-- Logs begin at Wed 2022-11-02 06:45:48 UTC, end at Wed 2022-11-02 07:59:00 UTC. -- Nov 02 07:21:31.779703 dv-cinder-804757-31-smb systemd[1]: Starting Devstack devstack@keystone.service... Nov 02 07:21:31.788222 dv-cinder-804757-31-smb devstack@keystone.service[81599]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Nov 02 07:21:31.792213 dv-cinder-804757-31-smb devstack@keystone.service[81599]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 2 07:21:31 2022] *** Nov 02 07:21:31.792213 dv-cinder-804757-31-smb devstack@keystone.service[81599]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 02 07:21:31.792213 dv-cinder-804757-31-smb devstack@keystone.service[81599]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 02 07:21:31.792213 dv-cinder-804757-31-smb devstack@keystone.service[81599]: nodename: dv-cinder-804757-31-smb Nov 02 07:21:31.792213 dv-cinder-804757-31-smb devstack@keystone.service[81599]: machine: x86_64 Nov 02 07:21:31.792213 dv-cinder-804757-31-smb devstack@keystone.service[81599]: clock source: unix Nov 02 07:21:31.792213 dv-cinder-804757-31-smb devstack@keystone.service[81599]: pcre jit disabled Nov 02 07:21:31.792213 dv-cinder-804757-31-smb devstack@keystone.service[81599]: detected number of CPU cores: 4 Nov 02 07:21:31.792213 dv-cinder-804757-31-smb devstack@keystone.service[81599]: current working directory: / Nov 02 07:21:31.792213 dv-cinder-804757-31-smb devstack@keystone.service[81599]: detected binary path: /usr/bin/uwsgi-core Nov 02 07:21:31.792213 dv-cinder-804757-31-smb devstack@keystone.service[81599]: your processes number limit is 47680 Nov 02 07:21:31.792213 dv-cinder-804757-31-smb devstack@keystone.service[81599]: your memory page size is 4096 bytes Nov 02 07:21:31.792213 dv-cinder-804757-31-smb devstack@keystone.service[81599]: detected max file descriptor number: 2048 Nov 02 07:21:31.792213 dv-cinder-804757-31-smb devstack@keystone.service[81599]: lock engine: pthread robust mutexes Nov 02 07:21:31.792213 dv-cinder-804757-31-smb devstack@keystone.service[81599]: thunder lock: enabled Nov 02 07:21:31.792213 dv-cinder-804757-31-smb devstack@keystone.service[81599]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Nov 02 07:21:31.792213 dv-cinder-804757-31-smb devstack@keystone.service[81599]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Nov 02 07:21:31.830611 dv-cinder-804757-31-smb devstack@keystone.service[81599]: Python main interpreter initialized at 0x55555ab139c0 Nov 02 07:21:31.830611 dv-cinder-804757-31-smb devstack@keystone.service[81599]: python threads support enabled Nov 02 07:21:31.830611 dv-cinder-804757-31-smb devstack@keystone.service[81599]: your server socket listen backlog is limited to 100 connections Nov 02 07:21:31.830611 dv-cinder-804757-31-smb devstack@keystone.service[81599]: your mercy for graceful operations on workers is 90 seconds Nov 02 07:21:31.830926 dv-cinder-804757-31-smb devstack@keystone.service[81599]: mapped 403077 bytes (393 KB) for 2 cores Nov 02 07:21:31.831034 dv-cinder-804757-31-smb devstack@keystone.service[81599]: *** Operational MODE: preforking *** Nov 02 07:21:31.831325 dv-cinder-804757-31-smb devstack@keystone.service[81599]: *** uWSGI is running in multiple interpreter mode *** Nov 02 07:21:31.831325 dv-cinder-804757-31-smb devstack@keystone.service[81599]: spawned uWSGI master process (pid: 81599) Nov 02 07:21:31.831529 dv-cinder-804757-31-smb systemd[1]: Started Devstack devstack@keystone.service. Nov 02 07:21:31.833803 dv-cinder-804757-31-smb devstack@keystone.service[81599]: spawned uWSGI worker 1 (pid: 81610, cores: 1) Nov 02 07:21:31.833803 dv-cinder-804757-31-smb devstack@keystone.service[81599]: spawned uWSGI worker 2 (pid: 81611, cores: 1) Nov 02 07:21:31.833803 dv-cinder-804757-31-smb devstack@keystone.service[81599]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 02 07:21:36.158346 dv-cinder-804757-31-smb devstack@keystone.service[81611]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 07:21:36.158346 dv-cinder-804757-31-smb devstack@keystone.service[81611]: from cryptography.utils import int_from_bytes Nov 02 07:21:36.159131 dv-cinder-804757-31-smb devstack@keystone.service[81611]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 07:21:36.159131 dv-cinder-804757-31-smb devstack@keystone.service[81611]: from cryptography.utils import int_from_bytes Nov 02 07:21:36.159710 dv-cinder-804757-31-smb devstack@keystone.service[81610]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 07:21:36.159710 dv-cinder-804757-31-smb devstack@keystone.service[81610]: from cryptography.utils import int_from_bytes Nov 02 07:21:36.160179 dv-cinder-804757-31-smb devstack@keystone.service[81610]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 07:21:36.160179 dv-cinder-804757-31-smb devstack@keystone.service[81610]: from cryptography.utils import int_from_bytes Nov 02 07:21:36.215449 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 07:21:36.215449 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 07:21:36.215449 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] command line args: [] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 07:21:36.216283 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 07:21:36.216373 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 07:21:36.216453 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 07:21:36.216526 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ================================================================================ {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 07:21:36.216602 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] command line args: [] {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 07:21:36.216680 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] admin_token = **** {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.216752 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 07:21:36.216752 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ================================================================================ {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 07:21:36.216881 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] config_dir = [] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.216881 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.216994 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] admin_token = **** {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.217062 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] config_source = [] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.217122 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] config_dir = [] {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.217178 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] debug = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.217234 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.217295 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.217622 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] config_source = [] {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.217622 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] debug = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.217813 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.217916 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.218055 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.218163 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.218264 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.218366 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.218460 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.218568 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.218656 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] list_limit = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.218736 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.218813 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] log_config_append = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.218888 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] list_limit = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.218963 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.219037 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] log_config_append = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.219114 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] log_dir = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.219193 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.219317 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] log_file = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.219397 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] log_dir = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.219473 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.219547 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] log_file = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.219616 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.219694 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.219766 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.219839 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.219914 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.220034 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.220138 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.220224 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.220298 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.220374 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.220450 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.220526 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.220604 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.220682 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.220758 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.220828 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.220903 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.220984 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.221055 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.221128 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.221198 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.221266 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.221266 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.221475 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.221558 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.221633 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.221708 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.221782 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.221853 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.221929 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.222006 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.222115 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] publish_errors = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.222203 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] publish_errors = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.222309 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.222388 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.222453 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.222528 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.222645 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.222719 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.222787 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.222875 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.222947 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.223023 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.223095 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] standard_threads = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.223168 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] standard_threads = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.223244 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.223319 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.223389 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.223468 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.223540 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.223608 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.223682 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] use_journal = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.223753 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] use_journal = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.223821 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] use_json = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.223897 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] use_json = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.223968 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] use_stderr = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.224068 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] use_stderr = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.224153 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] use_syslog = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.224231 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] use_syslog = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.224303 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.224379 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:36.224456 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.224526 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.224600 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.224676 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.224751 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.224904 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.224978 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.225051 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.225122 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.225191 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.225267 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.225343 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.225413 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.225482 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.225549 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.225624 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.225702 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.225779 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.225849 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.225923 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.225993 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.226061 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.226140 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.226212 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.226285 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.226355 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.226424 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.226496 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.226573 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.226644 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.226719 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.226795 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.226866 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.227006 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.227126 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.227203 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.227273 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.227342 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.227410 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.227478 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.227554 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.227626 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.227703 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.227773 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.227841 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.227909 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.227988 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.228092 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.228172 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.228243 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.228312 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.228381 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.228523 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.228596 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.228665 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.228739 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.228815 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.228885 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.228961 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.229033 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.229101 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.229226 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.229302 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.229370 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.229450 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.229521 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.229595 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.229670 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.229740 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.229808 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.229884 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.229955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.230023 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.230091 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.230159 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.230227 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.230305 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.230376 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.230445 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.230518 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.230587 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.230662 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.230738 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.230808 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.230910 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.231011 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.231136 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.231813 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.232271 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.232472 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.232596 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.232700 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.232805 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.232912 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.232912 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.233113 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.233191 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.233299 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.233382 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.233464 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.233544 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.233616 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.233741 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.233818 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.233888 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.234002 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.234086 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.234170 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.234283 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.234361 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.234432 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.234548 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.234634 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.234708 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.234824 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.234899 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.234968 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.235082 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.235165 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.235239 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.235311 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.235390 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.235460 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.235526 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.235603 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.235676 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.235749 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.235828 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.235900 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.235965 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.236039 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.236190 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.236274 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.236426 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.236506 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.236659 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.236740 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.236930 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.237168 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.237259 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.237419 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.237510 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.237660 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.237748 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.237895 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.237975 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.238128 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.238205 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.238382 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.238547 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.238659 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.238751 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.238823 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.238889 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.239053 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.239146 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.239294 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.239378 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.239528 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.239604 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.239771 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.239861 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.240004 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.240131 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.240260 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.240340 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.240493 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.240571 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.240726 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.240806 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.240958 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.241042 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.241216 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.241299 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.241455 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.241533 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.241697 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.241774 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.241934 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.242009 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.242171 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.242250 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.242411 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.242487 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.242646 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.242732 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.242881 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.242958 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.243112 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.243207 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.243340 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.243416 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.243565 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.243644 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.243791 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.243868 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.244022 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.244169 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.244257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.244330 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.244498 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.244577 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.244729 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.244806 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.244975 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.245055 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.245209 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.245287 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.245462 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.245550 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.245721 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.245807 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.245958 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.246065 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.246186 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] auth.external = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.246266 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] auth.external = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.246414 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.246491 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.246706 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.246786 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.246979 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.247064 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.247214 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] auth.password = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.247345 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] auth.password = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.247434 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] auth.token = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.247508 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] auth.token = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.247667 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.247747 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.247901 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.247980 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.248169 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.248263 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.248401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.248481 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.248647 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.248734 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.248893 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.248971 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.249120 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.249199 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.249354 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] credential.caching = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.249439 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] credential.caching = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.249598 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.249683 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.249844 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.249922 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.250088 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.250183 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.250330 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.250409 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.250572 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.250650 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.250805 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.250892 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.251051 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.251136 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.251302 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.251380 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.251537 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.251624 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.251786 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.252136 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.252343 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.252421 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.252585 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.252744 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.252845 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.252924 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.253083 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.253161 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.253338 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.253425 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.253569 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] federation.caching = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.253648 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] federation.caching = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.253805 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.253889 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.254046 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.254132 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.254289 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.254374 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.254623 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.254717 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.254778 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.254847 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.255016 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.255096 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.255266 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.255344 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.255499 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.255585 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.255749 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.255827 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.255983 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.256143 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.256253 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.256346 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.256489 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity.caching = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.256567 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] identity.caching = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.256732 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.256809 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.256977 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.257065 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.257211 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.257290 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.257442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.257520 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.257688 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.257777 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.257914 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.257993 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.258149 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.258226 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.258393 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.258481 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.258640 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.258718 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.258868 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.258946 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.259095 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.259181 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.259321 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.259399 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.259560 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.259637 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.259802 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.259882 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.260043 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.260139 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.260313 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.260391 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.261383 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.261540 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.261653 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.261731 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.261803 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.261873 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.261952 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.262025 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.262096 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.262166 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.262236 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.262300 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.262385 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.262529 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.262592 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.262651 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.262708 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.262765 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.262832 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.262893 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.262951 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.263021 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.263091 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.263242 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.263330 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.263496 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.263576 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.263738 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.263818 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.263973 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.264079 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.264253 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.264343 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.264483 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.264563 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.264720 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.264808 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.264948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.265028 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.265184 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.265263 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.265420 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.265508 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.265656 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.265734 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.265891 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.265969 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.266127 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.266244 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.266478 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.266563 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.266729 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.266807 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.266960 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.267096 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.267175 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.267247 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.267415 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.267493 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.267659 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.267745 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.267893 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.267990 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.268173 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.268264 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.268380 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.268476 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.268615 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.268695 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.user = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.268842 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.268924 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.269080 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.269169 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.269314 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.269394 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.269558 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.269636 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.269802 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.269888 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.270043 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.270122 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.270273 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.270351 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.270501 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.270588 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.270727 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.270806 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.270957 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.271035 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.271186 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.271266 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.271410 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.271488 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.271634 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.271716 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.271879 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.271959 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.272143 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.272227 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.272387 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.272465 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.272628 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.272710 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.272856 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.272938 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.273084 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.273161 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.273330 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.273410 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.273565 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.273644 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.273801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.273879 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.274035 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.274116 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.274270 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.274349 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.274512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.274591 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.274745 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.274825 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.274981 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.275059 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.275213 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.275291 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.275437 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.275511 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.275676 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.275754 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.275908 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.275991 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.276163 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.276247 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.276400 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.276479 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.276637 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.276715 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.276867 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.276947 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.277092 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.277169 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.277327 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.277499 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] resource.caching = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.277614 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] resource.caching = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.277733 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.277879 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.277957 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.278575 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.278657 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.278894 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.279010 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.279153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.279343 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.279421 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.279598 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.279685 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.279835 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.279914 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.280092 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.280174 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.280330 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] role.caching = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.280421 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.280567 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.280646 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] role.driver = sql {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.280794 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.280872 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] role.caching = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.281038 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] role.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.281123 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.281269 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.281348 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.281512 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.281590 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.281754 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.281840 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.281997 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.282075 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.282244 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.282336 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.282482 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.282572 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.282722 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.282803 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.282951 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.283029 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.283194 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.283282 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.283423 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.283501 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.283667 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.283746 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.283908 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.283988 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.284172 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.284327 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.284407 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.284562 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.289715 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.289843 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.289944 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.290042 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.290182 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.290292 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.290383 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.290464 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.290536 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.290606 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.290677 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.290747 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.290825 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.290899 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.290970 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.291041 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.291041 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.291159 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.291237 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.291316 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.291389 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.291460 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.291536 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.291608 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.291608 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.291751 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.291823 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.291893 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.291893 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.292010 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.292108 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.292184 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.292254 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.292325 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.292395 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] token.caching = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.292465 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.292543 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.292616 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.292686 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.292756 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] token.caching = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.292826 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.292896 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.292896 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.293032 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.293103 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.293173 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.293243 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.293320 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.293393 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.293464 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.293534 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.293604 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.293722 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.293804 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.293887 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.293958 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.294028 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.294099 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.294169 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.294247 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.294320 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.294391 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.294461 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.294461 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.294585 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.294585 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.294709 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.294792 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.294865 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.294865 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.295009 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.295082 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.295152 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] database.connection = **** {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.295152 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.295287 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.connection = **** {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.295360 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.295430 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.295430 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.295556 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.295625 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.295702 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.295775 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.295845 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.295914 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.295984 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.296074 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.296226 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.296304 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.296375 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.296445 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.296521 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.296613 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.296683 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.296757 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.296817 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.296875 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.296932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.297001 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.297079 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.297159 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.297231 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.297294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.297364 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.297434 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.297512 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.297585 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.297655 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.297725 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.297795 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.297864 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:36.297942 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 07:21:36.298021 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 07:21:36.327584 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.327806 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.328031 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.328271 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.328508 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.328735 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.336330 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.337303 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.364828 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.365054 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.365884 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.366120 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.425812 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.426890 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.480916 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.481099 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.481848 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.482089 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.639036 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.639249 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.639468 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.639556 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.639686 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.639770 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.639899 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.639985 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.640136 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.640222 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.640362 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.640579 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.669319 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.669568 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.669767 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.669858 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.669980 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.670079 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.670192 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.670273 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.670402 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.670483 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.670618 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.670707 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.670972 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.671140 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.689104 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.689277 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.702411 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.702640 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.702780 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.702864 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.702998 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.707381 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.707467 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.707543 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.707635 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.707749 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.707848 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.707928 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.708003 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.708003 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:36.723197 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.723405 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 02 07:21:36.723746 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.723947 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 02 07:21:36.724087 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.724250 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.724334 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 02 07:21:36.724512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.724625 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.724767 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.724849 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 02 07:21:36.725020 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.725100 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.725330 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.725725 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.725923 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.736206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.736206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.736206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.736206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.736502 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.736502 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.736502 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.736756 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.742312 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:36.743845 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:36.745200 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:36.745484 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.745764 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.746043 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.746326 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.746582 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.746873 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.747422 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:36.747524 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.747645 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.747727 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.747727 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.747852 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.747922 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.748119 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.748411 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.748676 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.748948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.749224 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.749497 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.749770 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.750040 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.771148 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.772617 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:36.772899 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.773990 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.775460 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:36.775773 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.777521 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:36.777801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.778698 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.781438 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:36.781732 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.782050 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.785010 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:36.785293 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.788637 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:36.788888 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.790878 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:36.791176 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.791464 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.791750 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.792028 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.792328 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.792602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.795358 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.795451 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:36.795451 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.795589 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.795859 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.796172 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.796455 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.796726 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.796997 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.808394 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.808664 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.812677 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:36.812874 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.813190 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.815859 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.816179 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.817181 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:36.820413 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:36.820514 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.824114 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.824209 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:36.825659 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:36.827399 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.827698 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.827983 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.828298 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.828594 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.828866 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:36.828950 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.832080 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.832424 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.832722 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.833133 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.833295 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.833583 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.844887 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:36.845178 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.845442 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.845703 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.849764 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:36.850051 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.850319 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.850581 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.852494 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.854024 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.855584 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.855865 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.858329 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.859252 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:36.859543 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.859656 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.859826 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.860133 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.860520 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.861324 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.861611 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.864316 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:36.864603 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.864885 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.865167 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.865565 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.871564 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:36.871928 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.872236 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.872610 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.873009 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.873290 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.873566 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.877244 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:36.877535 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.877819 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.878103 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.878490 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.878770 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.879057 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.889265 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:36.892165 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:36.894789 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:36.895032 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.896512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.897795 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:36.898032 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:36.898313 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.898711 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.900825 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.902344 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.904430 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:36.904714 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.905105 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.905768 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.907233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:36.910106 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.910495 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.910780 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.911059 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.911632 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.913149 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:36.916154 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.916549 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.916834 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.917111 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.918897 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:36.919183 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.919462 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.925271 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:36.925706 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.925900 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.926329 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:36.926616 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.926897 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.927171 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.927442 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.927714 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.928042 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.928292 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.932938 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.932938 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.932938 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.932938 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.932938 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.932938 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.933396 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:36.933396 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.933571 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.933846 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.934119 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.934930 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.935206 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.935492 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.935774 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.936043 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.936331 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.936591 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.936864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.937246 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:36.965872 dv-cinder-804757-31-smb devstack@keystone.service[81611]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55555ab139c0 pid: 81611 (default app) Nov 02 07:21:36.969358 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5e606-6240-4340-8cc9-a49ce2a2eaf1 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:36.969644 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5e606-6240-4340-8cc9-a49ce2a2eaf1 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:36.969914 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5e606-6240-4340-8cc9-a49ce2a2eaf1 None None] PATH_INFO: `/v3` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:36.973406 dv-cinder-804757-31-smb devstack@keystone.service[81610]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55555ab139c0 pid: 81610 (default app) Nov 02 07:21:36.974130 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Wed Nov 2 07:21:36 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:44.588496 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb2826-cf96-4725-b4f2-f6fb76f54ea2 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:44.589022 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb2826-cf96-4725-b4f2-f6fb76f54ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:44.589022 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb2826-cf96-4725-b4f2-f6fb76f54ea2 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:44.593872 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:21:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:21:44.599073 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bceccd7-2bda-4375-9865-c3c167d5a7ab None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:44.599522 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bceccd7-2bda-4375-9865-c3c167d5a7ab None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:44.599617 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bceccd7-2bda-4375-9865-c3c167d5a7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:44.670186 dv-cinder-804757-31-smb devstack@keystone.service[81611]: INFO dbcounter [None req-4bceccd7-2bda-4375-9865-c3c167d5a7ab None None] Registered counter for database keystone Nov 02 07:21:44.688879 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG oslo_db.sqlalchemy.engines [None req-4bceccd7-2bda-4375-9865-c3c167d5a7ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 07:21:44.694933 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writer thread running {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 07:21:44.875131 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG passlib.handlers.bcrypt [None req-4bceccd7-2bda-4375-9865-c3c167d5a7ab None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81611) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 02 07:21:44.875436 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG passlib.handlers.bcrypt [None req-4bceccd7-2bda-4375-9865-c3c167d5a7ab None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81611) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 02 07:21:44.934143 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-4bceccd7-2bda-4375-9865-c3c167d5a7ab None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:44.935915 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4bceccd7-2bda-4375-9865-c3c167d5a7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:45.063377 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:21:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 02 07:21:45.485713 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb2826-cf96-4725-b4f2-f6fb76f54ea2 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:45.553740 dv-cinder-804757-31-smb devstack@keystone.service[81610]: INFO dbcounter [None req-a2bb2826-cf96-4725-b4f2-f6fb76f54ea2 None None] Registered counter for database keystone Nov 02 07:21:45.575485 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG oslo_db.sqlalchemy.engines [None req-a2bb2826-cf96-4725-b4f2-f6fb76f54ea2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81610) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 07:21:45.581628 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writer thread running {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 07:21:45.699692 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb2826-cf96-4725-b4f2-f6fb76f54ea2 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:45.703980 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a010e51-406f-492c-bd11-02a1ad02f66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:45.704616 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a010e51-406f-492c-bd11-02a1ad02f66b admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:45.704891 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a010e51-406f-492c-bd11-02a1ad02f66b admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:45.705158 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a010e51-406f-492c-bd11-02a1ad02f66b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:45.713183 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a010e51-406f-492c-bd11-02a1ad02f66b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:45.764968 dv-cinder-804757-31-smb devstack@keystone.service[81610]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8a010e51-406f-492c-bd11-02a1ad02f66b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 02 07:21:45.765250 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a010e51-406f-492c-bd11-02a1ad02f66b admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:45.774288 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Wed Nov 2 07:21:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 07:21:45.780393 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bceccd7-2bda-4375-9865-c3c167d5a7ab None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:45.797669 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bceccd7-2bda-4375-9865-c3c167d5a7ab None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:45.802007 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1febf4ad-fe06-4948-ab4d-8ab9ea198c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:45.803124 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febf4ad-fe06-4948-ab4d-8ab9ea198c71 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:45.803402 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febf4ad-fe06-4948-ab4d-8ab9ea198c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:45.803671 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febf4ad-fe06-4948-ab4d-8ab9ea198c71 admin admin] PATH_INFO: `/v3/projects/3f9bbbd097ac4710887083fd253be149` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:45.805290 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1febf4ad-fe06-4948-ab4d-8ab9ea198c71 admin admin] RBAC: Authorizing `identity:get_project(project_id=3f9bbbd097ac4710887083fd253be149)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:45.857763 dv-cinder-804757-31-smb devstack@keystone.service[81611]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1febf4ad-fe06-4948-ab4d-8ab9ea198c71 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 02 07:21:45.858094 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1febf4ad-fe06-4948-ab4d-8ab9ea198c71 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:45.862541 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Wed Nov 2 07:21:45 2022] GET /identity/v3/projects/3f9bbbd097ac4710887083fd253be149 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:47.998265 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e226f-46c8-44d2-8262-50f0f5a8a21a None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:47.998731 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e226f-46c8-44d2-8262-50f0f5a8a21a None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:47.998813 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e226f-46c8-44d2-8262-50f0f5a8a21a None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:48.003124 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:21:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:21:48.008474 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f73cab-9351-4315-8b39-099b764c90c8 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:48.008939 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f73cab-9351-4315-8b39-099b764c90c8 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:48.009028 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f73cab-9351-4315-8b39-099b764c90c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:48.029684 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-f8f73cab-9351-4315-8b39-099b764c90c8 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:48.031189 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f8f73cab-9351-4315-8b39-099b764c90c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:48.038878 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:21:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 07:21:48.303791 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e226f-46c8-44d2-8262-50f0f5a8a21a None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:48.315922 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e226f-46c8-44d2-8262-50f0f5a8a21a None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:48.320221 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147ffa0-11d9-44f7-8e31-665297f9c597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:48.320820 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147ffa0-11d9-44f7-8e31-665297f9c597 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:48.321101 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147ffa0-11d9-44f7-8e31-665297f9c597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:48.321375 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147ffa0-11d9-44f7-8e31-665297f9c597 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:48.328919 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e147ffa0-11d9-44f7-8e31-665297f9c597 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:48.330688 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e147ffa0-11d9-44f7-8e31-665297f9c597 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:48.339228 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Wed Nov 2 07:21:48 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:21:48.345203 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f73cab-9351-4315-8b39-099b764c90c8 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:48.354066 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f73cab-9351-4315-8b39-099b764c90c8 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:48.359051 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30c28a-b89b-4896-9062-ebfe00443605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:48.359664 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30c28a-b89b-4896-9062-ebfe00443605 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:48.359940 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30c28a-b89b-4896-9062-ebfe00443605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:48.360244 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30c28a-b89b-4896-9062-ebfe00443605 admin admin] PATH_INFO: `/v3/users/7738e47cbf7c4d698504a795d02c194a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:48.361532 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30c28a-b89b-4896-9062-ebfe00443605 admin admin] RBAC: Authorizing `identity:get_user(user_id=7738e47cbf7c4d698504a795d02c194a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:48.363329 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30c28a-b89b-4896-9062-ebfe00443605 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:48.364869 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Wed Nov 2 07:21:48 2022] GET /identity/v3/users/7738e47cbf7c4d698504a795d02c194a => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:50.546013 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40695b83-9159-49d1-90b7-d297d25d1507 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:50.546582 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40695b83-9159-49d1-90b7-d297d25d1507 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:50.546582 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40695b83-9159-49d1-90b7-d297d25d1507 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:50.547878 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:21:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:50.553312 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703b27a-1931-4bf8-970b-e51cb530c860 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:50.553734 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703b27a-1931-4bf8-970b-e51cb530c860 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:50.553849 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703b27a-1931-4bf8-970b-e51cb530c860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:50.572771 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-d703b27a-1931-4bf8-970b-e51cb530c860 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:50.574295 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d703b27a-1931-4bf8-970b-e51cb530c860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:50.628410 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5e0cd-8585-4e81-9fc6-b2847685e8c1 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:50.628692 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5e0cd-8585-4e81-9fc6-b2847685e8c1 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:50.629214 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5e0cd-8585-4e81-9fc6-b2847685e8c1 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:50.634975 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:21:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:50.636332 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d488dec-68cf-4553-af0f-10dcd728e1a1 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:50.636836 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d488dec-68cf-4553-af0f-10dcd728e1a1 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:50.637389 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d488dec-68cf-4553-af0f-10dcd728e1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:50.661031 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:21:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:21:50.680059 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG passlib.handlers.bcrypt [None req-1d488dec-68cf-4553-af0f-10dcd728e1a1 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81610) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 02 07:21:50.680468 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG passlib.handlers.bcrypt [None req-1d488dec-68cf-4553-af0f-10dcd728e1a1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81610) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 02 07:21:50.729536 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-1d488dec-68cf-4553-af0f-10dcd728e1a1 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:50.731618 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-1d488dec-68cf-4553-af0f-10dcd728e1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:50.828724 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:21:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:21:50.927726 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d703b27a-1931-4bf8-970b-e51cb530c860 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:50.955861 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:51.034957 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d703b27a-1931-4bf8-970b-e51cb530c860 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:51.066998 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2759c-bd16-4077-98d6-73c565dad401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:51.067631 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2759c-bd16-4077-98d6-73c565dad401 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:51.067908 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2759c-bd16-4077-98d6-73c565dad401 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:51.068208 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2759c-bd16-4077-98d6-73c565dad401 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:51.079460 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2759c-bd16-4077-98d6-73c565dad401 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:21:51.088264 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-a4f2759c-bd16-4077-98d6-73c565dad401 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:21:51.088264 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:21:51.088264 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:21:51.088264 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:21:51.088264 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:21:51.088264 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:21:51.088264 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:21:51.088264 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:21:51.088264 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:21:51.088264 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:21:51.088264 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:21:51.088264 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:21:51.088264 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:21:51.088264 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:21:51.088264 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:21:51.088264 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:21:51.089310 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:21:51.089310 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:21:51.089310 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:21:51.089310 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:21:51.089310 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:21:51.089310 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:21:51.089310 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:21:51.089310 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:21:51.089310 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:21:51.089310 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:21:51.089310 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:21:51.089310 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:21:51.089310 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:21:51.089310 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:21:51.089310 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:21:51.089310 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:21:51.090317 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:21:51.090317 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:21:51.090317 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:21:51.090317 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:21:51.090317 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:21:51.090317 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:21:51.090317 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:21:51.090317 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:21:51.090317 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:21:51.090317 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:21:51.090317 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:21:51.090317 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:21:51.090317 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Nov 2 07:21:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:21:51.095836 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d488dec-68cf-4553-af0f-10dcd728e1a1 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:51.097007 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2759c-bd16-4077-98d6-73c565dad401 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:51.178675 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:51.196649 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d488dec-68cf-4553-af0f-10dcd728e1a1 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:51.196908 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2759c-bd16-4077-98d6-73c565dad401 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:51.199709 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:51.232414 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c89a43-41c1-4549-bacb-aaa9f077933d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:51.233023 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c89a43-41c1-4549-bacb-aaa9f077933d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:51.233304 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c89a43-41c1-4549-bacb-aaa9f077933d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:51.233581 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c89a43-41c1-4549-bacb-aaa9f077933d None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:51.234270 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c89a43-41c1-4549-bacb-aaa9f077933d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:21:51.234568 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c89a43-41c1-4549-bacb-aaa9f077933d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:51.235178 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ce3f9-ee99-415a-b1ce-7d92a60966e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:51.235968 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c89a43-41c1-4549-bacb-aaa9f077933d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:51.236113 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ce3f9-ee99-415a-b1ce-7d92a60966e7 None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:51.236578 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ce3f9-ee99-415a-b1ce-7d92a60966e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:51.236894 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ce3f9-ee99-415a-b1ce-7d92a60966e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:51.238207 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ce3f9-ee99-415a-b1ce-7d92a60966e7 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:51.239617 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ce3f9-ee99-415a-b1ce-7d92a60966e7 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:51.247684 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 8/15] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Nov 2 07:21:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:21:51.253465 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c89a43-41c1-4549-bacb-aaa9f077933d None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:51.335639 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.sql.core [None req-082ce3f9-ee99-415a-b1ce-7d92a60966e7 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 07:21:51.335639 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 07:21:51.335639 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [parameters: {'id': 'e3413ec1fbef44ff9dc7e0ae9b077995', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Nov 02 07:21:51.335639 dv-cinder-804757-31-smb devstack@keystone.service[81610]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81610) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 07:21:51.350691 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c89a43-41c1-4549-bacb-aaa9f077933d None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:51.354314 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-082ce3f9-ee99-415a-b1ce-7d92a60966e7 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Nov 02 07:21:51.354314 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:21:51.354314 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 07:21:51.354314 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 07:21:51.354314 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 07:21:51.354314 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 07:21:51.354314 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 07:21:51.354314 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 07:21:51.354314 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 07:21:51.354314 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application conn.query(q) Nov 02 07:21:51.354314 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 07:21:51.354314 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 07:21:51.354314 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 07:21:51.354314 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application result.read() Nov 02 07:21:51.355236 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 07:21:51.355236 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 07:21:51.355236 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 07:21:51.355236 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 07:21:51.355236 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 07:21:51.355236 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 07:21:51.355236 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 07:21:51.355236 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 07:21:51.355236 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 07:21:51.355236 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:21:51.355236 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Nov 02 07:21:51.355236 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:21:51.355236 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:21:51.355236 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Nov 02 07:21:51.355236 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return method(*args, **kwargs) Nov 02 07:21:51.355236 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Nov 02 07:21:51.355236 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return project_ref.to_dict() Nov 02 07:21:51.355236 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 07:21:51.356791 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application next(self.gen) Nov 02 07:21:51.356791 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Nov 02 07:21:51.356791 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application yield resource Nov 02 07:21:51.356791 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 07:21:51.356791 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application next(self.gen) Nov 02 07:21:51.356791 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Nov 02 07:21:51.356791 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self.session.rollback() Nov 02 07:21:51.356791 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 07:21:51.356791 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self.force_reraise() Nov 02 07:21:51.356791 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 07:21:51.356791 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise self.value Nov 02 07:21:51.356791 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Nov 02 07:21:51.356791 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Nov 02 07:21:51.356791 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Nov 02 07:21:51.356791 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application session.commit() Nov 02 07:21:51.356791 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Nov 02 07:21:51.356791 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Nov 02 07:21:51.357809 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Nov 02 07:21:51.357809 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._prepare_impl() Nov 02 07:21:51.357809 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Nov 02 07:21:51.357809 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self.session.flush() Nov 02 07:21:51.357809 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 07:21:51.357809 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._flush(objects) Nov 02 07:21:51.357809 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 07:21:51.357809 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Nov 02 07:21:51.357809 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 07:21:51.357809 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application compat.raise_( Nov 02 07:21:51.357809 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 07:21:51.357809 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception Nov 02 07:21:51.357809 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 07:21:51.357809 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application flush_context.execute() Nov 02 07:21:51.357809 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 07:21:51.357809 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rec.execute(self) Nov 02 07:21:51.357809 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 07:21:51.358931 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Nov 02 07:21:51.358931 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 07:21:51.358931 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application _emit_insert_statements( Nov 02 07:21:51.358931 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Nov 02 07:21:51.358931 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application c = connection._execute_20( Nov 02 07:21:51.358931 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 07:21:51.358931 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 07:21:51.358931 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 07:21:51.358931 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Nov 02 07:21:51.358931 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 07:21:51.358931 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ret = self._execute_context( Nov 02 07:21:51.358931 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 07:21:51.358931 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Nov 02 07:21:51.358931 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 07:21:51.358931 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 07:21:51.359884 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 07:21:51.359884 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception Nov 02 07:21:51.359884 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 07:21:51.359884 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 07:21:51.359884 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 07:21:51.359884 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 07:21:51.359884 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 07:21:51.359884 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 07:21:51.359884 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 07:21:51.359884 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application conn.query(q) Nov 02 07:21:51.359884 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 07:21:51.359884 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 07:21:51.359884 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 07:21:51.359884 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application result.read() Nov 02 07:21:51.359884 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 07:21:51.359884 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 07:21:51.359884 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 07:21:51.360872 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 07:21:51.360872 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 07:21:51.360872 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 07:21:51.360872 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 07:21:51.360872 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 07:21:51.360872 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 07:21:51.360872 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 07:21:51.360872 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [parameters: {'id': 'e3413ec1fbef44ff9dc7e0ae9b077995', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Nov 02 07:21:51.360872 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 07:21:51.360872 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:21:51.360872 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:21:51.360872 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:21:51.360872 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:21:51.360872 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Nov 02 07:21:51.360872 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Nov 02 07:21:51.361742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Nov 02 07:21:51.361742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Nov 02 07:21:51.361742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Nov 02 07:21:51.361742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:21:51.361742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:21:51.361742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:21:51.361742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:21:51.361742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:21:51.361742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:21:51.361742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:21:51.361742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:21:51.361742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:21:51.361742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:21:51.361742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:21:51.361742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:21:51.361742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:21:51.361742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:21:51.362706 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Nov 02 07:21:51.362706 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Nov 02 07:21:51.362706 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:21:51.362706 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:21:51.362706 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Nov 02 07:21:51.362706 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Nov 02 07:21:51.362706 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:21:51.362706 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:21:51.362706 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Nov 02 07:21:51.362706 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.Conflict( Nov 02 07:21:51.362706 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Nov 02 07:21:51.362706 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:21:51.362706 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 8/16] 10.222.0.16 () {60 vars in 1137 bytes} [Wed Nov 2 07:21:51 2022] POST /identity/v3/domains => generated 190 bytes in 260 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:21:51.362706 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ce3f9-ee99-415a-b1ce-7d92a60966e7 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:51.391537 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300af1d2-6183-44b3-943a-45fb979319f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:51.392201 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300af1d2-6183-44b3-943a-45fb979319f1 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:51.392481 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300af1d2-6183-44b3-943a-45fb979319f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:51.392758 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300af1d2-6183-44b3-943a-45fb979319f1 None admin] PATH_INFO: `/v3/users/7738e47cbf7c4d698504a795d02c194a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:51.393915 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300af1d2-6183-44b3-943a-45fb979319f1 None admin] RBAC: Authorizing `identity:get_user(user_id=7738e47cbf7c4d698504a795d02c194a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:51.395370 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300af1d2-6183-44b3-943a-45fb979319f1 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:51.397197 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 9/17] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Nov 2 07:21:51 2022] GET /identity/v3/users/7738e47cbf7c4d698504a795d02c194a => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:21:51.403480 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300af1d2-6183-44b3-943a-45fb979319f1 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:51.418361 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:51.463259 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ce3f9-ee99-415a-b1ce-7d92a60966e7 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:51.496839 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c9fff-75cd-49a9-a062-dd36136ca642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:51.497778 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c9fff-75cd-49a9-a062-dd36136ca642 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:51.498119 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c9fff-75cd-49a9-a062-dd36136ca642 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:51.498450 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c9fff-75cd-49a9-a062-dd36136ca642 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:51.502956 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300af1d2-6183-44b3-943a-45fb979319f1 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:51.516784 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c9fff-75cd-49a9-a062-dd36136ca642 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:51.518230 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c9fff-75cd-49a9-a062-dd36136ca642 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:51.534256 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-f89c9fff-75cd-49a9-a062-dd36136ca642 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:21:51.534256 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:21:51.534256 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:21:51.534256 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:21:51.534256 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:21:51.534256 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:21:51.534256 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:21:51.534256 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:21:51.534256 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:21:51.534256 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:21:51.534256 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:21:51.534256 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:21:51.534256 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:21:51.534256 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:21:51.534256 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:21:51.534256 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:21:51.535079 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:21:51.535079 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:21:51.535079 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:21:51.535079 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:21:51.535079 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:21:51.535079 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:21:51.535079 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:21:51.535079 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:21:51.535079 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:21:51.535079 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:21:51.535079 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:21:51.535079 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:21:51.535079 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:21:51.535079 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:21:51.535079 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:21:51.535079 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:21:51.535079 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:21:51.535954 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:21:51.535954 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:21:51.535954 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:21:51.535954 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 9/18] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:21:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:21:51.537603 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8882347-b0fb-4bdf-abff-436c915da5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:51.538236 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8882347-b0fb-4bdf-abff-436c915da5da None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:51.538515 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8882347-b0fb-4bdf-abff-436c915da5da None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:51.538789 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8882347-b0fb-4bdf-abff-436c915da5da None admin] PATH_INFO: `/v3/domains/default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:51.539885 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8882347-b0fb-4bdf-abff-436c915da5da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:51.541238 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c9fff-75cd-49a9-a062-dd36136ca642 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:51.541376 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8882347-b0fb-4bdf-abff-436c915da5da None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:51.542904 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 10/19] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:21:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:21:51.548244 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8882347-b0fb-4bdf-abff-436c915da5da None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:51.562670 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:51.634703 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:51.644187 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c9fff-75cd-49a9-a062-dd36136ca642 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:51.655369 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8882347-b0fb-4bdf-abff-436c915da5da None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:51.681050 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c1c47-2ea8-458d-93cd-7b226fc021b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:51.681653 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c1c47-2ea8-458d-93cd-7b226fc021b0 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:51.681926 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c1c47-2ea8-458d-93cd-7b226fc021b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:51.682201 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c1c47-2ea8-458d-93cd-7b226fc021b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:51.682834 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c1c47-2ea8-458d-93cd-7b226fc021b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:21:51.683135 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c1c47-2ea8-458d-93cd-7b226fc021b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:51.684556 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c1c47-2ea8-458d-93cd-7b226fc021b0 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:51.689797 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bf291-8421-4efb-9408-caa2fe3efca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:51.690449 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bf291-8421-4efb-9408-caa2fe3efca4 None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:51.690730 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bf291-8421-4efb-9408-caa2fe3efca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:51.691005 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bf291-8421-4efb-9408-caa2fe3efca4 None admin] PATH_INFO: `/v3/domains/default/users/7738e47cbf7c4d698504a795d02c194a/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:51.692962 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10bf291-8421-4efb-9408-caa2fe3efca4 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7738e47cbf7c4d698504a795d02c194a, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:51.694404 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10bf291-8421-4efb-9408-caa2fe3efca4 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:51.702146 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 10/20] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:21:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:21:51.881005 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 11/21] 10.222.0.16 () {58 vars in 1361 bytes} [Wed Nov 2 07:21:51 2022] PUT /identity/v3/domains/default/users/7738e47cbf7c4d698504a795d02c194a/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:21:54.395871 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90c558-cef5-4313-90ca-b7541e73f726 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:54.396433 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90c558-cef5-4313-90ca-b7541e73f726 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:54.396433 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90c558-cef5-4313-90ca-b7541e73f726 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:54.397781 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 11/22] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:54.404169 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913543c-ffa1-4a1f-93f8-b95643dd5894 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:54.404561 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913543c-ffa1-4a1f-93f8-b95643dd5894 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:54.404740 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913543c-ffa1-4a1f-93f8-b95643dd5894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:54.445171 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-d913543c-ffa1-4a1f-93f8-b95643dd5894 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:54.446712 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d913543c-ffa1-4a1f-93f8-b95643dd5894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:54.538366 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 12/23] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:21:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:21:54.677189 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97065bcf-14fe-42ca-ba8f-d073a3e90e10 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:54.677504 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97065bcf-14fe-42ca-ba8f-d073a3e90e10 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:54.677686 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97065bcf-14fe-42ca-ba8f-d073a3e90e10 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:54.679127 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 12/24] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:54.684521 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba326d58-c0a0-4da8-ba59-5f8340c1aec6 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:54.684818 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba326d58-c0a0-4da8-ba59-5f8340c1aec6 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:54.685196 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba326d58-c0a0-4da8-ba59-5f8340c1aec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:54.705650 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-ba326d58-c0a0-4da8-ba59-5f8340c1aec6 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:54.706869 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ba326d58-c0a0-4da8-ba59-5f8340c1aec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:54.749574 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b0b1a-9e7c-40e9-8c00-6f28a9ce2838 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:54.749876 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b0b1a-9e7c-40e9-8c00-6f28a9ce2838 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:54.750119 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b0b1a-9e7c-40e9-8c00-6f28a9ce2838 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:54.751899 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 13/25] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:21:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:21:54.763748 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d7e64-9f32-4369-aeab-cf30cf829571 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:54.764035 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d7e64-9f32-4369-aeab-cf30cf829571 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:54.764358 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d7e64-9f32-4369-aeab-cf30cf829571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:54.791584 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-ad8d7e64-9f32-4369-aeab-cf30cf829571 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:54.793393 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-ad8d7e64-9f32-4369-aeab-cf30cf829571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:54.795324 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 13/26] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:21:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:21:54.800073 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:54.897387 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 14/27] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:21:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:21:54.944462 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba326d58-c0a0-4da8-ba59-5f8340c1aec6 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:54.971892 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fb2ba-0a80-43a6-8163-c57793171d4a None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:54.972501 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fb2ba-0a80-43a6-8163-c57793171d4a None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:54.972961 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fb2ba-0a80-43a6-8163-c57793171d4a None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:54.974457 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 15/28] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:21:54.979518 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044b212-3f02-4b19-a7a3-1701c6685160 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:54.980015 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044b212-3f02-4b19-a7a3-1701c6685160 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:54.980491 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044b212-3f02-4b19-a7a3-1701c6685160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:55.006602 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-9044b212-3f02-4b19-a7a3-1701c6685160 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:55.008660 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-9044b212-3f02-4b19-a7a3-1701c6685160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:55.028974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:55.135406 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba326d58-c0a0-4da8-ba59-5f8340c1aec6 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:55.150751 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 16/29] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:21:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:21:55.180382 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52119f1-69e6-4545-a614-441fdc77aa2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:55.181311 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52119f1-69e6-4545-a614-441fdc77aa2f None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:55.181788 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52119f1-69e6-4545-a614-441fdc77aa2f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:55.182264 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52119f1-69e6-4545-a614-441fdc77aa2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:55.193445 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52119f1-69e6-4545-a614-441fdc77aa2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:21:55.198610 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-b52119f1-69e6-4545-a614-441fdc77aa2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:21:55.198610 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:21:55.198610 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:21:55.198610 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:21:55.198610 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:21:55.198610 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:21:55.198610 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:21:55.198610 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:21:55.198610 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:21:55.198610 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:21:55.198610 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:21:55.198610 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:21:55.198610 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:21:55.198610 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:21:55.198610 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:21:55.198610 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:21:55.199423 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:21:55.199423 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:21:55.199423 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:21:55.199423 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:21:55.199423 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:21:55.199423 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:21:55.199423 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:21:55.199423 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:21:55.199423 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:21:55.199423 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:21:55.199423 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:21:55.199423 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:21:55.199423 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:21:55.199423 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:21:55.199423 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:21:55.199423 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:21:55.200744 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:21:55.200744 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:21:55.200744 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:21:55.200744 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:21:55.200744 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:21:55.200744 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:21:55.200744 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:21:55.200744 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:21:55.200744 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:21:55.200744 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:21:55.200744 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:21:55.200744 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:21:55.202956 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 14/30] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Nov 2 07:21:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:21:55.208809 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044b212-3f02-4b19-a7a3-1701c6685160 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:55.218038 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52119f1-69e6-4545-a614-441fdc77aa2f None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:55.324436 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:55.398056 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52119f1-69e6-4545-a614-441fdc77aa2f None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:55.401242 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044b212-3f02-4b19-a7a3-1701c6685160 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:55.460131 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e93707-e44d-42a4-9b7e-ac3f7a54797a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:55.461394 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd485c-f2f4-4abd-9f28-dcfeb70bfae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:55.461653 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e93707-e44d-42a4-9b7e-ac3f7a54797a None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:55.462041 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd485c-f2f4-4abd-9f28-dcfeb70bfae6 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:55.462329 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd485c-f2f4-4abd-9f28-dcfeb70bfae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:55.462531 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e93707-e44d-42a4-9b7e-ac3f7a54797a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:55.462624 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd485c-f2f4-4abd-9f28-dcfeb70bfae6 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:55.463070 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e93707-e44d-42a4-9b7e-ac3f7a54797a None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:55.463266 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd485c-f2f4-4abd-9f28-dcfeb70bfae6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:21:55.463576 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd485c-f2f4-4abd-9f28-dcfeb70bfae6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:55.464342 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e93707-e44d-42a4-9b7e-ac3f7a54797a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:55.464990 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd485c-f2f4-4abd-9f28-dcfeb70bfae6 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:55.466468 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e93707-e44d-42a4-9b7e-ac3f7a54797a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:55.479626 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 17/31] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Nov 2 07:21:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:55.480752 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd485c-f2f4-4abd-9f28-dcfeb70bfae6 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:55.486309 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:55.559346 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 15/32] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Nov 2 07:21:55 2022] POST /identity/v3/roles => generated 219 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:21:55.560594 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e93707-e44d-42a4-9b7e-ac3f7a54797a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:55.597941 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd485c-f2f4-4abd-9f28-dcfeb70bfae6 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:55.642968 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1a67b-af04-49c5-a04e-c5cb34d2c802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:55.643601 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1a67b-af04-49c5-a04e-c5cb34d2c802 None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:55.643879 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1a67b-af04-49c5-a04e-c5cb34d2c802 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:55.644176 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1a67b-af04-49c5-a04e-c5cb34d2c802 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:55.645122 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c1a67b-af04-49c5-a04e-c5cb34d2c802 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:55.646409 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c1a67b-af04-49c5-a04e-c5cb34d2c802 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:55.683817 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e93707-e44d-42a4-9b7e-ac3f7a54797a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:55.709487 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:55.725691 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b892d-766a-4c66-b65d-ee7748498533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:55.726748 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b892d-766a-4c66-b65d-ee7748498533 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:55.727188 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b892d-766a-4c66-b65d-ee7748498533 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:55.727874 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b892d-766a-4c66-b65d-ee7748498533 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:55.740360 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b892d-766a-4c66-b65d-ee7748498533 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:55.742161 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b892d-766a-4c66-b65d-ee7748498533 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:55.761194 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-f26b892d-766a-4c66-b65d-ee7748498533 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:21:55.761194 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:21:55.761194 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:21:55.761194 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:21:55.761194 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:21:55.761194 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:21:55.761194 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:21:55.761194 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:21:55.761194 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:21:55.761194 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:21:55.761194 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:21:55.761194 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:21:55.761194 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:21:55.761194 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:21:55.761194 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:21:55.761194 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:21:55.771545 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:21:55.771545 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:21:55.771545 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:21:55.771545 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:21:55.771545 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:21:55.771545 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:21:55.771545 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:21:55.771545 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:21:55.771545 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:21:55.771545 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:21:55.771545 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:21:55.771545 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:21:55.771545 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:21:55.771545 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:21:55.771545 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:21:55.771545 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:21:55.771545 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:21:55.772473 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:21:55.772473 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:21:55.772473 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:21:55.772473 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 16/33] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:21:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:21:55.772473 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b892d-766a-4c66-b65d-ee7748498533 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:55.877774 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 18/34] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Nov 2 07:21:55 2022] POST /identity/v3/roles => generated 225 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:21:55.879136 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1a67b-af04-49c5-a04e-c5cb34d2c802 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:55.958528 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b892d-766a-4c66-b65d-ee7748498533 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:55.981011 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:56.010170 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb6950-2754-47bd-b1cc-4fb4f43ed7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:56.010833 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb6950-2754-47bd-b1cc-4fb4f43ed7a2 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:56.011117 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb6950-2754-47bd-b1cc-4fb4f43ed7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:56.011390 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb6950-2754-47bd-b1cc-4fb4f43ed7a2 None admin] PATH_INFO: `/v3/users/7738e47cbf7c4d698504a795d02c194a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:56.013474 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fb6950-2754-47bd-b1cc-4fb4f43ed7a2 None admin] RBAC: Authorizing `identity:get_user(user_id=7738e47cbf7c4d698504a795d02c194a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:56.015000 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fb6950-2754-47bd-b1cc-4fb4f43ed7a2 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:56.020526 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 17/35] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Nov 2 07:21:55 2022] GET /identity/v3/users/7738e47cbf7c4d698504a795d02c194a => generated 247 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:56.023099 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375eff00-688f-4f95-8a94-84255022e10b None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:56.023653 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375eff00-688f-4f95-8a94-84255022e10b None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:56.024418 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375eff00-688f-4f95-8a94-84255022e10b None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:56.026531 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 18/36] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:21:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:56.028307 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375eff00-688f-4f95-8a94-84255022e10b None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:56.045329 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1a67b-af04-49c5-a04e-c5cb34d2c802 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:56.092456 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9dd0ac-971d-40e2-b8fe-03e00300c8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:56.093135 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9dd0ac-971d-40e2-b8fe-03e00300c8ef None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:56.093425 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9dd0ac-971d-40e2-b8fe-03e00300c8ef None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:56.093705 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9dd0ac-971d-40e2-b8fe-03e00300c8ef None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:56.094435 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9dd0ac-971d-40e2-b8fe-03e00300c8ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:21:56.094742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9dd0ac-971d-40e2-b8fe-03e00300c8ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:56.096451 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9dd0ac-971d-40e2-b8fe-03e00300c8ef None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:56.111584 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 19/37] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:21:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:56.117390 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913150f-5003-42f3-9dbc-aaba829408bd None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:56.117675 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913150f-5003-42f3-9dbc-aaba829408bd None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:56.117950 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913150f-5003-42f3-9dbc-aaba829408bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:56.141997 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-1913150f-5003-42f3-9dbc-aaba829408bd None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:56.143947 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-1913150f-5003-42f3-9dbc-aaba829408bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:56.209443 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:56.226821 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 20/38] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:21:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:21:56.227649 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913150f-5003-42f3-9dbc-aaba829408bd None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:56.275966 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375eff00-688f-4f95-8a94-84255022e10b None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:56.293362 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:56.314291 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b70c55-76e0-462d-a33b-a87e22884f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:56.314932 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b70c55-76e0-462d-a33b-a87e22884f57 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:56.315217 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b70c55-76e0-462d-a33b-a87e22884f57 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:56.315494 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b70c55-76e0-462d-a33b-a87e22884f57 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:56.317061 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b70c55-76e0-462d-a33b-a87e22884f57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:56.318605 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b70c55-76e0-462d-a33b-a87e22884f57 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:56.326282 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 19/39] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:21:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:56.326282 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d44843-e25b-4a04-aed5-cffbd80d4c7d None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:56.326282 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d44843-e25b-4a04-aed5-cffbd80d4c7d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:56.326282 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d44843-e25b-4a04-aed5-cffbd80d4c7d None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:56.326282 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 20/40] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:21:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:56.328211 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d44843-e25b-4a04-aed5-cffbd80d4c7d None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:56.346744 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913150f-5003-42f3-9dbc-aaba829408bd None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:56.384690 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafcfb7c-ad68-4d60-9aca-b0b4371d61ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:56.385332 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafcfb7c-ad68-4d60-9aca-b0b4371d61ab None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:56.385609 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafcfb7c-ad68-4d60-9aca-b0b4371d61ab None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:56.385900 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafcfb7c-ad68-4d60-9aca-b0b4371d61ab None admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:56.386553 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafcfb7c-ad68-4d60-9aca-b0b4371d61ab None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:56.388223 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafcfb7c-ad68-4d60-9aca-b0b4371d61ab None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:56.438287 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d44843-e25b-4a04-aed5-cffbd80d4c7d None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:56.447296 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:56.471640 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d8654-0bd3-4eb5-a5e1-2a66c898e53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:56.472274 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d8654-0bd3-4eb5-a5e1-2a66c898e53e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:56.472549 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d8654-0bd3-4eb5-a5e1-2a66c898e53e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:56.472821 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d8654-0bd3-4eb5-a5e1-2a66c898e53e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:56.473539 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d8654-0bd3-4eb5-a5e1-2a66c898e53e None admin] RBAC: Adding query filter params (role.id=9252c356af254127896f3626d925a88a, scope.domain.id=default, user.id=7738e47cbf7c4d698504a795d02c194a) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:21:56.473839 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d8654-0bd3-4eb5-a5e1-2a66c898e53e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:56.475300 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d8654-0bd3-4eb5-a5e1-2a66c898e53e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:56.482915 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 21/41] 10.222.0.16 () {56 vars in 1322 bytes} [Wed Nov 2 07:21:56 2022] GET /identity/v3/role_assignments?user.id=7738e47cbf7c4d698504a795d02c194a&scope.domain.id=default&role.id=9252c356af254127896f3626d925a88a => generated 530 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:21:56.484039 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22aaa3-f1d4-4b6c-9551-9ada17ba30ee None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:56.484348 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22aaa3-f1d4-4b6c-9551-9ada17ba30ee None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:56.484626 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22aaa3-f1d4-4b6c-9551-9ada17ba30ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:56.506771 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 21/42] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Nov 2 07:21:56 2022] POST /identity/v3/projects => generated 301 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:21:56.507753 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafcfb7c-ad68-4d60-9aca-b0b4371d61ab None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:56.508666 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-7d22aaa3-f1d4-4b6c-9551-9ada17ba30ee None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:56.510165 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7d22aaa3-f1d4-4b6c-9551-9ada17ba30ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:56.596615 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 22/43] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:21:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:21:56.642561 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafcfb7c-ad68-4d60-9aca-b0b4371d61ab None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:56.645568 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:56.684708 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a522a-3de8-4169-b6dd-914e74704014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:56.685373 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a522a-3de8-4169-b6dd-914e74704014 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:56.685648 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a522a-3de8-4169-b6dd-914e74704014 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:56.685919 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a522a-3de8-4169-b6dd-914e74704014 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:56.687102 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a522a-3de8-4169-b6dd-914e74704014 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:56.688597 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a522a-3de8-4169-b6dd-914e74704014 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:56.690210 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 22/44] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:21:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:56.696269 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22aaa3-f1d4-4b6c-9551-9ada17ba30ee None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:56.811071 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22aaa3-f1d4-4b6c-9551-9ada17ba30ee None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:56.812688 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:56.845457 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b0acd-58db-40b5-8c50-b820c9f89094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:56.846068 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b0acd-58db-40b5-8c50-b820c9f89094 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:56.846342 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b0acd-58db-40b5-8c50-b820c9f89094 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:56.846612 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b0acd-58db-40b5-8c50-b820c9f89094 None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:56.847298 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b0acd-58db-40b5-8c50-b820c9f89094 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:56.848713 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b0acd-58db-40b5-8c50-b820c9f89094 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:56.869343 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a522a-3de8-4169-b6dd-914e74704014 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:56.959736 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 23/45] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Nov 2 07:21:56 2022] POST /identity/v3/projects => generated 312 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:21:56.969116 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a522a-3de8-4169-b6dd-914e74704014 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:57.005660 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18482251-ed6a-4cc9-8c38-44e5b33840af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:57.006278 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18482251-ed6a-4cc9-8c38-44e5b33840af None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:57.006557 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18482251-ed6a-4cc9-8c38-44e5b33840af None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:57.006829 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18482251-ed6a-4cc9-8c38-44e5b33840af None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:57.007506 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18482251-ed6a-4cc9-8c38-44e5b33840af None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:57.008947 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18482251-ed6a-4cc9-8c38-44e5b33840af None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:57.067796 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 23/46] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Nov 2 07:21:56 2022] POST /identity/v3/roles => generated 223 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:21:59.106795 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e98220-9b1e-4f5a-9643-0d7368ff9a29 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:59.107334 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e98220-9b1e-4f5a-9643-0d7368ff9a29 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:59.107472 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e98220-9b1e-4f5a-9643-0d7368ff9a29 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:59.108875 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 24/47] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:21:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:59.113934 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b1eef-e31c-4e70-a0e4-88b927eef9b6 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:59.114317 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b1eef-e31c-4e70-a0e4-88b927eef9b6 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:59.114489 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b1eef-e31c-4e70-a0e4-88b927eef9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:59.132721 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-470b1eef-e31c-4e70-a0e4-88b927eef9b6 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:59.133889 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-470b1eef-e31c-4e70-a0e4-88b927eef9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:59.158552 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:59.197723 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 24/48] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:21:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:21:59.464027 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e98220-9b1e-4f5a-9643-0d7368ff9a29 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:59.563968 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e98220-9b1e-4f5a-9643-0d7368ff9a29 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:59.596585 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b042b06-a321-493f-9747-9babe2fcab53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:59.597205 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b042b06-a321-493f-9747-9babe2fcab53 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:59.597486 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b042b06-a321-493f-9747-9babe2fcab53 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:59.597768 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b042b06-a321-493f-9747-9babe2fcab53 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:59.598865 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b042b06-a321-493f-9747-9babe2fcab53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:59.600331 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b042b06-a321-493f-9747-9babe2fcab53 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:59.601860 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 25/49] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:21:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:59.607961 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b1eef-e31c-4e70-a0e4-88b927eef9b6 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:59.702778 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b1eef-e31c-4e70-a0e4-88b927eef9b6 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:59.735855 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64514123-04cc-4ee9-8c9c-ad04da3c3482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:59.736426 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64514123-04cc-4ee9-8c9c-ad04da3c3482 None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:59.736708 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64514123-04cc-4ee9-8c9c-ad04da3c3482 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:59.736980 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64514123-04cc-4ee9-8c9c-ad04da3c3482 None admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:59.737622 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64514123-04cc-4ee9-8c9c-ad04da3c3482 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:59.739064 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64514123-04cc-4ee9-8c9c-ad04da3c3482 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:59.844920 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 25/50] 10.222.0.16 () {60 vars in 1140 bytes} [Wed Nov 2 07:21:59 2022] POST /identity/v3/projects => generated 298 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:22:02.000586 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724fd5e-7b13-44d6-bbf7-28a64040c780 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:02.001077 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724fd5e-7b13-44d6-bbf7-28a64040c780 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:02.001174 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724fd5e-7b13-44d6-bbf7-28a64040c780 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:02.002709 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 26/51] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:02.007944 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363333f-3af0-4374-8cb1-7ae16020ffd9 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:02.008365 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363333f-3af0-4374-8cb1-7ae16020ffd9 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:02.008529 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363333f-3af0-4374-8cb1-7ae16020ffd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:02.026848 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-3363333f-3af0-4374-8cb1-7ae16020ffd9 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:02.028119 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-3363333f-3af0-4374-8cb1-7ae16020ffd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:02.037157 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:02.091482 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 26/52] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:02.358331 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724fd5e-7b13-44d6-bbf7-28a64040c780 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:02.383051 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:02.458786 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724fd5e-7b13-44d6-bbf7-28a64040c780 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:02.491263 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914453a-80f3-40df-95a0-cc18921eb231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:02.491882 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914453a-80f3-40df-95a0-cc18921eb231 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:02.492193 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914453a-80f3-40df-95a0-cc18921eb231 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:02.492470 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914453a-80f3-40df-95a0-cc18921eb231 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:02.493579 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8914453a-80f3-40df-95a0-cc18921eb231 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:02.495012 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8914453a-80f3-40df-95a0-cc18921eb231 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:02.497109 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 27/53] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:02.502754 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363333f-3af0-4374-8cb1-7ae16020ffd9 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:02.598690 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363333f-3af0-4374-8cb1-7ae16020ffd9 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:02.734662 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81611a4d-1618-40cf-8a1b-4af945383f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:02.735176 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81611a4d-1618-40cf-8a1b-4af945383f3b None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:02.735460 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81611a4d-1618-40cf-8a1b-4af945383f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:02.735739 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81611a4d-1618-40cf-8a1b-4af945383f3b None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:02.736427 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81611a4d-1618-40cf-8a1b-4af945383f3b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:02.737837 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81611a4d-1618-40cf-8a1b-4af945383f3b None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:02.824562 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:02.829573 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 27/54] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Nov 2 07:22:02 2022] POST /identity/v3/users => generated 275 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:22:06.184967 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189ff22-70e8-4925-b4ca-b0b357c58ba7 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:06.186017 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189ff22-70e8-4925-b4ca-b0b357c58ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:06.186501 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189ff22-70e8-4925-b4ca-b0b357c58ba7 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:06.188100 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 28/55] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:06.193389 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a079c-b065-4251-a816-4b65b2c92dcd None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:06.194202 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a079c-b065-4251-a816-4b65b2c92dcd None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:06.195866 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea35b9-947c-48ac-8570-2b867703e63a None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:06.196365 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea35b9-947c-48ac-8570-2b867703e63a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:06.196856 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea35b9-947c-48ac-8570-2b867703e63a None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:06.198312 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 29/56] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:22:06.198788 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a079c-b065-4251-a816-4b65b2c92dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:06.203483 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41b0dd-99af-44c3-8630-ea6234187d20 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:06.204007 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41b0dd-99af-44c3-8630-ea6234187d20 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:06.204523 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41b0dd-99af-44c3-8630-ea6234187d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:06.238007 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-9e41b0dd-99af-44c3-8630-ea6234187d20 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:06.239292 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-8b4a079c-b065-4251-a816-4b65b2c92dcd None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:06.240731 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-8b4a079c-b065-4251-a816-4b65b2c92dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:06.242094 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9e41b0dd-99af-44c3-8630-ea6234187d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:06.326683 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 30/57] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:22:06.328311 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59176404-da80-44e4-aa40-5cf0ae747f60 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:06.328759 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59176404-da80-44e4-aa40-5cf0ae747f60 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:06.329207 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59176404-da80-44e4-aa40-5cf0ae747f60 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:06.330864 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 31/58] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:06.336297 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553033b-271d-4ac4-bb53-633ba298ca3f None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:06.336787 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553033b-271d-4ac4-bb53-633ba298ca3f None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:06.337226 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553033b-271d-4ac4-bb53-633ba298ca3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:06.345890 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 28/59] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:22:06.360173 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-5553033b-271d-4ac4-bb53-633ba298ca3f None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:06.361586 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5553033b-271d-4ac4-bb53-633ba298ca3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:06.384074 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:06.461383 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 32/60] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:22:06.605653 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ef341-87d7-49ce-a132-c1a7e23ea839 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:06.606770 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ef341-87d7-49ce-a132-c1a7e23ea839 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:06.607225 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ef341-87d7-49ce-a132-c1a7e23ea839 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:06.608765 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 29/61] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:06.613872 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0636e-9684-4036-b9b6-6bac8c6efb84 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:06.614339 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0636e-9684-4036-b9b6-6bac8c6efb84 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:06.614778 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0636e-9684-4036-b9b6-6bac8c6efb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:06.626560 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ef341-87d7-49ce-a132-c1a7e23ea839 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:06.647123 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-dcd0636e-9684-4036-b9b6-6bac8c6efb84 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:06.649275 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-dcd0636e-9684-4036-b9b6-6bac8c6efb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:06.738602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 33/62] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:06.739636 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0636e-9684-4036-b9b6-6bac8c6efb84 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:06.799131 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ef341-87d7-49ce-a132-c1a7e23ea839 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:06.849662 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:06.856658 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e247c77-8ba8-4c31-95a9-3819a1e652b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:06.857568 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e247c77-8ba8-4c31-95a9-3819a1e652b8 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:06.857995 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e247c77-8ba8-4c31-95a9-3819a1e652b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:06.858409 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e247c77-8ba8-4c31-95a9-3819a1e652b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:06.872436 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e247c77-8ba8-4c31-95a9-3819a1e652b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:06.879575 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-7e247c77-8ba8-4c31-95a9-3819a1e652b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:22:06.879575 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:06.879575 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:06.879575 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:06.879575 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:06.879575 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:06.879575 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:06.879575 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:06.879575 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:06.879575 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:06.879575 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:06.879575 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:06.879575 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:06.879575 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:06.879575 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:06.879575 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:06.880599 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:06.880599 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:06.880599 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:06.880599 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:06.880599 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:06.880599 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:06.880599 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:06.880599 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:06.880599 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:06.880599 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:06.880599 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:06.880599 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:06.880599 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:06.880599 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:06.880599 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:06.880599 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:06.881571 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:06.881571 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:06.881571 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:06.881571 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:06.881571 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:06.881571 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:06.881571 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:06.881571 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:06.881571 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:06.881571 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:06.881571 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:22:06.881571 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:22:06.883433 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:06.883718 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 30/63] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Nov 2 07:22:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:22:06.884909 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e247c77-8ba8-4c31-95a9-3819a1e652b8 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:06.911687 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0636e-9684-4036-b9b6-6bac8c6efb84 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:06.962127 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f62a31-b51f-4f9a-a8c3-5fa756fedfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:06.963151 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f62a31-b51f-4f9a-a8c3-5fa756fedfb9 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:06.963440 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f62a31-b51f-4f9a-a8c3-5fa756fedfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:06.963714 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f62a31-b51f-4f9a-a8c3-5fa756fedfb9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:06.975670 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f62a31-b51f-4f9a-a8c3-5fa756fedfb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:06.980475 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-d4f62a31-b51f-4f9a-a8c3-5fa756fedfb9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:06.980475 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:06.980475 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:06.980475 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:06.980475 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:06.980475 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:06.980475 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:06.980475 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:06.980475 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:06.980475 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:06.980475 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:06.980475 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:06.980475 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:06.980475 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:06.980475 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:06.980475 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:06.981511 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:06.981511 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:06.981511 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:06.981511 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:06.981511 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:06.981511 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:06.981511 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:06.981511 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:06.981511 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:06.981511 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:06.981511 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:06.981511 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:06.981511 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:06.981511 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:06.981511 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:06.981511 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:06.982252 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:06.982252 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:06.982252 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:06.982252 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:06.982252 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:06.982252 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:06.982252 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:06.982252 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:06.982252 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:06.982252 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:06.982252 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:06.982252 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:22:06.982252 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 34/64] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:06.982870 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f62a31-b51f-4f9a-a8c3-5fa756fedfb9 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:07.012853 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e247c77-8ba8-4c31-95a9-3819a1e652b8 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:07.047769 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a60dd-98ab-4d36-9e94-814405acb158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:07.048432 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a60dd-98ab-4d36-9e94-814405acb158 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:07.048722 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a60dd-98ab-4d36-9e94-814405acb158 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:07.048995 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a60dd-98ab-4d36-9e94-814405acb158 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:07.058796 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a60dd-98ab-4d36-9e94-814405acb158 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:07.064414 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-308a60dd-98ab-4d36-9e94-814405acb158 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:22:07.064414 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:07.064414 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:07.064414 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:07.064414 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:07.064414 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:07.064414 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:07.064414 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:07.064414 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:07.064414 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:07.064414 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:07.064414 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:07.064414 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:07.064414 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:07.064414 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:07.064414 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:07.065386 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:07.065386 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:07.065386 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:07.065386 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:07.065386 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:07.065386 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:07.065386 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:07.065386 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:07.065386 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:07.065386 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:07.065386 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:07.065386 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:07.065386 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:07.065386 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:07.065386 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:07.065386 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:07.066132 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:07.066132 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:07.066132 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:07.066132 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:07.066132 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:07.066132 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:07.066132 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:07.066132 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:07.066132 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:07.066132 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:07.066132 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:22:07.066132 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:22:07.066132 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 31/65] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Nov 2 07:22:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:07.067261 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb859c97-c1c6-4b5a-8090-a0522a84227d None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:07.067614 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb859c97-c1c6-4b5a-8090-a0522a84227d None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:07.067900 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb859c97-c1c6-4b5a-8090-a0522a84227d None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:07.069167 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 32/66] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:07.069870 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb859c97-c1c6-4b5a-8090-a0522a84227d None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:07.087568 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f62a31-b51f-4f9a-a8c3-5fa756fedfb9 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:07.120256 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:07.120963 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0b7a8-6bdd-4cda-bbdf-f9911da5aa74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:07.122140 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0b7a8-6bdd-4cda-bbdf-f9911da5aa74 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:07.122457 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0b7a8-6bdd-4cda-bbdf-f9911da5aa74 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:07.122733 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0b7a8-6bdd-4cda-bbdf-f9911da5aa74 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:07.123384 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce0b7a8-6bdd-4cda-bbdf-f9911da5aa74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:07.123686 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce0b7a8-6bdd-4cda-bbdf-f9911da5aa74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:07.125102 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce0b7a8-6bdd-4cda-bbdf-f9911da5aa74 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:07.133304 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 35/67] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:07.139383 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0b7a8-6bdd-4cda-bbdf-f9911da5aa74 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:07.139383 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:07.174439 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb859c97-c1c6-4b5a-8090-a0522a84227d None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:07.208643 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074cfb86-626b-4660-9159-ee9e0f63be98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:07.209253 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cfb86-626b-4660-9159-ee9e0f63be98 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:07.209508 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cfb86-626b-4660-9159-ee9e0f63be98 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:07.209776 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cfb86-626b-4660-9159-ee9e0f63be98 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:07.210422 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074cfb86-626b-4660-9159-ee9e0f63be98 None admin] RBAC: Adding query filter params (name=member) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:07.210719 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074cfb86-626b-4660-9159-ee9e0f63be98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:07.212119 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074cfb86-626b-4660-9159-ee9e0f63be98 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:07.220173 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 33/68] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Nov 2 07:22:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:07.220948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074cfb86-626b-4660-9159-ee9e0f63be98 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:07.234330 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0b7a8-6bdd-4cda-bbdf-f9911da5aa74 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:07.269126 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f634b41-7b31-43d6-91a4-2c475180791f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:07.269696 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f634b41-7b31-43d6-91a4-2c475180791f None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:07.269979 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f634b41-7b31-43d6-91a4-2c475180791f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:07.270255 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f634b41-7b31-43d6-91a4-2c475180791f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:07.280413 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f634b41-7b31-43d6-91a4-2c475180791f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:07.285639 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-9f634b41-7b31-43d6-91a4-2c475180791f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:07.285639 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:07.285639 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:07.285639 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:07.285639 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:07.285639 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:07.285639 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:07.285639 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:07.285639 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:07.285639 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:07.285639 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:07.285639 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:07.285639 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:07.285639 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:07.285639 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:07.285639 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:07.286572 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:07.286572 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:07.286572 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:07.286572 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:07.286572 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:07.286572 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:07.286572 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:07.286572 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:07.286572 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:07.286572 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:07.286572 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:07.286572 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:07.286572 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:07.286572 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:07.286572 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:07.286572 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:07.288731 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:07.288731 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:07.288731 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:07.288731 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:07.288731 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:07.288731 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:07.288731 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:07.288731 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:07.288731 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:07.288731 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:07.288731 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:07.288731 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:22:07.288731 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 36/69] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:07.288731 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375951a5-817b-4aa2-95d7-6384f22d4ad8 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:07.289398 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375951a5-817b-4aa2-95d7-6384f22d4ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:07.289398 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375951a5-817b-4aa2-95d7-6384f22d4ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:07.305973 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-375951a5-817b-4aa2-95d7-6384f22d4ad8 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:07.307180 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-375951a5-817b-4aa2-95d7-6384f22d4ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:07.321092 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074cfb86-626b-4660-9159-ee9e0f63be98 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:07.333619 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:07.353582 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f31f7-cefb-494d-87e5-b096513d1b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:07.354227 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f31f7-cefb-494d-87e5-b096513d1b1a None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:07.354501 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f31f7-cefb-494d-87e5-b096513d1b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:07.354774 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f31f7-cefb-494d-87e5-b096513d1b1a None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:07.355423 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f31f7-cefb-494d-87e5-b096513d1b1a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:07.355725 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f31f7-cefb-494d-87e5-b096513d1b1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:07.357612 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f31f7-cefb-494d-87e5-b096513d1b1a None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:07.363576 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:07.366205 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 34/70] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Nov 2 07:22:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:07.367289 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f31f7-cefb-494d-87e5-b096513d1b1a None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:07.378195 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 37/71] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:07.379014 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375951a5-817b-4aa2-95d7-6384f22d4ad8 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:07.477166 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f31f7-cefb-494d-87e5-b096513d1b1a None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:07.488965 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375951a5-817b-4aa2-95d7-6384f22d4ad8 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:07.512809 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ad761-775d-4ded-b09c-63b8607371da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:07.513444 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ad761-775d-4ded-b09c-63b8607371da None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:07.513731 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ad761-775d-4ded-b09c-63b8607371da None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:07.514010 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ad761-775d-4ded-b09c-63b8607371da None admin] PATH_INFO: `/v3/users/7738e47cbf7c4d698504a795d02c194a` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:07.515418 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ad761-775d-4ded-b09c-63b8607371da None admin] RBAC: Authorizing `identity:get_user(user_id=7738e47cbf7c4d698504a795d02c194a)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:07.516909 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ad761-775d-4ded-b09c-63b8607371da None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:07.518646 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 35/72] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Nov 2 07:22:07 2022] GET /identity/v3/users/7738e47cbf7c4d698504a795d02c194a => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:07.519489 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ad761-775d-4ded-b09c-63b8607371da None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:07.525504 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f0086-9893-4b44-8e08-cca51ad085b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:07.526141 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f0086-9893-4b44-8e08-cca51ad085b8 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:07.526420 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f0086-9893-4b44-8e08-cca51ad085b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:07.526694 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f0086-9893-4b44-8e08-cca51ad085b8 None admin] PATH_INFO: `/v3/users/4df76d036f8b410588df74292bc5a6a0` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:07.540371 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f0086-9893-4b44-8e08-cca51ad085b8 None admin] RBAC: Authorizing `identity:get_user(user_id=4df76d036f8b410588df74292bc5a6a0)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:07.542129 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f0086-9893-4b44-8e08-cca51ad085b8 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:07.544963 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 38/73] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Nov 2 07:22:07 2022] GET /identity/v3/users/4df76d036f8b410588df74292bc5a6a0 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:07.549539 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f0086-9893-4b44-8e08-cca51ad085b8 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:07.565775 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:07.602160 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:07.632923 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ad761-775d-4ded-b09c-63b8607371da None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:07.654521 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f0086-9893-4b44-8e08-cca51ad085b8 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:07.671678 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827fcfad-f8e8-4676-bb13-f973348a7f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:07.672462 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fcfad-f8e8-4676-bb13-f973348a7f6e None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:07.672803 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fcfad-f8e8-4676-bb13-f973348a7f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:07.673340 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fcfad-f8e8-4676-bb13-f973348a7f6e None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:07.674158 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827fcfad-f8e8-4676-bb13-f973348a7f6e None admin] RBAC: Adding query filter params (name=member) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:07.674461 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827fcfad-f8e8-4676-bb13-f973348a7f6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:07.675829 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827fcfad-f8e8-4676-bb13-f973348a7f6e None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:07.684393 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 36/74] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Nov 2 07:22:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:07.685110 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827fcfad-f8e8-4676-bb13-f973348a7f6e None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:07.692253 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b95184-c4b4-4003-910f-8be5560cd31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:07.692882 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b95184-c4b4-4003-910f-8be5560cd31f None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:07.693156 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b95184-c4b4-4003-910f-8be5560cd31f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:07.693425 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b95184-c4b4-4003-910f-8be5560cd31f None admin] PATH_INFO: `/v3/users/4df76d036f8b410588df74292bc5a6a0` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:07.694538 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b95184-c4b4-4003-910f-8be5560cd31f None admin] RBAC: Authorizing `identity:get_user(user_id=4df76d036f8b410588df74292bc5a6a0)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:07.695971 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b95184-c4b4-4003-910f-8be5560cd31f None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:07.697607 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 39/75] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Nov 2 07:22:07 2022] GET /identity/v3/users/4df76d036f8b410588df74292bc5a6a0 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:07.698358 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b95184-c4b4-4003-910f-8be5560cd31f None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:07.787259 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827fcfad-f8e8-4676-bb13-f973348a7f6e None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:07.789737 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:07.797479 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b95184-c4b4-4003-910f-8be5560cd31f None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:07.814141 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:07.821598 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b78c1-662b-40bc-85c2-f46b03ec7d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:07.822369 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b78c1-662b-40bc-85c2-f46b03ec7d2b None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:07.822922 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b78c1-662b-40bc-85c2-f46b03ec7d2b None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:07.823241 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b78c1-662b-40bc-85c2-f46b03ec7d2b None admin] PATH_INFO: `/v3/projects/3131faaaf63143c4891d5b7ea7131cec` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:07.824888 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b78c1-662b-40bc-85c2-f46b03ec7d2b None admin] RBAC: Authorizing `identity:get_project(project_id=3131faaaf63143c4891d5b7ea7131cec)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:07.826347 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b78c1-662b-40bc-85c2-f46b03ec7d2b None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:07.828347 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 37/76] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Nov 2 07:22:07 2022] GET /identity/v3/projects/3131faaaf63143c4891d5b7ea7131cec => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:07.829044 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b78c1-662b-40bc-85c2-f46b03ec7d2b None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:07.837067 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af255a-c3bd-4933-9f5e-7f403309fbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:07.838128 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af255a-c3bd-4933-9f5e-7f403309fbe1 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:07.838412 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af255a-c3bd-4933-9f5e-7f403309fbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:07.838690 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af255a-c3bd-4933-9f5e-7f403309fbe1 None admin] PATH_INFO: `/v3/projects/3131faaaf63143c4891d5b7ea7131cec` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:07.839901 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af255a-c3bd-4933-9f5e-7f403309fbe1 None admin] RBAC: Authorizing `identity:get_project(project_id=3131faaaf63143c4891d5b7ea7131cec)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:07.841932 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af255a-c3bd-4933-9f5e-7f403309fbe1 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:07.843549 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 40/77] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Nov 2 07:22:07 2022] GET /identity/v3/projects/3131faaaf63143c4891d5b7ea7131cec => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:07.844338 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af255a-c3bd-4933-9f5e-7f403309fbe1 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:07.930990 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b78c1-662b-40bc-85c2-f46b03ec7d2b None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:07.948617 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af255a-c3bd-4933-9f5e-7f403309fbe1 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:07.964578 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc12e83-92e6-4b35-ad56-d80adfc6a18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:07.965896 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc12e83-92e6-4b35-ad56-d80adfc6a18c None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:07.966010 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc12e83-92e6-4b35-ad56-d80adfc6a18c None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:07.966275 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc12e83-92e6-4b35-ad56-d80adfc6a18c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:07.967384 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc12e83-92e6-4b35-ad56-d80adfc6a18c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:07.968824 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc12e83-92e6-4b35-ad56-d80adfc6a18c None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:07.970369 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 38/78] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:07.971125 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc12e83-92e6-4b35-ad56-d80adfc6a18c None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:07.987213 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f22f4-289a-4571-8fdf-d567386a5c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:07.987849 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f22f4-289a-4571-8fdf-d567386a5c9a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:07.988162 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f22f4-289a-4571-8fdf-d567386a5c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:07.988439 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f22f4-289a-4571-8fdf-d567386a5c9a None admin] PATH_INFO: `/v3/users/4df76d036f8b410588df74292bc5a6a0` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:07.989644 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f22f4-289a-4571-8fdf-d567386a5c9a None admin] RBAC: Authorizing `identity:get_user(user_id=4df76d036f8b410588df74292bc5a6a0)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:07.991099 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f22f4-289a-4571-8fdf-d567386a5c9a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:07.992742 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 41/79] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Nov 2 07:22:07 2022] GET /identity/v3/users/4df76d036f8b410588df74292bc5a6a0 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:07.993485 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f22f4-289a-4571-8fdf-d567386a5c9a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:08.016729 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:08.047744 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:08.072414 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc12e83-92e6-4b35-ad56-d80adfc6a18c None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:08.092351 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f22f4-289a-4571-8fdf-d567386a5c9a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:08.105595 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c9837-50c8-4583-a051-de9698c5a947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:08.106764 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c9837-50c8-4583-a051-de9698c5a947 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:08.107043 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c9837-50c8-4583-a051-de9698c5a947 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:08.107315 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c9837-50c8-4583-a051-de9698c5a947 None admin] PATH_INFO: `/v3/projects/3131faaaf63143c4891d5b7ea7131cec` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:08.108456 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c9837-50c8-4583-a051-de9698c5a947 None admin] RBAC: Authorizing `identity:get_project(project_id=3131faaaf63143c4891d5b7ea7131cec)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:08.109894 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c9837-50c8-4583-a051-de9698c5a947 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:08.111514 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 39/80] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Nov 2 07:22:07 2022] GET /identity/v3/projects/3131faaaf63143c4891d5b7ea7131cec => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:08.112268 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c9837-50c8-4583-a051-de9698c5a947 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:08.126560 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1872a7d-9cf7-4c9a-b377-adcd6d13475b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:08.127221 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1872a7d-9cf7-4c9a-b377-adcd6d13475b None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:08.127500 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1872a7d-9cf7-4c9a-b377-adcd6d13475b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:08.128041 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1872a7d-9cf7-4c9a-b377-adcd6d13475b None admin] PATH_INFO: `/v3/projects/3131faaaf63143c4891d5b7ea7131cec/users/7738e47cbf7c4d698504a795d02c194a/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:08.129960 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1872a7d-9cf7-4c9a-b377-adcd6d13475b None admin] RBAC: Authorizing `identity:create_grant(project_id=3131faaaf63143c4891d5b7ea7131cec, user_id=7738e47cbf7c4d698504a795d02c194a, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:08.131413 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1872a7d-9cf7-4c9a-b377-adcd6d13475b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:08.208032 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c9837-50c8-4583-a051-de9698c5a947 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:08.216792 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:08.228360 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 42/81] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Nov 2 07:22:07 2022] PUT /identity/v3/projects/3131faaaf63143c4891d5b7ea7131cec/users/7738e47cbf7c4d698504a795d02c194a/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:22:08.229115 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1872a7d-9cf7-4c9a-b377-adcd6d13475b None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:08.241759 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef329a-44c1-4199-aab5-246a8ff8677c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:08.242458 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef329a-44c1-4199-aab5-246a8ff8677c None admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:08.242793 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef329a-44c1-4199-aab5-246a8ff8677c None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:08.243078 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef329a-44c1-4199-aab5-246a8ff8677c None admin] PATH_INFO: `/v3/projects/3131faaaf63143c4891d5b7ea7131cec/users/4df76d036f8b410588df74292bc5a6a0/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:08.245399 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef329a-44c1-4199-aab5-246a8ff8677c None admin] RBAC: Authorizing `identity:create_grant(project_id=3131faaaf63143c4891d5b7ea7131cec, user_id=4df76d036f8b410588df74292bc5a6a0, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:08.247504 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef329a-44c1-4199-aab5-246a8ff8677c None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:08.344472 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 40/82] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Nov 2 07:22:08 2022] PUT /identity/v3/projects/3131faaaf63143c4891d5b7ea7131cec/users/4df76d036f8b410588df74292bc5a6a0/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:22:08.345640 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef329a-44c1-4199-aab5-246a8ff8677c None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:08.363160 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1872a7d-9cf7-4c9a-b377-adcd6d13475b None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:08.384000 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:08.420620 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab8fb4a-c575-427c-abb3-97e94f9ccffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:08.421668 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8fb4a-c575-427c-abb3-97e94f9ccffd None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:08.422193 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8fb4a-c575-427c-abb3-97e94f9ccffd None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:08.422908 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8fb4a-c575-427c-abb3-97e94f9ccffd None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:08.423798 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab8fb4a-c575-427c-abb3-97e94f9ccffd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:08.426691 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab8fb4a-c575-427c-abb3-97e94f9ccffd None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:08.489552 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef329a-44c1-4199-aab5-246a8ff8677c None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:08.526492 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0280b7-b828-4e2c-a6ce-e0b86aaa7769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:08.527142 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0280b7-b828-4e2c-a6ce-e0b86aaa7769 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:08.527421 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0280b7-b828-4e2c-a6ce-e0b86aaa7769 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:08.528271 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0280b7-b828-4e2c-a6ce-e0b86aaa7769 None admin] PATH_INFO: `/v3/projects/bdcc7489b7ff4dd99f7ae69a1bcfc9a5` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:08.529464 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0280b7-b828-4e2c-a6ce-e0b86aaa7769 None admin] RBAC: Authorizing `identity:get_project(project_id=bdcc7489b7ff4dd99f7ae69a1bcfc9a5)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:08.530970 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0280b7-b828-4e2c-a6ce-e0b86aaa7769 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:08.532668 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 41/83] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Nov 2 07:22:08 2022] GET /identity/v3/projects/bdcc7489b7ff4dd99f7ae69a1bcfc9a5 => generated 312 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:08.533735 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0280b7-b828-4e2c-a6ce-e0b86aaa7769 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:08.543679 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 43/84] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Nov 2 07:22:08 2022] POST /identity/v3/users => generated 289 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:22:08.547421 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab8fb4a-c575-427c-abb3-97e94f9ccffd None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:08.591575 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:08.675510 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0280b7-b828-4e2c-a6ce-e0b86aaa7769 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:08.710165 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab8fb4a-c575-427c-abb3-97e94f9ccffd None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:08.727320 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc862b7b-d4c9-42de-9c7a-200d058aeb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:08.728031 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc862b7b-d4c9-42de-9c7a-200d058aeb88 None admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:08.728332 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc862b7b-d4c9-42de-9c7a-200d058aeb88 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:08.728613 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc862b7b-d4c9-42de-9c7a-200d058aeb88 None admin] PATH_INFO: `/v3/projects/3131faaaf63143c4891d5b7ea7131cec/users/4df76d036f8b410588df74292bc5a6a0/roles/c2071a72276d475daff2d76d195df6c4` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:08.734233 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc862b7b-d4c9-42de-9c7a-200d058aeb88 None admin] RBAC: Authorizing `identity:create_grant(project_id=3131faaaf63143c4891d5b7ea7131cec, user_id=4df76d036f8b410588df74292bc5a6a0, role_id=c2071a72276d475daff2d76d195df6c4)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:08.735709 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc862b7b-d4c9-42de-9c7a-200d058aeb88 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:08.763472 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b7887-ad15-429b-8dee-c7b2392eefba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:08.764203 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b7887-ad15-429b-8dee-c7b2392eefba None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:08.764485 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b7887-ad15-429b-8dee-c7b2392eefba None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:08.764759 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b7887-ad15-429b-8dee-c7b2392eefba None admin] PATH_INFO: `/v3/projects/bdcc7489b7ff4dd99f7ae69a1bcfc9a5/users/4df76d036f8b410588df74292bc5a6a0/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:08.766857 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b7887-ad15-429b-8dee-c7b2392eefba None admin] RBAC: Authorizing `identity:create_grant(project_id=bdcc7489b7ff4dd99f7ae69a1bcfc9a5, user_id=4df76d036f8b410588df74292bc5a6a0, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:08.768380 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b7887-ad15-429b-8dee-c7b2392eefba None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:08.807072 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 42/85] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Nov 2 07:22:08 2022] PUT /identity/v3/projects/3131faaaf63143c4891d5b7ea7131cec/users/4df76d036f8b410588df74292bc5a6a0/roles/c2071a72276d475daff2d76d195df6c4 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:22:08.865407 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 44/86] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Nov 2 07:22:08 2022] PUT /identity/v3/projects/bdcc7489b7ff4dd99f7ae69a1bcfc9a5/users/4df76d036f8b410588df74292bc5a6a0/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:22:11.417429 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b734f60-29d6-4b81-9776-21941f9d9c19 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:11.418607 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b734f60-29d6-4b81-9776-21941f9d9c19 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:11.419183 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b734f60-29d6-4b81-9776-21941f9d9c19 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:11.420861 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 43/87] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:11.426686 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa97268-967a-430b-bf61-3409f7c74078 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:11.427554 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa97268-967a-430b-bf61-3409f7c74078 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:11.428026 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa97268-967a-430b-bf61-3409f7c74078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:11.457016 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-0fa97268-967a-430b-bf61-3409f7c74078 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:11.458540 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0fa97268-967a-430b-bf61-3409f7c74078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:11.495664 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:11.499642 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120ecf7-29d1-4d1f-92ec-74e4e25afefa None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:11.500191 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120ecf7-29d1-4d1f-92ec-74e4e25afefa None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:11.500679 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120ecf7-29d1-4d1f-92ec-74e4e25afefa None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:11.502203 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 44/88] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:22:11.507566 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bbe10f-9526-4656-8826-ece433a22086 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:11.508179 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bbe10f-9526-4656-8826-ece433a22086 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:11.523547 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bbe10f-9526-4656-8826-ece433a22086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:11.533642 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-15bbe10f-9526-4656-8826-ece433a22086 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:11.539650 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-15bbe10f-9526-4656-8826-ece433a22086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:11.587964 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 45/89] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:11.589606 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f6811-f6c1-4cf8-a805-eac43e998e72 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:11.590093 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f6811-f6c1-4cf8-a805-eac43e998e72 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:11.592262 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f6811-f6c1-4cf8-a805-eac43e998e72 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:11.594711 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 46/90] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:11.599745 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352556c-00de-4bb1-a6f9-aa569d69de6e None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:11.600245 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352556c-00de-4bb1-a6f9-aa569d69de6e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:11.600717 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352556c-00de-4bb1-a6f9-aa569d69de6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:11.636086 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-b352556c-00de-4bb1-a6f9-aa569d69de6e None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:11.636086 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b352556c-00de-4bb1-a6f9-aa569d69de6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:11.703407 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 45/91] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:11.729652 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 47/92] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:22:11.777525 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763e83d-314d-4bd5-975a-9c0c9e0de0f7 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:11.778331 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763e83d-314d-4bd5-975a-9c0c9e0de0f7 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:11.778980 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763e83d-314d-4bd5-975a-9c0c9e0de0f7 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:11.780561 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 46/93] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:11.786079 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34284de6-72c1-43fc-b257-f11b68bcc8eb None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:11.786364 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34284de6-72c1-43fc-b257-f11b68bcc8eb None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:11.786635 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34284de6-72c1-43fc-b257-f11b68bcc8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:11.810245 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-34284de6-72c1-43fc-b257-f11b68bcc8eb None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:11.811434 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-34284de6-72c1-43fc-b257-f11b68bcc8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:11.896835 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 48/94] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:12.139134 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763e83d-314d-4bd5-975a-9c0c9e0de0f7 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:12.175655 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:12.208003 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34284de6-72c1-43fc-b257-f11b68bcc8eb None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:12.248570 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:12.275468 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763e83d-314d-4bd5-975a-9c0c9e0de0f7 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:12.327438 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97dfe6-8960-44a6-9676-0eed063d89f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:12.328016 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97dfe6-8960-44a6-9676-0eed063d89f8 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:12.328332 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97dfe6-8960-44a6-9676-0eed063d89f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:12.328602 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97dfe6-8960-44a6-9676-0eed063d89f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:12.339588 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae97dfe6-8960-44a6-9676-0eed063d89f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:12.345518 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-ae97dfe6-8960-44a6-9676-0eed063d89f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:12.345518 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:12.345518 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:12.345518 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:12.345518 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:12.345518 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:12.345518 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:12.345518 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:12.345518 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:12.345518 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:12.345518 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:12.345518 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:12.345518 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:12.345518 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:12.345518 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:12.345518 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:12.346372 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:12.346372 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:12.346372 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:12.346372 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:12.346372 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:12.346372 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:12.346372 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:12.346372 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:12.346372 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:12.346372 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:12.346372 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:12.346372 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:12.346372 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:12.346372 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:12.346372 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:12.346372 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:12.352067 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:12.352067 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:12.352067 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:12.352067 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:12.352067 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:12.352067 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:12.352067 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:12.352067 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:12.352067 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:12.352067 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:12.352067 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:12.352067 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:22:12.352067 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 47/95] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:12.352067 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97dfe6-8960-44a6-9676-0eed063d89f8 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:12.382124 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34284de6-72c1-43fc-b257-f11b68bcc8eb None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:12.419807 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a45429-97f5-4549-9893-1dd6c7e5f4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:12.420393 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a45429-97f5-4549-9893-1dd6c7e5f4a3 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:12.420675 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a45429-97f5-4549-9893-1dd6c7e5f4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:12.420956 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a45429-97f5-4549-9893-1dd6c7e5f4a3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:12.433376 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a45429-97f5-4549-9893-1dd6c7e5f4a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:12.438398 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-22a45429-97f5-4549-9893-1dd6c7e5f4a3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:22:12.438398 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:12.438398 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:12.438398 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:12.438398 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:12.438398 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:12.438398 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:12.438398 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:12.438398 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:12.438398 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:12.438398 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:12.438398 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:12.438398 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:12.438398 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:12.438398 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:12.438398 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:12.439257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:12.439257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:12.439257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:12.439257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:12.439257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:12.439257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:12.439257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:12.439257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:12.439257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:12.439257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:12.439257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:12.439257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:12.439257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:12.439257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:12.439257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:12.439257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:12.440003 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:12.440003 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:12.440003 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:12.440003 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:12.440003 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:12.440003 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:12.440003 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:12.440003 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:12.440003 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:12.440003 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:12.440003 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:22:12.440003 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:22:12.440003 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 49/96] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Nov 2 07:22:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:12.442206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e953a-3c23-4db6-9ee2-bbbdd5b85a58 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:12.442206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e953a-3c23-4db6-9ee2-bbbdd5b85a58 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:12.442206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e953a-3c23-4db6-9ee2-bbbdd5b85a58 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:12.443143 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 50/97] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:12.443699 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e953a-3c23-4db6-9ee2-bbbdd5b85a58 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:12.460395 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:12.476446 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97dfe6-8960-44a6-9676-0eed063d89f8 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:12.510467 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c23134-bbf5-4b95-9cc4-28785fa14acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:12.511133 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c23134-bbf5-4b95-9cc4-28785fa14acb None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:12.511410 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c23134-bbf5-4b95-9cc4-28785fa14acb None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:12.511737 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c23134-bbf5-4b95-9cc4-28785fa14acb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:12.522144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c23134-bbf5-4b95-9cc4-28785fa14acb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:12.526920 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-d9c23134-bbf5-4b95-9cc4-28785fa14acb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:22:12.526920 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:12.526920 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:12.526920 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:12.526920 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:12.526920 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:12.526920 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:12.526920 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:12.526920 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:12.526920 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:12.526920 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:12.526920 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:12.526920 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:12.526920 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:12.526920 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:12.526920 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:12.528550 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:12.528550 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:12.528550 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:12.528550 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:12.528550 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:12.528550 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:12.528550 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:12.528550 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:12.528550 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:12.528550 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:12.528550 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:12.528550 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:12.528550 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:12.528550 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:12.528550 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:12.528550 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:12.529368 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:12.529368 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:12.529368 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:12.529368 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:12.529368 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:12.529368 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:12.529368 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:12.529368 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:12.529368 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:12.529368 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:12.529368 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:22:12.529368 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:22:12.529368 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 48/98] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Nov 2 07:22:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:12.530651 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c23134-bbf5-4b95-9cc4-28785fa14acb None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:12.539510 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:12.558419 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e953a-3c23-4db6-9ee2-bbbdd5b85a58 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:12.591983 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027f606-f18d-4fa1-8661-bb709e72af09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:12.592743 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027f606-f18d-4fa1-8661-bb709e72af09 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:12.593026 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027f606-f18d-4fa1-8661-bb709e72af09 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:12.593298 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027f606-f18d-4fa1-8661-bb709e72af09 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:12.594396 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027f606-f18d-4fa1-8661-bb709e72af09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:12.595852 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027f606-f18d-4fa1-8661-bb709e72af09 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:12.597459 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 51/99] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:12.597459 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027f606-f18d-4fa1-8661-bb709e72af09 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:12.626595 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c23134-bbf5-4b95-9cc4-28785fa14acb None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:12.659671 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843461a0-ea29-417f-9f9a-5d41e8ba02b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:12.660309 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843461a0-ea29-417f-9f9a-5d41e8ba02b0 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:12.660589 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843461a0-ea29-417f-9f9a-5d41e8ba02b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:12.660867 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843461a0-ea29-417f-9f9a-5d41e8ba02b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:12.661522 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843461a0-ea29-417f-9f9a-5d41e8ba02b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:12.661824 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843461a0-ea29-417f-9f9a-5d41e8ba02b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:12.663199 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843461a0-ea29-417f-9f9a-5d41e8ba02b0 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:12.672119 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 49/100] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Nov 2 07:22:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:12.673194 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecb47c-b90f-4418-99ed-ae2641607359 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:12.673489 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecb47c-b90f-4418-99ed-ae2641607359 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:12.673769 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecb47c-b90f-4418-99ed-ae2641607359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:12.690913 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-4eecb47c-b90f-4418-99ed-ae2641607359 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:12.692155 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-4eecb47c-b90f-4418-99ed-ae2641607359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:12.694078 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:12.697899 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027f606-f18d-4fa1-8661-bb709e72af09 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:12.731424 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fdcc4c-e1d5-4338-a80e-16cfb53710c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:12.732023 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdcc4c-e1d5-4338-a80e-16cfb53710c9 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:12.732329 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdcc4c-e1d5-4338-a80e-16cfb53710c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:12.732647 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdcc4c-e1d5-4338-a80e-16cfb53710c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:12.733317 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fdcc4c-e1d5-4338-a80e-16cfb53710c9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:12.733620 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fdcc4c-e1d5-4338-a80e-16cfb53710c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:12.734996 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fdcc4c-e1d5-4338-a80e-16cfb53710c9 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:12.742792 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 52/101] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Nov 2 07:22:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:12.743940 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b32b7-0523-4d7e-a7f9-631b7e8b3c27 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:12.744360 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b32b7-0523-4d7e-a7f9-631b7e8b3c27 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:12.744636 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b32b7-0523-4d7e-a7f9-631b7e8b3c27 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:12.745996 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 53/102] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:12.747078 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b32b7-0523-4d7e-a7f9-631b7e8b3c27 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:12.759693 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:12.764484 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 50/103] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:12.765292 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eecb47c-b90f-4418-99ed-ae2641607359 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:12.852162 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b32b7-0523-4d7e-a7f9-631b7e8b3c27 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:12.872476 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eecb47c-b90f-4418-99ed-ae2641607359 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:12.887572 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47254def-80e6-4dad-a8a1-04faad728176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:12.888481 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47254def-80e6-4dad-a8a1-04faad728176 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:12.888875 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47254def-80e6-4dad-a8a1-04faad728176 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:12.889220 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47254def-80e6-4dad-a8a1-04faad728176 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:12.889936 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47254def-80e6-4dad-a8a1-04faad728176 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:12.890305 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47254def-80e6-4dad-a8a1-04faad728176 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:12.891737 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47254def-80e6-4dad-a8a1-04faad728176 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:12.904201 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 54/104] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:12.905773 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47254def-80e6-4dad-a8a1-04faad728176 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:12.909613 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba2eb4-4538-4cf3-8f2d-abe3af4a3cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:12.910230 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba2eb4-4538-4cf3-8f2d-abe3af4a3cb5 None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:12.910513 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba2eb4-4538-4cf3-8f2d-abe3af4a3cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:12.910786 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba2eb4-4538-4cf3-8f2d-abe3af4a3cb5 None admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:12.911433 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba2eb4-4538-4cf3-8f2d-abe3af4a3cb5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:12.913017 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba2eb4-4538-4cf3-8f2d-abe3af4a3cb5 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:12.924481 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:12.975952 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 51/105] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Nov 2 07:22:12 2022] POST /identity/v3/projects => generated 302 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:22:12.984347 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba2eb4-4538-4cf3-8f2d-abe3af4a3cb5 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:12.986111 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:13.023474 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47254def-80e6-4dad-a8a1-04faad728176 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:13.064317 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4e18c-e310-4948-9310-bece1ca329b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:13.064959 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4e18c-e310-4948-9310-bece1ca329b6 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:13.065351 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4e18c-e310-4948-9310-bece1ca329b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:13.065624 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4e18c-e310-4948-9310-bece1ca329b6 None admin] PATH_INFO: `/v3/users/4df76d036f8b410588df74292bc5a6a0` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:13.066821 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4e18c-e310-4948-9310-bece1ca329b6 None admin] RBAC: Authorizing `identity:get_user(user_id=4df76d036f8b410588df74292bc5a6a0)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:13.068328 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4e18c-e310-4948-9310-bece1ca329b6 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:13.070269 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 55/106] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Nov 2 07:22:12 2022] GET /identity/v3/users/4df76d036f8b410588df74292bc5a6a0 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:13.076646 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c0ccb-42e6-4750-b80e-6192456b0fa9 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:13.076943 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c0ccb-42e6-4750-b80e-6192456b0fa9 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:13.077198 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c0ccb-42e6-4750-b80e-6192456b0fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:13.098903 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-281c0ccb-42e6-4750-b80e-6192456b0fa9 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:13.100168 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-281c0ccb-42e6-4750-b80e-6192456b0fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:13.104116 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba2eb4-4538-4cf3-8f2d-abe3af4a3cb5 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:13.141404 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73745780-2028-45de-85aa-d3a943d345ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:13.142067 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73745780-2028-45de-85aa-d3a943d345ad None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:13.142419 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73745780-2028-45de-85aa-d3a943d345ad None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:13.142703 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73745780-2028-45de-85aa-d3a943d345ad None admin] PATH_INFO: `/v3/users/4df76d036f8b410588df74292bc5a6a0` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:13.143896 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73745780-2028-45de-85aa-d3a943d345ad None admin] RBAC: Authorizing `identity:get_user(user_id=4df76d036f8b410588df74292bc5a6a0)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:13.145396 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73745780-2028-45de-85aa-d3a943d345ad None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:13.151543 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 52/107] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Nov 2 07:22:12 2022] GET /identity/v3/users/4df76d036f8b410588df74292bc5a6a0 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:13.151543 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73745780-2028-45de-85aa-d3a943d345ad None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:13.182193 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 56/108] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:13.182967 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c0ccb-42e6-4750-b80e-6192456b0fa9 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:13.224343 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:13.276820 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73745780-2028-45de-85aa-d3a943d345ad None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:13.285524 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:13.310276 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c0ccb-42e6-4750-b80e-6192456b0fa9 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:13.321551 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1b6f0-4fb3-4c13-8529-43c7f3e3d3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:13.322692 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1b6f0-4fb3-4c13-8529-43c7f3e3d3fb None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:13.323121 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1b6f0-4fb3-4c13-8529-43c7f3e3d3fb None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:13.323557 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1b6f0-4fb3-4c13-8529-43c7f3e3d3fb None admin] PATH_INFO: `/v3/users/7738e47cbf7c4d698504a795d02c194a` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:13.325943 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1b6f0-4fb3-4c13-8529-43c7f3e3d3fb None admin] RBAC: Authorizing `identity:get_user(user_id=7738e47cbf7c4d698504a795d02c194a)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:13.327814 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1b6f0-4fb3-4c13-8529-43c7f3e3d3fb None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:13.330007 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 53/109] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Nov 2 07:22:13 2022] GET /identity/v3/users/7738e47cbf7c4d698504a795d02c194a => generated 247 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:13.330914 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1b6f0-4fb3-4c13-8529-43c7f3e3d3fb None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:13.346403 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a80fae-9a58-456b-bec9-f4f71967fcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:13.347222 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a80fae-9a58-456b-bec9-f4f71967fcd3 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:13.347325 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a80fae-9a58-456b-bec9-f4f71967fcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:13.347586 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a80fae-9a58-456b-bec9-f4f71967fcd3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:13.359381 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a80fae-9a58-456b-bec9-f4f71967fcd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:13.364195 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-19a80fae-9a58-456b-bec9-f4f71967fcd3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:22:13.364195 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:13.364195 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:13.364195 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:13.364195 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:13.364195 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:13.364195 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:13.364195 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:13.364195 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:13.364195 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:13.364195 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:13.364195 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:13.364195 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:13.364195 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:13.364195 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:13.364195 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:13.365218 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:13.365218 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:13.365218 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:13.365218 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:13.365218 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:13.365218 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:13.365218 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:13.365218 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:13.365218 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:13.365218 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:13.365218 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:13.365218 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:13.365218 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:13.365218 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:13.365218 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:13.365218 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:13.366121 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:13.366121 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:13.366121 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:13.366121 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:13.366121 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:13.366121 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:13.366121 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:13.366121 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:13.366121 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:13.366121 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:13.366121 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:22:13.366121 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:22:13.371973 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 57/110] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:13.371973 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a80fae-9a58-456b-bec9-f4f71967fcd3 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:13.467106 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1b6f0-4fb3-4c13-8529-43c7f3e3d3fb None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:13.478863 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a80fae-9a58-456b-bec9-f4f71967fcd3 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:13.495280 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:13.504331 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0f3d5-74fc-4b25-a3fb-c8299db81788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:13.504951 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0f3d5-74fc-4b25-a3fb-c8299db81788 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:13.505234 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0f3d5-74fc-4b25-a3fb-c8299db81788 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:13.505509 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0f3d5-74fc-4b25-a3fb-c8299db81788 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:13.520387 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:13.527074 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb13313-9def-4de2-91e0-820091f01944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:13.528315 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb13313-9def-4de2-91e0-820091f01944 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:13.528738 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb13313-9def-4de2-91e0-820091f01944 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:13.529409 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb13313-9def-4de2-91e0-820091f01944 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:13.577724 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad0f3d5-74fc-4b25-a3fb-c8299db81788 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:13.579387 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad0f3d5-74fc-4b25-a3fb-c8299db81788 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:13.602358 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb13313-9def-4de2-91e0-820091f01944 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:13.604359 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb13313-9def-4de2-91e0-820091f01944 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:13.683252 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 54/111] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Nov 2 07:22:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:22:13.683252 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0f3d5-74fc-4b25-a3fb-c8299db81788 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:13.708449 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:13.712299 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 58/112] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Nov 2 07:22:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:22:13.721573 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb13313-9def-4de2-91e0-820091f01944 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:13.747977 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:13.799371 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0f3d5-74fc-4b25-a3fb-c8299db81788 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:13.819675 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb13313-9def-4de2-91e0-820091f01944 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:13.837400 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d6316-fa4b-4d4b-9904-2455e8f001e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:13.838011 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d6316-fa4b-4d4b-9904-2455e8f001e5 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:13.838289 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d6316-fa4b-4d4b-9904-2455e8f001e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:13.838560 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d6316-fa4b-4d4b-9904-2455e8f001e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:13.853377 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b43019-b99b-4edd-9e92-f871739b3e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:13.853985 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b43019-b99b-4edd-9e92-f871739b3e8c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:13.854267 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b43019-b99b-4edd-9e92-f871739b3e8c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:13.854540 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b43019-b99b-4edd-9e92-f871739b3e8c None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:13.855195 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b43019-b99b-4edd-9e92-f871739b3e8c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:13.855498 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b43019-b99b-4edd-9e92-f871739b3e8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:13.857665 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b43019-b99b-4edd-9e92-f871739b3e8c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:13.865718 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 59/113] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Nov 2 07:22:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:13.870914 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b43019-b99b-4edd-9e92-f871739b3e8c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:13.913819 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043d6316-fa4b-4d4b-9904-2455e8f001e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:13.915384 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043d6316-fa4b-4d4b-9904-2455e8f001e5 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:13.944095 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:13.977509 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:13.986644 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b43019-b99b-4edd-9e92-f871739b3e8c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:14.021384 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c14dfa-a9e3-4bdc-8a10-c159b045bd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:14.022017 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c14dfa-a9e3-4bdc-8a10-c159b045bd4a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:14.022293 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c14dfa-a9e3-4bdc-8a10-c159b045bd4a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:14.022562 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c14dfa-a9e3-4bdc-8a10-c159b045bd4a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:14.023100 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 55/114] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Nov 2 07:22:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:22:14.023940 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d6316-fa4b-4d4b-9904-2455e8f001e5 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:14.039319 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c14dfa-a9e3-4bdc-8a10-c159b045bd4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:14.044750 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-19c14dfa-a9e3-4bdc-8a10-c159b045bd4a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:14.044750 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:14.044750 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:14.044750 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:14.044750 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:14.044750 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:14.044750 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:14.044750 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:14.044750 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:14.044750 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:14.044750 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:14.044750 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:14.044750 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:14.044750 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:14.044750 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:14.044750 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:14.045614 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:14.045614 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:14.045614 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:14.045614 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:14.045614 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:14.045614 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:14.045614 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:14.045614 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:14.045614 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:14.045614 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:14.045614 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:14.045614 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:14.045614 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:14.045614 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:14.045614 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:14.045614 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:14.046382 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:14.046382 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:14.046382 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:14.046382 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:14.046382 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:14.046382 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:14.046382 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:14.046382 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:14.046382 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:14.046382 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:14.046382 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:14.046382 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:22:14.046382 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 60/115] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:14.046996 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c14dfa-a9e3-4bdc-8a10-c159b045bd4a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:14.132222 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d6316-fa4b-4d4b-9904-2455e8f001e5 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:14.153908 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c14dfa-a9e3-4bdc-8a10-c159b045bd4a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:14.158161 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:14.168640 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c704f9d-a663-4408-a22a-a543699a9425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:14.169536 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c704f9d-a663-4408-a22a-a543699a9425 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:14.169820 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c704f9d-a663-4408-a22a-a543699a9425 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:14.170751 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c704f9d-a663-4408-a22a-a543699a9425 None admin] PATH_INFO: `/v3/projects/3131faaaf63143c4891d5b7ea7131cec` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:14.171355 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c704f9d-a663-4408-a22a-a543699a9425 None admin] RBAC: Authorizing `identity:get_project(project_id=3131faaaf63143c4891d5b7ea7131cec)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:14.172847 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c704f9d-a663-4408-a22a-a543699a9425 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:14.174484 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 56/116] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Nov 2 07:22:14 2022] GET /identity/v3/projects/3131faaaf63143c4891d5b7ea7131cec => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:14.175250 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c704f9d-a663-4408-a22a-a543699a9425 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:14.193624 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd60a3-72ca-48ca-ab79-9757d95236d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:14.194256 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd60a3-72ca-48ca-ab79-9757d95236d8 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:14.194533 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd60a3-72ca-48ca-ab79-9757d95236d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:14.194806 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd60a3-72ca-48ca-ab79-9757d95236d8 None admin] PATH_INFO: `/v3/projects/3131faaaf63143c4891d5b7ea7131cec` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:14.195911 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd60a3-72ca-48ca-ab79-9757d95236d8 None admin] RBAC: Authorizing `identity:get_project(project_id=3131faaaf63143c4891d5b7ea7131cec)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:14.197407 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd60a3-72ca-48ca-ab79-9757d95236d8 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:14.204170 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 61/117] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Nov 2 07:22:14 2022] GET /identity/v3/projects/3131faaaf63143c4891d5b7ea7131cec => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:14.204170 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd60a3-72ca-48ca-ab79-9757d95236d8 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:14.226605 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:14.283741 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c704f9d-a663-4408-a22a-a543699a9425 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:14.307938 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd60a3-72ca-48ca-ab79-9757d95236d8 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:14.321973 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c69ac24-7a5d-4674-be87-601353ff23d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:14.322605 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69ac24-7a5d-4674-be87-601353ff23d1 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:14.322890 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69ac24-7a5d-4674-be87-601353ff23d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:14.323164 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69ac24-7a5d-4674-be87-601353ff23d1 None admin] PATH_INFO: `/v3/users/5d0b4b6d1cbc49efaddb473444821d0b` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:14.343997 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c69ac24-7a5d-4674-be87-601353ff23d1 None admin] RBAC: Authorizing `identity:get_user(user_id=5d0b4b6d1cbc49efaddb473444821d0b)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:14.345448 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c69ac24-7a5d-4674-be87-601353ff23d1 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:14.347127 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 57/118] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Nov 2 07:22:14 2022] GET /identity/v3/users/5d0b4b6d1cbc49efaddb473444821d0b => generated 289 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:14.349839 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c40d18-cf37-4b28-9fcb-f18159c3fecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:14.350473 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c40d18-cf37-4b28-9fcb-f18159c3fecb None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:14.350752 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c40d18-cf37-4b28-9fcb-f18159c3fecb None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:14.351022 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c40d18-cf37-4b28-9fcb-f18159c3fecb None admin] PATH_INFO: `/v3/projects/3131faaaf63143c4891d5b7ea7131cec` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:14.352260 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c69ac24-7a5d-4674-be87-601353ff23d1 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:14.352363 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c40d18-cf37-4b28-9fcb-f18159c3fecb None admin] RBAC: Authorizing `identity:get_project(project_id=3131faaaf63143c4891d5b7ea7131cec)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:14.353707 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c40d18-cf37-4b28-9fcb-f18159c3fecb None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:14.361132 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 62/119] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Nov 2 07:22:14 2022] GET /identity/v3/projects/3131faaaf63143c4891d5b7ea7131cec => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:14.361132 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c40d18-cf37-4b28-9fcb-f18159c3fecb None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:14.414695 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:14.450620 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:14.463376 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c40d18-cf37-4b28-9fcb-f18159c3fecb None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:14.463828 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c69ac24-7a5d-4674-be87-601353ff23d1 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:14.499488 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e029dc-59f2-4bd2-9a90-7eb0af83a909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:14.500009 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf518f-3ba9-4276-baa7-b02725c84d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:14.500377 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e029dc-59f2-4bd2-9a90-7eb0af83a909 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:14.500377 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e029dc-59f2-4bd2-9a90-7eb0af83a909 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:14.500676 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf518f-3ba9-4276-baa7-b02725c84d98 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:14.500786 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e029dc-59f2-4bd2-9a90-7eb0af83a909 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:14.500858 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf518f-3ba9-4276-baa7-b02725c84d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:14.501101 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf518f-3ba9-4276-baa7-b02725c84d98 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:14.501399 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e029dc-59f2-4bd2-9a90-7eb0af83a909 None admin] RBAC: Adding query filter params (role.id=c80de80e56e34e6caa3c27dcec321efd, scope.project.id=3131faaaf63143c4891d5b7ea7131cec, user.id=4df76d036f8b410588df74292bc5a6a0) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:14.501703 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e029dc-59f2-4bd2-9a90-7eb0af83a909 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:14.501791 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf518f-3ba9-4276-baa7-b02725c84d98 None admin] RBAC: Adding query filter params (name=member) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:14.502043 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf518f-3ba9-4276-baa7-b02725c84d98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:14.503431 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e029dc-59f2-4bd2-9a90-7eb0af83a909 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:14.503634 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf518f-3ba9-4276-baa7-b02725c84d98 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:14.520360 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 63/120] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Nov 2 07:22:14 2022] GET /identity/v3/role_assignments?user.id=4df76d036f8b410588df74292bc5a6a0&scope.project.id=3131faaaf63143c4891d5b7ea7131cec&role.id=c80de80e56e34e6caa3c27dcec321efd => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:14.520360 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e029dc-59f2-4bd2-9a90-7eb0af83a909 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:14.523754 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 58/121] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Nov 2 07:22:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:14.524813 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf518f-3ba9-4276-baa7-b02725c84d98 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:14.656633 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf518f-3ba9-4276-baa7-b02725c84d98 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:14.660992 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e029dc-59f2-4bd2-9a90-7eb0af83a909 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:14.674499 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:14.698664 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef54e2-f323-443c-ad70-d3fab719db2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:14.698664 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef54e2-f323-443c-ad70-d3fab719db2e None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:14.698664 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef54e2-f323-443c-ad70-d3fab719db2e None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:14.698968 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef54e2-f323-443c-ad70-d3fab719db2e None admin] PATH_INFO: `/v3/projects/3131faaaf63143c4891d5b7ea7131cec` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:14.700828 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef54e2-f323-443c-ad70-d3fab719db2e None admin] RBAC: Authorizing `identity:get_project(project_id=3131faaaf63143c4891d5b7ea7131cec)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:14.703091 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef54e2-f323-443c-ad70-d3fab719db2e None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:14.705107 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 59/122] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Nov 2 07:22:14 2022] GET /identity/v3/projects/3131faaaf63143c4891d5b7ea7131cec => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:14.705594 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef54e2-f323-443c-ad70-d3fab719db2e None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:14.707037 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee37bc-ac30-4f92-acd1-41d52ed5b142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:14.707650 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee37bc-ac30-4f92-acd1-41d52ed5b142 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:14.707928 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee37bc-ac30-4f92-acd1-41d52ed5b142 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:14.708417 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee37bc-ac30-4f92-acd1-41d52ed5b142 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:14.709206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee37bc-ac30-4f92-acd1-41d52ed5b142 None admin] RBAC: Adding query filter params (role.id=c2071a72276d475daff2d76d195df6c4, scope.project.id=3131faaaf63143c4891d5b7ea7131cec, user.id=4df76d036f8b410588df74292bc5a6a0) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:14.709676 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee37bc-ac30-4f92-acd1-41d52ed5b142 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:14.711997 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee37bc-ac30-4f92-acd1-41d52ed5b142 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:14.719039 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 64/123] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Nov 2 07:22:14 2022] GET /identity/v3/role_assignments?user.id=4df76d036f8b410588df74292bc5a6a0&scope.project.id=3131faaaf63143c4891d5b7ea7131cec&role.id=c2071a72276d475daff2d76d195df6c4 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:14.720318 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee37bc-ac30-4f92-acd1-41d52ed5b142 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:14.749864 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:14.857228 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee37bc-ac30-4f92-acd1-41d52ed5b142 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:14.858039 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef54e2-f323-443c-ad70-d3fab719db2e None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:14.903033 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a960e40-69c6-430e-aebd-770e0175b45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:14.903750 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a960e40-69c6-430e-aebd-770e0175b45d None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:14.903995 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a960e40-69c6-430e-aebd-770e0175b45d None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:14.904362 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a960e40-69c6-430e-aebd-770e0175b45d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:14.905057 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a960e40-69c6-430e-aebd-770e0175b45d None admin] RBAC: Adding query filter params (role.id=9252c356af254127896f3626d925a88a, scope.project.id=3131faaaf63143c4891d5b7ea7131cec, user.id=7738e47cbf7c4d698504a795d02c194a) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:14.905367 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a960e40-69c6-430e-aebd-770e0175b45d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:14.906978 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a960e40-69c6-430e-aebd-770e0175b45d None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:14.916834 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082a4c9-a576-4ee9-871e-32f0c8c35581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:14.917994 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082a4c9-a576-4ee9-871e-32f0c8c35581 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:14.919082 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082a4c9-a576-4ee9-871e-32f0c8c35581 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:14.919550 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082a4c9-a576-4ee9-871e-32f0c8c35581 None admin] PATH_INFO: `/v3/users/4df76d036f8b410588df74292bc5a6a0` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:14.920033 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 60/124] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Nov 2 07:22:14 2022] GET /identity/v3/role_assignments?user.id=7738e47cbf7c4d698504a795d02c194a&scope.project.id=3131faaaf63143c4891d5b7ea7131cec&role.id=9252c356af254127896f3626d925a88a => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:14.924105 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a960e40-69c6-430e-aebd-770e0175b45d None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:14.926619 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d082a4c9-a576-4ee9-871e-32f0c8c35581 None admin] RBAC: Authorizing `identity:get_user(user_id=4df76d036f8b410588df74292bc5a6a0)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:14.928490 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d082a4c9-a576-4ee9-871e-32f0c8c35581 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:14.930773 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 65/125] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Nov 2 07:22:14 2022] GET /identity/v3/users/4df76d036f8b410588df74292bc5a6a0 => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:14.938845 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082a4c9-a576-4ee9-871e-32f0c8c35581 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:14.986162 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:15.047269 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:15.060923 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a960e40-69c6-430e-aebd-770e0175b45d None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:15.068823 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082a4c9-a576-4ee9-871e-32f0c8c35581 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:15.104025 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e2e62-d54e-4cab-aaf3-b43c358d8dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:15.104915 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e2e62-d54e-4cab-aaf3-b43c358d8dde None admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:15.105261 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e2e62-d54e-4cab-aaf3-b43c358d8dde None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:15.105609 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e2e62-d54e-4cab-aaf3-b43c358d8dde None admin] PATH_INFO: `/v3/projects/3131faaaf63143c4891d5b7ea7131cec/users/5d0b4b6d1cbc49efaddb473444821d0b/roles/ad30a1e0742545958d34a1672de998c1` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:15.108468 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e2e62-d54e-4cab-aaf3-b43c358d8dde None admin] RBAC: Authorizing `identity:create_grant(project_id=3131faaaf63143c4891d5b7ea7131cec, user_id=5d0b4b6d1cbc49efaddb473444821d0b, role_id=ad30a1e0742545958d34a1672de998c1)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:15.112802 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e2e62-d54e-4cab-aaf3-b43c358d8dde None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:15.117003 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7b996-40e6-47cb-a139-6e01d240b99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:15.117915 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7b996-40e6-47cb-a139-6e01d240b99e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:15.118192 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7b996-40e6-47cb-a139-6e01d240b99e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:15.118468 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7b996-40e6-47cb-a139-6e01d240b99e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:15.178666 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 61/126] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Nov 2 07:22:14 2022] PUT /identity/v3/projects/3131faaaf63143c4891d5b7ea7131cec/users/5d0b4b6d1cbc49efaddb473444821d0b/roles/ad30a1e0742545958d34a1672de998c1 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:22:15.193268 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa7b996-40e6-47cb-a139-6e01d240b99e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:15.194834 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa7b996-40e6-47cb-a139-6e01d240b99e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:15.296532 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:15.314820 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 66/127] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Nov 2 07:22:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Nov 02 07:22:15.320426 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e2e62-d54e-4cab-aaf3-b43c358d8dde None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:15.329251 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3faab-27ce-4d43-9659-e127c90f9947 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:15.329562 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3faab-27ce-4d43-9659-e127c90f9947 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:15.329810 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3faab-27ce-4d43-9659-e127c90f9947 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:15.331297 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 67/128] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:22:15.337208 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216108fe-924a-478f-9002-1949e709fbff None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:15.337493 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216108fe-924a-478f-9002-1949e709fbff None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:15.337770 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216108fe-924a-478f-9002-1949e709fbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:15.357231 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-216108fe-924a-478f-9002-1949e709fbff None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:15.359003 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-216108fe-924a-478f-9002-1949e709fbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:15.431927 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 68/129] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:22:15.442327 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e2e62-d54e-4cab-aaf3-b43c358d8dde None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:15.450012 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:15.476396 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da202129-5fd1-4f2f-b7d0-1f3462bc3ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:15.477036 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da202129-5fd1-4f2f-b7d0-1f3462bc3ba3 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:15.477318 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da202129-5fd1-4f2f-b7d0-1f3462bc3ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:15.477594 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da202129-5fd1-4f2f-b7d0-1f3462bc3ba3 None admin] PATH_INFO: `/v3/projects/bdcc7489b7ff4dd99f7ae69a1bcfc9a5` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:15.478711 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da202129-5fd1-4f2f-b7d0-1f3462bc3ba3 None admin] RBAC: Authorizing `identity:get_project(project_id=bdcc7489b7ff4dd99f7ae69a1bcfc9a5)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:15.480211 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da202129-5fd1-4f2f-b7d0-1f3462bc3ba3 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:15.482297 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 62/130] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Nov 2 07:22:15 2022] GET /identity/v3/projects/bdcc7489b7ff4dd99f7ae69a1bcfc9a5 => generated 312 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:15.487891 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216108fe-924a-478f-9002-1949e709fbff None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:15.592596 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216108fe-924a-478f-9002-1949e709fbff None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:15.607086 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:15.627101 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52581f0c-0ba6-415a-90c6-23306d8cfe4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:15.627712 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52581f0c-0ba6-415a-90c6-23306d8cfe4a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:15.628311 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52581f0c-0ba6-415a-90c6-23306d8cfe4a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:15.628576 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52581f0c-0ba6-415a-90c6-23306d8cfe4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:15.629655 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52581f0c-0ba6-415a-90c6-23306d8cfe4a None admin] RBAC: Adding query filter params (role.id=c80de80e56e34e6caa3c27dcec321efd, scope.project.id=bdcc7489b7ff4dd99f7ae69a1bcfc9a5, user.id=4df76d036f8b410588df74292bc5a6a0) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:15.630303 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52581f0c-0ba6-415a-90c6-23306d8cfe4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:15.632251 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52581f0c-0ba6-415a-90c6-23306d8cfe4a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:15.639066 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 69/131] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Nov 2 07:22:15 2022] GET /identity/v3/role_assignments?user.id=4df76d036f8b410588df74292bc5a6a0&scope.project.id=bdcc7489b7ff4dd99f7ae69a1bcfc9a5&role.id=c80de80e56e34e6caa3c27dcec321efd => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:15.704628 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da202129-5fd1-4f2f-b7d0-1f3462bc3ba3 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:15.816627 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da202129-5fd1-4f2f-b7d0-1f3462bc3ba3 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:15.851368 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683fba38-4e06-4855-9883-790412ce983a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:15.852004 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fba38-4e06-4855-9883-790412ce983a None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:15.852305 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fba38-4e06-4855-9883-790412ce983a None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:15.852581 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fba38-4e06-4855-9883-790412ce983a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:15.853688 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683fba38-4e06-4855-9883-790412ce983a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:15.855117 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683fba38-4e06-4855-9883-790412ce983a None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:15.857405 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 63/132] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:15.862721 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52581f0c-0ba6-415a-90c6-23306d8cfe4a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:15.970229 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52581f0c-0ba6-415a-90c6-23306d8cfe4a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:16.002572 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c978b-60b9-4e9c-bca3-472be429cfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:16.003435 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c978b-60b9-4e9c-bca3-472be429cfac None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:16.003711 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c978b-60b9-4e9c-bca3-472be429cfac None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:16.003983 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c978b-60b9-4e9c-bca3-472be429cfac None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:16.004661 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c978b-60b9-4e9c-bca3-472be429cfac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:16.006100 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c978b-60b9-4e9c-bca3-472be429cfac None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:16.101694 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 70/133] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Nov 2 07:22:15 2022] POST /identity/v3/users => generated 283 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:22:17.357978 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0f95a-f6bd-4d2b-a526-66cca60faeda None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:17.358497 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0f95a-f6bd-4d2b-a526-66cca60faeda None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:17.358591 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0f95a-f6bd-4d2b-a526-66cca60faeda None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:17.359952 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 64/134] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:17.365262 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3326ad0-c7fc-40c1-b42e-769ffa72c9e7 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:17.365644 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3326ad0-c7fc-40c1-b42e-769ffa72c9e7 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:17.365821 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3326ad0-c7fc-40c1-b42e-769ffa72c9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:17.385601 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-d3326ad0-c7fc-40c1-b42e-769ffa72c9e7 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:17.386806 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d3326ad0-c7fc-40c1-b42e-769ffa72c9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:17.414588 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:17.457762 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 71/135] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:22:17.734640 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0f95a-f6bd-4d2b-a526-66cca60faeda None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:17.789439 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:17.852293 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0f95a-f6bd-4d2b-a526-66cca60faeda None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:17.889135 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2552c0-1d12-4c69-a909-4ea1e1f0dd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:17.889777 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2552c0-1d12-4c69-a909-4ea1e1f0dd53 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:17.890063 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2552c0-1d12-4c69-a909-4ea1e1f0dd53 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:17.890334 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2552c0-1d12-4c69-a909-4ea1e1f0dd53 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:17.901232 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2552c0-1d12-4c69-a909-4ea1e1f0dd53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:17.907524 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-ee2552c0-1d12-4c69-a909-4ea1e1f0dd53 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:22:17.907524 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:17.907524 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:17.907524 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:17.907524 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:17.907524 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:17.907524 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:17.907524 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:17.907524 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:17.907524 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:17.907524 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:17.907524 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:17.907524 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:17.907524 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:17.907524 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:17.907524 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:17.908393 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:17.908393 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:17.908393 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:17.908393 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:17.908393 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:17.908393 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:17.908393 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:17.908393 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:17.908393 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:17.908393 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:17.908393 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:17.908393 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:17.908393 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:17.908393 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:17.908393 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:17.908393 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:17.909141 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:17.909141 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:17.909141 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:17.909141 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:17.909141 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:17.909141 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:17.909141 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:17.909141 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:17.909141 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:17.909141 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:17.909141 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:22:17.909141 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:22:17.909141 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 65/136] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:17.915230 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3326ad0-c7fc-40c1-b42e-769ffa72c9e7 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:18.030022 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3326ad0-c7fc-40c1-b42e-769ffa72c9e7 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:18.066386 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d944ff-b7ed-4cf1-b26e-ed3be415db06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:18.067273 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d944ff-b7ed-4cf1-b26e-ed3be415db06 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:18.067694 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d944ff-b7ed-4cf1-b26e-ed3be415db06 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:18.068135 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d944ff-b7ed-4cf1-b26e-ed3be415db06 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:18.068937 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d944ff-b7ed-4cf1-b26e-ed3be415db06 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:18.069409 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d944ff-b7ed-4cf1-b26e-ed3be415db06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:18.070937 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d944ff-b7ed-4cf1-b26e-ed3be415db06 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:18.080234 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 72/137] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Nov 2 07:22:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:18.086300 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2552c0-1d12-4c69-a909-4ea1e1f0dd53 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:18.197977 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2552c0-1d12-4c69-a909-4ea1e1f0dd53 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:18.199467 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:18.234000 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ecc80-4c5a-49f3-a906-856a9de1ec71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:18.235071 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ecc80-4c5a-49f3-a906-856a9de1ec71 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:18.235720 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ecc80-4c5a-49f3-a906-856a9de1ec71 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:18.236250 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ecc80-4c5a-49f3-a906-856a9de1ec71 None admin] PATH_INFO: `/v3/users/5d0b4b6d1cbc49efaddb473444821d0b` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:18.237850 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ecc80-4c5a-49f3-a906-856a9de1ec71 None admin] RBAC: Authorizing `identity:get_user(user_id=5d0b4b6d1cbc49efaddb473444821d0b)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:18.239305 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ecc80-4c5a-49f3-a906-856a9de1ec71 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:18.241235 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 66/138] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Nov 2 07:22:18 2022] GET /identity/v3/users/5d0b4b6d1cbc49efaddb473444821d0b => generated 289 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:18.247296 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d944ff-b7ed-4cf1-b26e-ed3be415db06 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:18.281776 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:18.363522 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d944ff-b7ed-4cf1-b26e-ed3be415db06 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:18.404043 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2c938-aafc-452c-99c6-6ba710fddb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:18.404668 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2c938-aafc-452c-99c6-6ba710fddb40 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:18.404941 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2c938-aafc-452c-99c6-6ba710fddb40 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:18.405212 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2c938-aafc-452c-99c6-6ba710fddb40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:18.427459 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f9fe0-8107-461e-9c81-4bd90bc3cdb9 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:18.427947 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f9fe0-8107-461e-9c81-4bd90bc3cdb9 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:18.428019 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f9fe0-8107-461e-9c81-4bd90bc3cdb9 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:18.429531 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 67/139] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:22:18.435333 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99d16c-899e-4f03-9dbe-07b48f700521 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:18.435863 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99d16c-899e-4f03-9dbe-07b48f700521 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:18.436457 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99d16c-899e-4f03-9dbe-07b48f700521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:18.456016 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-5e99d16c-899e-4f03-9dbe-07b48f700521 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:18.457563 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-5e99d16c-899e-4f03-9dbe-07b48f700521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:18.474724 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2c938-aafc-452c-99c6-6ba710fddb40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:18.476215 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2c938-aafc-452c-99c6-6ba710fddb40 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:18.505208 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:18.532965 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 68/140] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:22:18.533983 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881aec0e-57ae-4c59-a4c4-98d7b956b2fe None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:18.534271 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881aec0e-57ae-4c59-a4c4-98d7b956b2fe None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:18.534543 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881aec0e-57ae-4c59-a4c4-98d7b956b2fe None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:18.535967 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 69/141] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:18.541435 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748a2ce-a8b8-4a9e-892d-9d80b8607b4e None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:18.541762 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748a2ce-a8b8-4a9e-892d-9d80b8607b4e None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:18.541998 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748a2ce-a8b8-4a9e-892d-9d80b8607b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:18.560950 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-7748a2ce-a8b8-4a9e-892d-9d80b8607b4e None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:18.562236 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-7748a2ce-a8b8-4a9e-892d-9d80b8607b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:18.603104 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 73/142] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Nov 2 07:22:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:22:18.611273 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2c938-aafc-452c-99c6-6ba710fddb40 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:18.639021 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 70/143] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:22:18.642395 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa99e5-85c8-460f-98c0-39fe52996173 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:18.643032 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa99e5-85c8-460f-98c0-39fe52996173 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:18.643531 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa99e5-85c8-460f-98c0-39fe52996173 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:18.645476 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 71/144] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:18.650773 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050b8e1-c15e-401f-a668-1112fb9a6e40 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:18.651056 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050b8e1-c15e-401f-a668-1112fb9a6e40 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:18.651329 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050b8e1-c15e-401f-a668-1112fb9a6e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:18.671350 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-c050b8e1-c15e-401f-a668-1112fb9a6e40 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:18.672673 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c050b8e1-c15e-401f-a668-1112fb9a6e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:18.703619 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:18.743420 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2c938-aafc-452c-99c6-6ba710fddb40 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:18.755597 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 72/145] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:18.780086 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:18.793814 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374a644-530f-474b-ac3a-5a8f8b08a230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:18.793814 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374a644-530f-474b-ac3a-5a8f8b08a230 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:18.793814 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374a644-530f-474b-ac3a-5a8f8b08a230 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:18.793814 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374a644-530f-474b-ac3a-5a8f8b08a230 None admin] PATH_INFO: `/v3/projects/3131faaaf63143c4891d5b7ea7131cec` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:18.794104 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374a644-530f-474b-ac3a-5a8f8b08a230 None admin] RBAC: Authorizing `identity:get_project(project_id=3131faaaf63143c4891d5b7ea7131cec)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:18.794104 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374a644-530f-474b-ac3a-5a8f8b08a230 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:18.799711 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 74/146] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Nov 2 07:22:18 2022] GET /identity/v3/projects/3131faaaf63143c4891d5b7ea7131cec => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:18.801066 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050b8e1-c15e-401f-a668-1112fb9a6e40 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:18.807112 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374a644-530f-474b-ac3a-5a8f8b08a230 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:18.924154 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374a644-530f-474b-ac3a-5a8f8b08a230 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:18.928589 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050b8e1-c15e-401f-a668-1112fb9a6e40 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:18.963281 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0b9df-ea47-4fc5-adbe-750890d535a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:18.963914 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0b9df-ea47-4fc5-adbe-750890d535a7 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:18.964222 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0b9df-ea47-4fc5-adbe-750890d535a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:18.964493 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0b9df-ea47-4fc5-adbe-750890d535a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:18.970632 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ff7f0-80c4-4cd2-95cf-9a5b3e2b7990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:18.971454 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ff7f0-80c4-4cd2-95cf-9a5b3e2b7990 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:18.971869 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ff7f0-80c4-4cd2-95cf-9a5b3e2b7990 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:18.972398 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ff7f0-80c4-4cd2-95cf-9a5b3e2b7990 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:18.973381 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ff7f0-80c4-4cd2-95cf-9a5b3e2b7990 None admin] RBAC: Adding query filter params (role.id=ad30a1e0742545958d34a1672de998c1, scope.project.id=3131faaaf63143c4891d5b7ea7131cec, user.id=5d0b4b6d1cbc49efaddb473444821d0b) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:18.973821 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ff7f0-80c4-4cd2-95cf-9a5b3e2b7990 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:18.975370 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ff7f0-80c4-4cd2-95cf-9a5b3e2b7990 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:18.975480 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e0b9df-ea47-4fc5-adbe-750890d535a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:18.980680 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-90e0b9df-ea47-4fc5-adbe-750890d535a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:22:18.980680 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:18.980680 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:18.980680 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:18.980680 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:18.980680 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:18.980680 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:18.980680 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:18.980680 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:18.980680 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:18.980680 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:18.980680 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:18.980680 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:18.980680 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:18.980680 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:18.980680 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:18.982033 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:18.982033 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:18.982033 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:18.982033 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:18.982033 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:18.982033 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:18.982033 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:18.982033 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:18.982033 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:18.982033 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:18.982033 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:18.982033 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:18.982033 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:18.982033 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:18.982033 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:18.982033 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:18.983007 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:18.983007 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:18.983007 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:18.983007 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:18.983007 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:18.983007 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:18.983007 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:18.983007 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:18.983007 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:18.983007 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:18.983007 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:22:18.983007 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:22:18.983007 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 75/147] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Nov 2 07:22:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:22:18.984681 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 73/148] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Nov 2 07:22:18 2022] GET /identity/v3/role_assignments?user.id=5d0b4b6d1cbc49efaddb473444821d0b&scope.project.id=3131faaaf63143c4891d5b7ea7131cec&role.id=ad30a1e0742545958d34a1672de998c1 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:18.987473 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ff7f0-80c4-4cd2-95cf-9a5b3e2b7990 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:18.988566 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0b9df-ea47-4fc5-adbe-750890d535a7 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:19.023964 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:19.071093 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:19.110206 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ff7f0-80c4-4cd2-95cf-9a5b3e2b7990 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:19.123569 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0b9df-ea47-4fc5-adbe-750890d535a7 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:19.146825 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc01d58-0f03-43b0-b043-43fb70401989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:19.147465 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc01d58-0f03-43b0-b043-43fb70401989 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:19.147755 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc01d58-0f03-43b0-b043-43fb70401989 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:19.148014 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc01d58-0f03-43b0-b043-43fb70401989 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:19.148722 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc01d58-0f03-43b0-b043-43fb70401989 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:19.149022 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc01d58-0f03-43b0-b043-43fb70401989 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:19.150424 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc01d58-0f03-43b0-b043-43fb70401989 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:19.161598 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 74/149] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:19.162530 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc01d58-0f03-43b0-b043-43fb70401989 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:19.167880 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1afed-edc1-4fbe-8aa7-0053eb39071c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:19.169364 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1afed-edc1-4fbe-8aa7-0053eb39071c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:19.169591 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1afed-edc1-4fbe-8aa7-0053eb39071c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:19.169860 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1afed-edc1-4fbe-8aa7-0053eb39071c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:19.182524 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec1afed-edc1-4fbe-8aa7-0053eb39071c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:19.188920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-eec1afed-edc1-4fbe-8aa7-0053eb39071c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:22:19.188920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:19.188920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:19.188920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:19.188920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:19.188920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:19.188920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:19.188920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:19.188920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:19.188920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:19.188920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:19.188920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:19.188920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:19.188920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:19.188920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:19.188920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:19.189866 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:19.189866 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:19.189866 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:19.189866 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:19.189866 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:19.189866 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:19.189866 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:19.189866 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:19.189866 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:19.189866 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:19.189866 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:19.189866 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:19.189866 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:19.189866 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:19.189866 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:19.189866 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:19.190632 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:19.190632 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:19.190632 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:19.190632 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:19.190632 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:19.190632 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:19.190632 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:19.190632 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:19.190632 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:19.190632 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:19.190632 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:22:19.190632 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:22:19.190632 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 76/150] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Nov 2 07:22:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:19.195534 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1afed-edc1-4fbe-8aa7-0053eb39071c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:19.265492 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:19.281906 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc01d58-0f03-43b0-b043-43fb70401989 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:19.297431 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1afed-edc1-4fbe-8aa7-0053eb39071c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:19.310465 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:19.315467 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4108efb-2bb8-49f3-92cd-967d4ade8310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:19.316118 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4108efb-2bb8-49f3-92cd-967d4ade8310 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:19.316406 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4108efb-2bb8-49f3-92cd-967d4ade8310 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:19.316674 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4108efb-2bb8-49f3-92cd-967d4ade8310 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:19.317751 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4108efb-2bb8-49f3-92cd-967d4ade8310 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:19.319171 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4108efb-2bb8-49f3-92cd-967d4ade8310 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:19.320735 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 75/151] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:19.321541 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4108efb-2bb8-49f3-92cd-967d4ade8310 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:19.331164 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa87f0-f653-4042-976f-89773858d832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:19.331783 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa87f0-f653-4042-976f-89773858d832 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:19.332070 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa87f0-f653-4042-976f-89773858d832 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:19.332348 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa87f0-f653-4042-976f-89773858d832 None admin] PATH_INFO: `/v3/users/2b5baaae9a82440b93d675668be2d13d` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:19.346269 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa87f0-f653-4042-976f-89773858d832 None admin] RBAC: Authorizing `identity:get_user(user_id=2b5baaae9a82440b93d675668be2d13d)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:19.347740 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa87f0-f653-4042-976f-89773858d832 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:19.349608 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 77/152] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Nov 2 07:22:19 2022] GET /identity/v3/users/2b5baaae9a82440b93d675668be2d13d => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:19.350188 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa87f0-f653-4042-976f-89773858d832 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:19.426279 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4108efb-2bb8-49f3-92cd-967d4ade8310 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:19.448501 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa87f0-f653-4042-976f-89773858d832 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:19.459721 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316d93b-bc9c-4fe5-a437-5a3bcba43a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:19.460367 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316d93b-bc9c-4fe5-a437-5a3bcba43a9e None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:19.460651 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316d93b-bc9c-4fe5-a437-5a3bcba43a9e None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:19.460926 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316d93b-bc9c-4fe5-a437-5a3bcba43a9e None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:19.461583 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3316d93b-bc9c-4fe5-a437-5a3bcba43a9e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:19.461885 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3316d93b-bc9c-4fe5-a437-5a3bcba43a9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:19.463249 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3316d93b-bc9c-4fe5-a437-5a3bcba43a9e None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:19.472263 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 76/153] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Nov 2 07:22:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:19.474328 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316d93b-bc9c-4fe5-a437-5a3bcba43a9e None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:19.483450 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80813fb2-f2c3-46ab-93d5-19edf755d0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:19.484095 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80813fb2-f2c3-46ab-93d5-19edf755d0f9 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:19.484359 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80813fb2-f2c3-46ab-93d5-19edf755d0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:19.484627 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80813fb2-f2c3-46ab-93d5-19edf755d0f9 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:19.485262 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80813fb2-f2c3-46ab-93d5-19edf755d0f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:19.486729 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80813fb2-f2c3-46ab-93d5-19edf755d0f9 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:19.492565 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:19.569592 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316d93b-bc9c-4fe5-a437-5a3bcba43a9e None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:19.600492 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4217d02-1f2c-4829-8fc5-e1dcec26d473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:19.601113 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4217d02-1f2c-4829-8fc5-e1dcec26d473 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:19.601386 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4217d02-1f2c-4829-8fc5-e1dcec26d473 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:19.601651 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4217d02-1f2c-4829-8fc5-e1dcec26d473 None admin] PATH_INFO: `/v3/projects/83c9c0ecb1ce451abd74d256c2639262` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:19.602772 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4217d02-1f2c-4829-8fc5-e1dcec26d473 None admin] RBAC: Authorizing `identity:get_project(project_id=83c9c0ecb1ce451abd74d256c2639262)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:19.604219 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4217d02-1f2c-4829-8fc5-e1dcec26d473 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:19.606455 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 77/154] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Nov 2 07:22:19 2022] GET /identity/v3/projects/83c9c0ecb1ce451abd74d256c2639262 => generated 302 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:19.607289 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4217d02-1f2c-4829-8fc5-e1dcec26d473 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:19.673493 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 78/155] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Nov 2 07:22:19 2022] POST /identity/v3/users => generated 297 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:22:19.673493 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80813fb2-f2c3-46ab-93d5-19edf755d0f9 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:19.698861 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:19.706827 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:19.716807 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4217d02-1f2c-4829-8fc5-e1dcec26d473 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:19.756893 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24c582-a679-4bef-a4f2-f09a274c3d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:19.757703 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24c582-a679-4bef-a4f2-f09a274c3d0c None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:19.758052 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24c582-a679-4bef-a4f2-f09a274c3d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:19.758382 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24c582-a679-4bef-a4f2-f09a274c3d0c None admin] PATH_INFO: `/v3/users/2b5baaae9a82440b93d675668be2d13d` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:19.759700 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de24c582-a679-4bef-a4f2-f09a274c3d0c None admin] RBAC: Authorizing `identity:get_user(user_id=2b5baaae9a82440b93d675668be2d13d)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:19.761281 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de24c582-a679-4bef-a4f2-f09a274c3d0c None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:19.764251 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 78/156] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Nov 2 07:22:19 2022] GET /identity/v3/users/2b5baaae9a82440b93d675668be2d13d => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:19.769041 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24c582-a679-4bef-a4f2-f09a274c3d0c None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:19.791220 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80813fb2-f2c3-46ab-93d5-19edf755d0f9 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:19.831432 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01b3cd-5747-440c-9255-9d387d923df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:19.832353 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01b3cd-5747-440c-9255-9d387d923df9 None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:19.832742 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01b3cd-5747-440c-9255-9d387d923df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:19.833149 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01b3cd-5747-440c-9255-9d387d923df9 None admin] PATH_INFO: `/v3/projects/83c9c0ecb1ce451abd74d256c2639262/users/2b5baaae9a82440b93d675668be2d13d/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:19.836486 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac01b3cd-5747-440c-9255-9d387d923df9 None admin] RBAC: Authorizing `identity:create_grant(project_id=83c9c0ecb1ce451abd74d256c2639262, user_id=2b5baaae9a82440b93d675668be2d13d, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:19.838610 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac01b3cd-5747-440c-9255-9d387d923df9 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:19.890953 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24c582-a679-4bef-a4f2-f09a274c3d0c None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:19.927988 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57fbb4-34f2-435a-85db-3bb2478db682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:19.928810 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 79/157] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Nov 2 07:22:19 2022] PUT /identity/v3/projects/83c9c0ecb1ce451abd74d256c2639262/users/2b5baaae9a82440b93d675668be2d13d/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:22:19.928932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57fbb4-34f2-435a-85db-3bb2478db682 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:19.928932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57fbb4-34f2-435a-85db-3bb2478db682 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:19.930808 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57fbb4-34f2-435a-85db-3bb2478db682 None admin] PATH_INFO: `/v3/projects/83c9c0ecb1ce451abd74d256c2639262` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:19.930808 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee57fbb4-34f2-435a-85db-3bb2478db682 None admin] RBAC: Authorizing `identity:get_project(project_id=83c9c0ecb1ce451abd74d256c2639262)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:19.931718 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee57fbb4-34f2-435a-85db-3bb2478db682 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:19.933539 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 79/158] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Nov 2 07:22:19 2022] GET /identity/v3/projects/83c9c0ecb1ce451abd74d256c2639262 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:19.945585 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01b3cd-5747-440c-9255-9d387d923df9 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:20.055425 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:20.070557 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01b3cd-5747-440c-9255-9d387d923df9 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:20.111005 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b74c46-1979-4e7c-80ae-c431ba86e94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:20.111685 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b74c46-1979-4e7c-80ae-c431ba86e94a None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:20.112016 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b74c46-1979-4e7c-80ae-c431ba86e94a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:20.112350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b74c46-1979-4e7c-80ae-c431ba86e94a None admin] PATH_INFO: `/v3/projects/83c9c0ecb1ce451abd74d256c2639262/users/2b5baaae9a82440b93d675668be2d13d/roles/c2071a72276d475daff2d76d195df6c4` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:20.114650 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b74c46-1979-4e7c-80ae-c431ba86e94a None admin] RBAC: Authorizing `identity:create_grant(project_id=83c9c0ecb1ce451abd74d256c2639262, user_id=2b5baaae9a82440b93d675668be2d13d, role_id=c2071a72276d475daff2d76d195df6c4)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:20.116141 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b74c46-1979-4e7c-80ae-c431ba86e94a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:20.194212 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 80/159] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Nov 2 07:22:19 2022] PUT /identity/v3/projects/83c9c0ecb1ce451abd74d256c2639262/users/2b5baaae9a82440b93d675668be2d13d/roles/c2071a72276d475daff2d76d195df6c4 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:22:21.958048 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3837b11-c95a-4e60-ad67-a2942a5b35b7 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:21.958536 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3837b11-c95a-4e60-ad67-a2942a5b35b7 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:21.958632 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3837b11-c95a-4e60-ad67-a2942a5b35b7 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:21.959938 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 80/160] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:21.966407 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22d997-515d-47b9-9462-35ef4b35db01 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:21.967359 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22d997-515d-47b9-9462-35ef4b35db01 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:21.967838 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22d997-515d-47b9-9462-35ef4b35db01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:21.987944 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-da22d997-515d-47b9-9462-35ef4b35db01 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:21.989564 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-da22d997-515d-47b9-9462-35ef4b35db01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:22.071101 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 81/161] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:22.111087 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f473f-b3d4-42ed-95c2-39ef9e7477eb None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:22.111707 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f473f-b3d4-42ed-95c2-39ef9e7477eb None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:22.112224 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f473f-b3d4-42ed-95c2-39ef9e7477eb None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:22.113784 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 81/162] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:22.119299 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e342eec0-7f54-4d91-a3ac-15091d86a21f None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:22.119593 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e342eec0-7f54-4d91-a3ac-15091d86a21f None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:22.119869 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e342eec0-7f54-4d91-a3ac-15091d86a21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:22.139151 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-e342eec0-7f54-4d91-a3ac-15091d86a21f None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:22.140378 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e342eec0-7f54-4d91-a3ac-15091d86a21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:22.162634 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a6043-ca3a-4d8e-9bef-c40b0758d3a6 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:22.163232 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a6043-ca3a-4d8e-9bef-c40b0758d3a6 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:22.163706 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a6043-ca3a-4d8e-9bef-c40b0758d3a6 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:22.165506 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 82/163] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:22.172819 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446dbe7-ce1c-4166-8b47-841d0b3fbdf2 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:22.173096 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446dbe7-ce1c-4166-8b47-841d0b3fbdf2 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:22.173369 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446dbe7-ce1c-4166-8b47-841d0b3fbdf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:22.192081 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-0446dbe7-ce1c-4166-8b47-841d0b3fbdf2 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:22.193342 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-0446dbe7-ce1c-4166-8b47-841d0b3fbdf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:22.208478 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:22.211477 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 82/164] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:22.264528 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 83/165] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:22:22.358255 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e342eec0-7f54-4d91-a3ac-15091d86a21f None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:22.368877 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:22.432332 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612b0b2-115e-42ce-a0e6-8a67a200eb47 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:22.432979 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612b0b2-115e-42ce-a0e6-8a67a200eb47 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:22.433447 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612b0b2-115e-42ce-a0e6-8a67a200eb47 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:22.435167 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 84/166] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:22:22.440474 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750613ec-7133-4ead-afb7-3cc0dae40906 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:22.440991 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750613ec-7133-4ead-afb7-3cc0dae40906 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:22.441466 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750613ec-7133-4ead-afb7-3cc0dae40906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:22.461658 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-750613ec-7133-4ead-afb7-3cc0dae40906 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:22.461922 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e342eec0-7f54-4d91-a3ac-15091d86a21f None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:22.463436 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-750613ec-7133-4ead-afb7-3cc0dae40906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:22.500164 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087eb1f-2dfa-49b8-8979-a765d341849f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:22.501025 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087eb1f-2dfa-49b8-8979-a765d341849f None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:22.501304 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087eb1f-2dfa-49b8-8979-a765d341849f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:22.501572 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087eb1f-2dfa-49b8-8979-a765d341849f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:22.511793 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d087eb1f-2dfa-49b8-8979-a765d341849f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:22.517110 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-d087eb1f-2dfa-49b8-8979-a765d341849f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:22.517110 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:22.517110 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:22.517110 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:22.517110 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:22.517110 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:22.517110 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:22.517110 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:22.517110 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:22.517110 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:22.517110 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:22.517110 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:22.517110 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:22.517110 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:22.517110 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:22.517110 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:22.518044 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:22.518044 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:22.518044 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:22.518044 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:22.518044 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:22.518044 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:22.518044 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:22.518044 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:22.518044 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:22.518044 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:22.518044 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:22.518044 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:22.518044 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:22.518044 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:22.518044 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:22.518044 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:22.518853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:22.518853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:22.518853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:22.518853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:22.518853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:22.518853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:22.518853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:22.518853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:22.518853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:22.518853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:22.518853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:22.518853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:22:22.518853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 83/167] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:22.519554 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087eb1f-2dfa-49b8-8979-a765d341849f None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:22.542358 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 85/168] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:22.544977 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750613ec-7133-4ead-afb7-3cc0dae40906 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:22.594181 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:22.627625 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:22.629015 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087eb1f-2dfa-49b8-8979-a765d341849f None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:22.647330 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750613ec-7133-4ead-afb7-3cc0dae40906 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:22.663706 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae726599-2943-41a6-8e30-3381e918f98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:22.664379 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae726599-2943-41a6-8e30-3381e918f98d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:22.664656 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae726599-2943-41a6-8e30-3381e918f98d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:22.664922 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae726599-2943-41a6-8e30-3381e918f98d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:22.666045 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae726599-2943-41a6-8e30-3381e918f98d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:22.667511 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae726599-2943-41a6-8e30-3381e918f98d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:22.673557 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 84/169] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:22.673557 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae726599-2943-41a6-8e30-3381e918f98d None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:22.687668 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8ee36-8ec5-4a71-ae12-5aaa802bfb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:22.688318 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8ee36-8ec5-4a71-ae12-5aaa802bfb9c None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:22.688593 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8ee36-8ec5-4a71-ae12-5aaa802bfb9c None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:22.688860 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8ee36-8ec5-4a71-ae12-5aaa802bfb9c None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:22.689506 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8ee36-8ec5-4a71-ae12-5aaa802bfb9c None admin] RBAC: Adding query filter params (name=member) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:22.689803 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8ee36-8ec5-4a71-ae12-5aaa802bfb9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:22.691378 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8ee36-8ec5-4a71-ae12-5aaa802bfb9c None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:22.700888 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 86/170] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Nov 2 07:22:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:22.701479 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8ee36-8ec5-4a71-ae12-5aaa802bfb9c None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:22.783481 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae726599-2943-41a6-8e30-3381e918f98d None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:22.806845 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8ee36-8ec5-4a71-ae12-5aaa802bfb9c None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:22.822420 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a836510-560f-4e11-8e84-e1732aca948a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:22.823046 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a836510-560f-4e11-8e84-e1732aca948a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:22.823324 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a836510-560f-4e11-8e84-e1732aca948a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:22.823589 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a836510-560f-4e11-8e84-e1732aca948a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:22.826516 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:22.834737 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a836510-560f-4e11-8e84-e1732aca948a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:22.839514 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-0a836510-560f-4e11-8e84-e1732aca948a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:22:22.839514 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:22.839514 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:22.839514 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:22.839514 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:22.839514 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:22.839514 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:22.839514 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:22.839514 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:22.839514 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:22.839514 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:22.839514 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:22.839514 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:22.839514 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:22.839514 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:22.839514 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:22.841121 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:22.841121 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:22.841121 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:22.841121 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:22.841121 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:22.841121 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:22.841121 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:22.841121 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:22.841121 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:22.841121 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:22.841121 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:22.841121 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:22.841121 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:22.841121 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:22.841121 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:22.841121 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:22.842042 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:22.842042 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:22.842042 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:22.842042 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:22.842042 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:22.842042 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:22.842042 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:22.842042 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:22.842042 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:22.842042 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:22.842042 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:22:22.842042 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:22:22.842042 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 85/171] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Nov 2 07:22:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:22.842823 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e105e98-8aed-4ec0-aecd-9e0558225a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:22.842823 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e105e98-8aed-4ec0-aecd-9e0558225a2e None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:22.842823 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e105e98-8aed-4ec0-aecd-9e0558225a2e None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:22.842823 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e105e98-8aed-4ec0-aecd-9e0558225a2e None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:22.843079 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e105e98-8aed-4ec0-aecd-9e0558225a2e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:22.844383 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e105e98-8aed-4ec0-aecd-9e0558225a2e None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:22.845009 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a836510-560f-4e11-8e84-e1732aca948a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:22.940955 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a836510-560f-4e11-8e84-e1732aca948a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:22.979213 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a3102-b397-4b1c-8ddf-ae8d321c0e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:22.979827 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a3102-b397-4b1c-8ddf-ae8d321c0e9a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:22.980133 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a3102-b397-4b1c-8ddf-ae8d321c0e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:22.980408 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a3102-b397-4b1c-8ddf-ae8d321c0e9a None admin] PATH_INFO: `/v3/users/403c20cf1d4847e8bf711b53bb556fe2` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:22.993971 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a3102-b397-4b1c-8ddf-ae8d321c0e9a None admin] RBAC: Authorizing `identity:get_user(user_id=403c20cf1d4847e8bf711b53bb556fe2)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:22.995535 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a3102-b397-4b1c-8ddf-ae8d321c0e9a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:22.997356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 86/172] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Nov 2 07:22:22 2022] GET /identity/v3/users/403c20cf1d4847e8bf711b53bb556fe2 => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:22.998192 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a3102-b397-4b1c-8ddf-ae8d321c0e9a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:23.052245 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:23.052393 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:23.058051 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 87/173] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Nov 2 07:22:22 2022] POST /identity/v3/users => generated 297 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:22:23.058869 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e105e98-8aed-4ec0-aecd-9e0558225a2e None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:23.103539 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a3102-b397-4b1c-8ddf-ae8d321c0e9a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:23.145807 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61f1c0-599c-4225-9687-110011b666d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:23.146793 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61f1c0-599c-4225-9687-110011b666d5 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:23.147258 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61f1c0-599c-4225-9687-110011b666d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:23.147725 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61f1c0-599c-4225-9687-110011b666d5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:23.164837 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee61f1c0-599c-4225-9687-110011b666d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:23.170437 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-ee61f1c0-599c-4225-9687-110011b666d5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:22:23.170437 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:23.170437 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:23.170437 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:23.170437 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:23.170437 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:23.170437 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:23.170437 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:23.170437 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:23.170437 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:23.170437 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:23.170437 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:23.170437 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:23.170437 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:23.170437 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:23.170437 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:23.171370 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:23.171370 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:23.171370 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:23.171370 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:23.171370 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:23.171370 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:23.171370 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:23.171370 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:23.171370 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:23.171370 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:23.171370 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:23.171370 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:23.171370 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:23.171370 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:23.171370 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:23.171370 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:23.177904 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:23.177904 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:23.177904 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:23.177904 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:23.177904 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:23.177904 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:23.177904 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:23.177904 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:23.177904 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:23.177904 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:23.177904 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:22:23.177904 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:22:23.177904 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 87/174] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Nov 2 07:22:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:23.177904 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61f1c0-599c-4225-9687-110011b666d5 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:23.184169 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e105e98-8aed-4ec0-aecd-9e0558225a2e None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:23.224965 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d09f18-3f9f-4c74-91ef-aed884d3d569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:23.225585 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d09f18-3f9f-4c74-91ef-aed884d3d569 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:23.225878 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d09f18-3f9f-4c74-91ef-aed884d3d569 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:23.226150 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d09f18-3f9f-4c74-91ef-aed884d3d569 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:23.226810 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d09f18-3f9f-4c74-91ef-aed884d3d569 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:23.227111 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d09f18-3f9f-4c74-91ef-aed884d3d569 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:23.228565 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d09f18-3f9f-4c74-91ef-aed884d3d569 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:23.239142 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 88/175] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:23.239759 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d09f18-3f9f-4c74-91ef-aed884d3d569 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:23.301515 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61f1c0-599c-4225-9687-110011b666d5 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:23.318396 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:23.320705 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:23.343286 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30deff-e31d-4565-9b78-0861d27243cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:23.343932 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30deff-e31d-4565-9b78-0861d27243cc None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:23.344655 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30deff-e31d-4565-9b78-0861d27243cc None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:23.344776 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30deff-e31d-4565-9b78-0861d27243cc None admin] PATH_INFO: `/v3/projects/83c9c0ecb1ce451abd74d256c2639262` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:23.348091 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe30deff-e31d-4565-9b78-0861d27243cc None admin] RBAC: Authorizing `identity:get_project(project_id=83c9c0ecb1ce451abd74d256c2639262)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:23.349750 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe30deff-e31d-4565-9b78-0861d27243cc None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:23.351666 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 88/176] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Nov 2 07:22:23 2022] GET /identity/v3/projects/83c9c0ecb1ce451abd74d256c2639262 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:23.353525 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30deff-e31d-4565-9b78-0861d27243cc None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:23.381499 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d09f18-3f9f-4c74-91ef-aed884d3d569 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:23.437532 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da58d53-0a2a-4a41-8632-b5388b440851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:23.438158 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da58d53-0a2a-4a41-8632-b5388b440851 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:23.438429 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da58d53-0a2a-4a41-8632-b5388b440851 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:23.438702 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da58d53-0a2a-4a41-8632-b5388b440851 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:23.439368 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da58d53-0a2a-4a41-8632-b5388b440851 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:23.439672 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da58d53-0a2a-4a41-8632-b5388b440851 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:23.441100 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da58d53-0a2a-4a41-8632-b5388b440851 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:23.451991 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 89/177] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Nov 2 07:22:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:23.452841 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da58d53-0a2a-4a41-8632-b5388b440851 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:23.504170 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30deff-e31d-4565-9b78-0861d27243cc None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:23.546908 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08df6a-6f6f-46de-886c-4961fccb682b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:23.547551 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08df6a-6f6f-46de-886c-4961fccb682b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:23.547826 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08df6a-6f6f-46de-886c-4961fccb682b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:23.548122 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08df6a-6f6f-46de-886c-4961fccb682b None admin] PATH_INFO: `/v3/users/2b5baaae9a82440b93d675668be2d13d` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:23.549292 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb08df6a-6f6f-46de-886c-4961fccb682b None admin] RBAC: Authorizing `identity:get_user(user_id=2b5baaae9a82440b93d675668be2d13d)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:23.550985 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb08df6a-6f6f-46de-886c-4961fccb682b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:23.552929 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 89/178] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Nov 2 07:22:23 2022] GET /identity/v3/users/2b5baaae9a82440b93d675668be2d13d => generated 283 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:23.553815 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08df6a-6f6f-46de-886c-4961fccb682b None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:23.602519 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da58d53-0a2a-4a41-8632-b5388b440851 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:23.617693 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:23.634014 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:23.647284 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e4ea7-ab32-4feb-aab7-c204ae9c3d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:23.647967 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e4ea7-ab32-4feb-aab7-c204ae9c3d69 None admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:23.648304 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e4ea7-ab32-4feb-aab7-c204ae9c3d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:23.648583 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e4ea7-ab32-4feb-aab7-c204ae9c3d69 None admin] PATH_INFO: `/v3/projects/83c9c0ecb1ce451abd74d256c2639262/users/403c20cf1d4847e8bf711b53bb556fe2/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:23.650836 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13e4ea7-ab32-4feb-aab7-c204ae9c3d69 None admin] RBAC: Authorizing `identity:create_grant(project_id=83c9c0ecb1ce451abd74d256c2639262, user_id=403c20cf1d4847e8bf711b53bb556fe2, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:23.652328 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13e4ea7-ab32-4feb-aab7-c204ae9c3d69 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:23.681954 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08df6a-6f6f-46de-886c-4961fccb682b None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:23.724686 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234f554-89f7-4910-baf4-30b738c426cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:23.725477 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234f554-89f7-4910-baf4-30b738c426cb None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:23.725861 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234f554-89f7-4910-baf4-30b738c426cb None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:23.726233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234f554-89f7-4910-baf4-30b738c426cb None admin] PATH_INFO: `/v3/users/2b5baaae9a82440b93d675668be2d13d` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:23.727505 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3234f554-89f7-4910-baf4-30b738c426cb None admin] RBAC: Authorizing `identity:get_user(user_id=2b5baaae9a82440b93d675668be2d13d)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:23.729148 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3234f554-89f7-4910-baf4-30b738c426cb None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:23.731161 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 90/179] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Nov 2 07:22:23 2022] GET /identity/v3/users/2b5baaae9a82440b93d675668be2d13d => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:23.732638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234f554-89f7-4910-baf4-30b738c426cb None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:23.738920 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 90/180] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Nov 2 07:22:23 2022] PUT /identity/v3/projects/83c9c0ecb1ce451abd74d256c2639262/users/403c20cf1d4847e8bf711b53bb556fe2/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:22:23.740351 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e4ea7-ab32-4feb-aab7-c204ae9c3d69 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:23.925057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234f554-89f7-4910-baf4-30b738c426cb None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:23.946537 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:23.968648 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb510d31-e4c0-4ede-8a65-82686c39eb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:23.969532 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb510d31-e4c0-4ede-8a65-82686c39eb08 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:23.969971 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb510d31-e4c0-4ede-8a65-82686c39eb08 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:23.970383 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb510d31-e4c0-4ede-8a65-82686c39eb08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:24.021225 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e4ea7-ab32-4feb-aab7-c204ae9c3d69 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:24.063903 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb510d31-e4c0-4ede-8a65-82686c39eb08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:24.065933 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb510d31-e4c0-4ede-8a65-82686c39eb08 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:24.077460 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf465d-9600-4ef6-a5e2-76186118d965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:24.078758 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf465d-9600-4ef6-a5e2-76186118d965 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:24.079315 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf465d-9600-4ef6-a5e2-76186118d965 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:24.079785 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf465d-9600-4ef6-a5e2-76186118d965 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:24.187679 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:24.208848 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf465d-9600-4ef6-a5e2-76186118d965 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:24.210341 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf465d-9600-4ef6-a5e2-76186118d965 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:24.214268 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 91/181] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Nov 2 07:22:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:22:24.251746 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb510d31-e4c0-4ede-8a65-82686c39eb08 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:24.261616 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:24.357922 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 91/182] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Nov 2 07:22:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:22:24.364090 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf465d-9600-4ef6-a5e2-76186118d965 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:24.434571 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb510d31-e4c0-4ede-8a65-82686c39eb08 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:24.475236 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0da77-7d10-4df0-b7fb-d031dc72e946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:24.475878 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0da77-7d10-4df0-b7fb-d031dc72e946 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:24.476182 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0da77-7d10-4df0-b7fb-d031dc72e946 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:24.476449 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0da77-7d10-4df0-b7fb-d031dc72e946 None admin] PATH_INFO: `/v3/projects/83c9c0ecb1ce451abd74d256c2639262` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:24.477728 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0da77-7d10-4df0-b7fb-d031dc72e946 None admin] RBAC: Authorizing `identity:get_project(project_id=83c9c0ecb1ce451abd74d256c2639262)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:24.479515 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0da77-7d10-4df0-b7fb-d031dc72e946 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:24.481573 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 92/183] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Nov 2 07:22:24 2022] GET /identity/v3/projects/83c9c0ecb1ce451abd74d256c2639262 => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:24.487128 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0da77-7d10-4df0-b7fb-d031dc72e946 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:24.528425 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:24.561786 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf465d-9600-4ef6-a5e2-76186118d965 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:24.631461 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:24.637395 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f144b-2537-459f-ab8f-475bc96dd63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:24.638327 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f144b-2537-459f-ab8f-475bc96dd63d None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:24.638327 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f144b-2537-459f-ab8f-475bc96dd63d None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:24.638587 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f144b-2537-459f-ab8f-475bc96dd63d None admin] PATH_INFO: `/v3/projects/83c9c0ecb1ce451abd74d256c2639262` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:24.640016 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f144b-2537-459f-ab8f-475bc96dd63d None admin] RBAC: Authorizing `identity:get_project(project_id=83c9c0ecb1ce451abd74d256c2639262)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:24.641475 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f144b-2537-459f-ab8f-475bc96dd63d None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:24.643307 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 92/184] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Nov 2 07:22:24 2022] GET /identity/v3/projects/83c9c0ecb1ce451abd74d256c2639262 => generated 302 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:24.648824 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f144b-2537-459f-ab8f-475bc96dd63d None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:24.663414 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0da77-7d10-4df0-b7fb-d031dc72e946 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:24.721705 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e813e3d-7897-4ff0-add4-1b4850696712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:24.722828 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e813e3d-7897-4ff0-add4-1b4850696712 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:24.724093 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e813e3d-7897-4ff0-add4-1b4850696712 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:24.724579 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e813e3d-7897-4ff0-add4-1b4850696712 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:24.730052 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e813e3d-7897-4ff0-add4-1b4850696712 None admin] RBAC: Adding query filter params (role.id=9252c356af254127896f3626d925a88a, scope.project.id=83c9c0ecb1ce451abd74d256c2639262, user.id=2b5baaae9a82440b93d675668be2d13d) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:24.730586 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e813e3d-7897-4ff0-add4-1b4850696712 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:24.732825 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e813e3d-7897-4ff0-add4-1b4850696712 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:24.744172 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 93/185] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Nov 2 07:22:24 2022] GET /identity/v3/role_assignments?user.id=2b5baaae9a82440b93d675668be2d13d&scope.project.id=83c9c0ecb1ce451abd74d256c2639262&role.id=9252c356af254127896f3626d925a88a => generated 608 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:24.834492 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f144b-2537-459f-ab8f-475bc96dd63d None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:24.889439 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744aa6c-a394-4b09-96df-1551ae5dd0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:24.890071 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744aa6c-a394-4b09-96df-1551ae5dd0b2 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:24.890343 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744aa6c-a394-4b09-96df-1551ae5dd0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:24.890616 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744aa6c-a394-4b09-96df-1551ae5dd0b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:24.891348 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744aa6c-a394-4b09-96df-1551ae5dd0b2 None admin] RBAC: Adding query filter params (role.id=c2071a72276d475daff2d76d195df6c4, scope.project.id=83c9c0ecb1ce451abd74d256c2639262, user.id=2b5baaae9a82440b93d675668be2d13d) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:24.891650 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744aa6c-a394-4b09-96df-1551ae5dd0b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:24.893128 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744aa6c-a394-4b09-96df-1551ae5dd0b2 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:24.904067 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 93/186] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Nov 2 07:22:24 2022] GET /identity/v3/role_assignments?user.id=2b5baaae9a82440b93d675668be2d13d&scope.project.id=83c9c0ecb1ce451abd74d256c2639262&role.id=c2071a72276d475daff2d76d195df6c4 => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:25.634789 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b72e5a-ba26-45a2-9ddb-fdc20bc19233 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:25.635736 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b72e5a-ba26-45a2-9ddb-fdc20bc19233 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:25.636281 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b72e5a-ba26-45a2-9ddb-fdc20bc19233 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:25.638376 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 94/187] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:25.643736 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e53d5-6114-42d0-be86-b637b6a60ca5 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:25.644149 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e53d5-6114-42d0-be86-b637b6a60ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:25.644308 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e53d5-6114-42d0-be86-b637b6a60ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:25.662957 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-505e53d5-6114-42d0-be86-b637b6a60ca5 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:25.664159 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-505e53d5-6114-42d0-be86-b637b6a60ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:25.674355 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:25.732120 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 94/188] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:25.859824 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7fc5f-6578-41a5-8cd8-4ff5b8f1c368 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:25.860170 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7fc5f-6578-41a5-8cd8-4ff5b8f1c368 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:25.860398 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7fc5f-6578-41a5-8cd8-4ff5b8f1c368 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:25.861894 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 95/189] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:25.866930 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca359c6-672c-45a6-ba3d-b1eee9c9dbb7 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:25.867225 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca359c6-672c-45a6-ba3d-b1eee9c9dbb7 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:25.867500 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca359c6-672c-45a6-ba3d-b1eee9c9dbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:25.886238 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-6ca359c6-672c-45a6-ba3d-b1eee9c9dbb7 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:25.887403 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-6ca359c6-672c-45a6-ba3d-b1eee9c9dbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:25.962991 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 95/190] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:26.009837 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7fc5f-6578-41a5-8cd8-4ff5b8f1c368 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:26.112760 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7fc5f-6578-41a5-8cd8-4ff5b8f1c368 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:26.146961 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b7684-6298-4fd7-b3b6-dc8e450eab8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:26.147517 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b7684-6298-4fd7-b3b6-dc8e450eab8c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:26.147794 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b7684-6298-4fd7-b3b6-dc8e450eab8c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:26.148081 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b7684-6298-4fd7-b3b6-dc8e450eab8c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:26.158278 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b7684-6298-4fd7-b3b6-dc8e450eab8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:26.163233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-a74b7684-6298-4fd7-b3b6-dc8e450eab8c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:22:26.163233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:26.163233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:26.163233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:26.163233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:26.163233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:26.163233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:26.163233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:26.163233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:26.163233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:26.163233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:26.163233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:26.163233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:26.163233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:26.163233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:26.163233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:26.164440 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:26.164440 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:26.164440 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:26.164440 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:26.164440 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:26.164440 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:26.164440 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:26.164440 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:26.164440 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:26.164440 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:26.164440 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:26.164440 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:26.164440 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:26.164440 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:26.164440 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:26.164440 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:26.165233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:26.165233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:26.165233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:26.165233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:26.165233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:26.165233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:26.165233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:26.165233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:26.165233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:26.165233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:26.165233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:22:26.165233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:22:26.165233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 96/191] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:26.172804 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca359c6-672c-45a6-ba3d-b1eee9c9dbb7 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:26.234992 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b7684-6298-4fd7-b3b6-dc8e450eab8c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:26.248588 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:26.251487 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:26.277658 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca359c6-672c-45a6-ba3d-b1eee9c9dbb7 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:26.311730 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282313d3-d40d-480c-bcf7-cd372e983bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:26.312369 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282313d3-d40d-480c-bcf7-cd372e983bf9 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:26.312648 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282313d3-d40d-480c-bcf7-cd372e983bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:26.312920 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282313d3-d40d-480c-bcf7-cd372e983bf9 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:26.313567 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282313d3-d40d-480c-bcf7-cd372e983bf9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:26.313872 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282313d3-d40d-480c-bcf7-cd372e983bf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:26.315268 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282313d3-d40d-480c-bcf7-cd372e983bf9 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:26.323179 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 96/192] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Nov 2 07:22:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:26.324183 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e40364-8f33-4a75-a6f2-26a06f321892 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:26.325012 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e40364-8f33-4a75-a6f2-26a06f321892 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:26.325313 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e40364-8f33-4a75-a6f2-26a06f321892 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:26.326524 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 97/193] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:26.329001 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e40364-8f33-4a75-a6f2-26a06f321892 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:26.340889 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b7684-6298-4fd7-b3b6-dc8e450eab8c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:26.374719 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab839b-5fbc-49d0-b06b-74b72e6890da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:26.375338 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab839b-5fbc-49d0-b06b-74b72e6890da None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:26.375609 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab839b-5fbc-49d0-b06b-74b72e6890da None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:26.375875 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab839b-5fbc-49d0-b06b-74b72e6890da None admin] PATH_INFO: `/v3/domains/default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:26.376977 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab839b-5fbc-49d0-b06b-74b72e6890da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:26.378662 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab839b-5fbc-49d0-b06b-74b72e6890da None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:26.380261 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 97/194] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:26.380261 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726cd6d-7190-4997-9c8e-8f39f7e5bad5 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:26.380261 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726cd6d-7190-4997-9c8e-8f39f7e5bad5 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:26.380261 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726cd6d-7190-4997-9c8e-8f39f7e5bad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:26.400264 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-9726cd6d-7190-4997-9c8e-8f39f7e5bad5 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:26.401507 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9726cd6d-7190-4997-9c8e-8f39f7e5bad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:26.439524 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e40364-8f33-4a75-a6f2-26a06f321892 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:26.466276 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 98/195] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:26.467082 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726cd6d-7190-4997-9c8e-8f39f7e5bad5 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:26.473408 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499bbcd-1d63-4f10-9209-5b4b18956682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:26.474040 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499bbcd-1d63-4f10-9209-5b4b18956682 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:26.474317 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499bbcd-1d63-4f10-9209-5b4b18956682 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:26.474588 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499bbcd-1d63-4f10-9209-5b4b18956682 None admin] PATH_INFO: `/v3/users/4aaa0abc65344c7ea474071e1a14b815` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:26.477074 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:26.477299 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:26.488709 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499bbcd-1d63-4f10-9209-5b4b18956682 None admin] RBAC: Authorizing `identity:get_user(user_id=4aaa0abc65344c7ea474071e1a14b815)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:26.490150 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499bbcd-1d63-4f10-9209-5b4b18956682 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:26.493641 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 98/196] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Nov 2 07:22:26 2022] GET /identity/v3/users/4aaa0abc65344c7ea474071e1a14b815 => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:26.497675 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499bbcd-1d63-4f10-9209-5b4b18956682 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:26.570076 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726cd6d-7190-4997-9c8e-8f39f7e5bad5 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:26.602431 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499bbcd-1d63-4f10-9209-5b4b18956682 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:26.604203 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225d043-70fd-4162-ad3d-5ff8a4caf1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:26.604804 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225d043-70fd-4162-ad3d-5ff8a4caf1d9 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:26.605076 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225d043-70fd-4162-ad3d-5ff8a4caf1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:26.605349 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225d043-70fd-4162-ad3d-5ff8a4caf1d9 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:26.606022 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5225d043-70fd-4162-ad3d-5ff8a4caf1d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:26.607468 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5225d043-70fd-4162-ad3d-5ff8a4caf1d9 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:26.636713 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97443a5-4a69-4af2-a3da-b0a0a12d5918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:26.638049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97443a5-4a69-4af2-a3da-b0a0a12d5918 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:26.638320 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97443a5-4a69-4af2-a3da-b0a0a12d5918 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:26.638594 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97443a5-4a69-4af2-a3da-b0a0a12d5918 None admin] PATH_INFO: `/v3/projects/83c9c0ecb1ce451abd74d256c2639262` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:26.639777 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97443a5-4a69-4af2-a3da-b0a0a12d5918 None admin] RBAC: Authorizing `identity:get_project(project_id=83c9c0ecb1ce451abd74d256c2639262)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:26.641223 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97443a5-4a69-4af2-a3da-b0a0a12d5918 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:26.643142 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 99/197] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Nov 2 07:22:26 2022] GET /identity/v3/projects/83c9c0ecb1ce451abd74d256c2639262 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:26.648340 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97443a5-4a69-4af2-a3da-b0a0a12d5918 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:26.687359 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 99/198] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Nov 2 07:22:26 2022] POST /identity/v3/users => generated 293 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:22:26.719676 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:26.737162 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225d043-70fd-4162-ad3d-5ff8a4caf1d9 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:26.763381 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97443a5-4a69-4af2-a3da-b0a0a12d5918 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:26.803195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a0551-d2df-4ad3-af97-958394326f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:26.804298 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a0551-d2df-4ad3-af97-958394326f59 None admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:26.804769 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a0551-d2df-4ad3-af97-958394326f59 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:26.805239 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a0551-d2df-4ad3-af97-958394326f59 None admin] PATH_INFO: `/v3/projects/83c9c0ecb1ce451abd74d256c2639262/users/4aaa0abc65344c7ea474071e1a14b815/roles/ad30a1e0742545958d34a1672de998c1` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:26.807214 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a0551-d2df-4ad3-af97-958394326f59 None admin] RBAC: Authorizing `identity:create_grant(project_id=83c9c0ecb1ce451abd74d256c2639262, user_id=4aaa0abc65344c7ea474071e1a14b815, role_id=ad30a1e0742545958d34a1672de998c1)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:26.809621 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a0551-d2df-4ad3-af97-958394326f59 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:26.815994 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:26.854751 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225d043-70fd-4162-ad3d-5ff8a4caf1d9 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:26.889791 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8505569-2a60-4530-9846-d6af1b303484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:26.890433 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8505569-2a60-4530-9846-d6af1b303484 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:26.890711 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8505569-2a60-4530-9846-d6af1b303484 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:26.890982 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8505569-2a60-4530-9846-d6af1b303484 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:26.901176 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8505569-2a60-4530-9846-d6af1b303484 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:26.906458 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-d8505569-2a60-4530-9846-d6af1b303484 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:26.906458 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:26.906458 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:26.906458 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:26.906458 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:26.906458 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:26.906458 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:26.906458 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:26.906458 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:26.906458 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:26.906458 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:26.906458 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:26.906458 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:26.906458 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:26.906458 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:26.906458 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:26.907312 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:26.907312 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:26.907312 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:26.907312 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:26.907312 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:26.907312 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:26.907312 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:26.907312 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:26.907312 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:26.907312 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:26.907312 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:26.907312 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:26.907312 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:26.907312 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:26.907312 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:26.907312 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:26.908201 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:26.908201 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:26.908201 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:26.908201 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:26.908201 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:26.908201 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:26.908201 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:26.908201 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:26.908201 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:26.908201 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:26.908201 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:26.908201 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:22:26.908201 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 100/199] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:22:26.914578 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8505569-2a60-4530-9846-d6af1b303484 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:26.915162 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 100/200] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Nov 2 07:22:26 2022] PUT /identity/v3/projects/83c9c0ecb1ce451abd74d256c2639262/users/4aaa0abc65344c7ea474071e1a14b815/roles/ad30a1e0742545958d34a1672de998c1 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:22:27.036910 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8505569-2a60-4530-9846-d6af1b303484 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:27.066013 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:27.078316 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33aa75-9458-443b-8e6f-6985ee693f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:27.078941 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33aa75-9458-443b-8e6f-6985ee693f7c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:27.079214 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33aa75-9458-443b-8e6f-6985ee693f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:27.079483 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33aa75-9458-443b-8e6f-6985ee693f7c None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:27.080239 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c33aa75-9458-443b-8e6f-6985ee693f7c None admin] RBAC: Adding query filter params (name=member) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:27.080478 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c33aa75-9458-443b-8e6f-6985ee693f7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:27.081887 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c33aa75-9458-443b-8e6f-6985ee693f7c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:27.091553 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 101/201] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Nov 2 07:22:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:27.097236 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a0551-d2df-4ad3-af97-958394326f59 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:27.202754 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a0551-d2df-4ad3-af97-958394326f59 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:27.227620 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:27.239343 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76fdab-b40b-404f-9081-6ac64e19af6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:27.240021 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76fdab-b40b-404f-9081-6ac64e19af6e None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:27.240331 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76fdab-b40b-404f-9081-6ac64e19af6e None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:27.240597 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76fdab-b40b-404f-9081-6ac64e19af6e None admin] PATH_INFO: `/v3/users/403c20cf1d4847e8bf711b53bb556fe2` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:27.241744 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76fdab-b40b-404f-9081-6ac64e19af6e None admin] RBAC: Authorizing `identity:get_user(user_id=403c20cf1d4847e8bf711b53bb556fe2)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:27.243184 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76fdab-b40b-404f-9081-6ac64e19af6e None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:27.245017 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 101/202] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Nov 2 07:22:27 2022] GET /identity/v3/users/403c20cf1d4847e8bf711b53bb556fe2 => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:27.250985 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33aa75-9458-443b-8e6f-6985ee693f7c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:27.357506 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33aa75-9458-443b-8e6f-6985ee693f7c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:27.393116 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906539e-aae5-4f49-b85d-c96447692a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:27.393732 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906539e-aae5-4f49-b85d-c96447692a51 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:27.394011 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906539e-aae5-4f49-b85d-c96447692a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:27.394284 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906539e-aae5-4f49-b85d-c96447692a51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:27.451271 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:27.471119 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7906539e-aae5-4f49-b85d-c96447692a51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:27.471119 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7906539e-aae5-4f49-b85d-c96447692a51 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:27.576105 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 102/203] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Nov 2 07:22:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:22:27.584584 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76fdab-b40b-404f-9081-6ac64e19af6e None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:27.687678 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76fdab-b40b-404f-9081-6ac64e19af6e None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:27.723635 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5297b050-ef58-4e77-bf3a-4292ba0e4833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:27.724543 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297b050-ef58-4e77-bf3a-4292ba0e4833 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:27.724999 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297b050-ef58-4e77-bf3a-4292ba0e4833 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:27.725407 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297b050-ef58-4e77-bf3a-4292ba0e4833 None admin] PATH_INFO: `/v3/projects/83c9c0ecb1ce451abd74d256c2639262` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:27.726680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5297b050-ef58-4e77-bf3a-4292ba0e4833 None admin] RBAC: Authorizing `identity:get_project(project_id=83c9c0ecb1ce451abd74d256c2639262)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:27.728293 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5297b050-ef58-4e77-bf3a-4292ba0e4833 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:27.730056 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 102/204] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Nov 2 07:22:27 2022] GET /identity/v3/projects/83c9c0ecb1ce451abd74d256c2639262 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:27.737547 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906539e-aae5-4f49-b85d-c96447692a51 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:27.831042 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:27.847547 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906539e-aae5-4f49-b85d-c96447692a51 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:27.895803 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5364891-1331-489b-ae8f-19461953fcdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:27.896702 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5364891-1331-489b-ae8f-19461953fcdb None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:27.897216 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5364891-1331-489b-ae8f-19461953fcdb None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:27.897624 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5364891-1331-489b-ae8f-19461953fcdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:27.898528 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5364891-1331-489b-ae8f-19461953fcdb None admin] RBAC: Adding query filter params (role.id=c80de80e56e34e6caa3c27dcec321efd, scope.project.id=83c9c0ecb1ce451abd74d256c2639262, user.id=403c20cf1d4847e8bf711b53bb556fe2) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:27.898990 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5364891-1331-489b-ae8f-19461953fcdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:27.900604 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5364891-1331-489b-ae8f-19461953fcdb None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:27.907334 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 103/205] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Nov 2 07:22:27 2022] GET /identity/v3/role_assignments?user.id=403c20cf1d4847e8bf711b53bb556fe2&scope.project.id=83c9c0ecb1ce451abd74d256c2639262&role.id=c80de80e56e34e6caa3c27dcec321efd => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:29.118896 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e248f5b-036b-41ea-bee7-c64e1bbaefe6 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:29.119428 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e248f5b-036b-41ea-bee7-c64e1bbaefe6 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:29.119428 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e248f5b-036b-41ea-bee7-c64e1bbaefe6 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:29.120938 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 103/206] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:29.126057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46053d-5501-43d6-8238-888b8ad911ca None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:29.126460 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46053d-5501-43d6-8238-888b8ad911ca None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:29.126633 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46053d-5501-43d6-8238-888b8ad911ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:29.135375 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e0dc3-64a6-4dde-87e5-3af5c92ebc05 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:29.135655 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e0dc3-64a6-4dde-87e5-3af5c92ebc05 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:29.135926 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e0dc3-64a6-4dde-87e5-3af5c92ebc05 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:29.137932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 104/207] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:22:29.142725 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ece051-ef78-467b-bd1a-645c3a211c47 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:29.143002 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ece051-ef78-467b-bd1a-645c3a211c47 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:29.143271 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ece051-ef78-467b-bd1a-645c3a211c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:29.145838 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-cf46053d-5501-43d6-8238-888b8ad911ca None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:29.147033 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-cf46053d-5501-43d6-8238-888b8ad911ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:29.160617 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-a9ece051-ef78-467b-bd1a-645c3a211c47 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:29.161769 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a9ece051-ef78-467b-bd1a-645c3a211c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:29.213854 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 104/208] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:29.214311 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:29.215136 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92b2a3-4ba4-44e2-96bf-8c1911f625d7 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:29.215392 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92b2a3-4ba4-44e2-96bf-8c1911f625d7 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:29.215573 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92b2a3-4ba4-44e2-96bf-8c1911f625d7 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:29.216858 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 105/209] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:29.222087 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ed0e2-926a-4b80-ab4d-d5f07321a9e2 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:29.222364 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ed0e2-926a-4b80-ab4d-d5f07321a9e2 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:29.222632 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ed0e2-926a-4b80-ab4d-d5f07321a9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:29.230501 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 105/210] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:22:29.241728 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-4c6ed0e2-926a-4b80-ab4d-d5f07321a9e2 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:29.243094 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4c6ed0e2-926a-4b80-ab4d-d5f07321a9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:29.312346 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 106/211] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:22:29.485763 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ece051-ef78-467b-bd1a-645c3a211c47 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:29.501043 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ed0e2-926a-4b80-ab4d-d5f07321a9e2 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:29.513741 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:29.592184 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ece051-ef78-467b-bd1a-645c3a211c47 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:29.609681 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ed0e2-926a-4b80-ab4d-d5f07321a9e2 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:29.626098 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73aabae-d308-419e-a362-0220125c2d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:29.626751 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73aabae-d308-419e-a362-0220125c2d46 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:29.627027 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73aabae-d308-419e-a362-0220125c2d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:29.627295 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73aabae-d308-419e-a362-0220125c2d46 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:29.637238 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73aabae-d308-419e-a362-0220125c2d46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:29.642128 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-c73aabae-d308-419e-a362-0220125c2d46 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:29.642128 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:29.642128 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:29.642128 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:29.642128 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:29.642128 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:29.642128 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:29.642128 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:29.642128 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:29.642128 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:29.642128 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:29.642128 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:29.642128 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:29.642128 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:29.642128 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:29.642128 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:29.643152 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:29.643152 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:29.643152 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:29.643152 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:29.643152 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:29.643152 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:29.643152 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:29.643152 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:29.643152 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:29.643152 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:29.643152 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:29.643152 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:29.643152 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:29.643152 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:29.643152 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:29.643152 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:29.645023 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:29.645023 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:29.645023 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:29.645023 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:29.645023 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:29.645023 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:29.645023 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:29.645023 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:29.645023 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:29.645023 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:29.645023 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:29.645023 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:22:29.645691 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34f4ef-f64c-46a3-9171-9211cf7d8aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:29.645691 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34f4ef-f64c-46a3-9171-9211cf7d8aed None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:29.645691 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34f4ef-f64c-46a3-9171-9211cf7d8aed None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:29.645886 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 106/212] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:29.645950 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34f4ef-f64c-46a3-9171-9211cf7d8aed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:29.646029 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73aabae-d308-419e-a362-0220125c2d46 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:29.656359 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34f4ef-f64c-46a3-9171-9211cf7d8aed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:29.661106 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-cf34f4ef-f64c-46a3-9171-9211cf7d8aed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:22:29.661106 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:29.661106 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:29.661106 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:29.661106 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:29.661106 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:29.661106 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:29.661106 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:29.661106 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:29.661106 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:29.661106 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:29.661106 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:29.661106 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:29.661106 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:29.661106 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:29.661106 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:29.662050 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:29.662050 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:29.662050 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:29.662050 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:29.662050 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:29.662050 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:29.662050 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:29.662050 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:29.662050 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:29.662050 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:29.662050 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:29.662050 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:29.662050 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:29.662050 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:29.662050 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:29.662050 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:29.665074 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:29.665074 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:29.665074 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:29.665074 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:29.665074 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:29.665074 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:29.665074 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:29.665074 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:29.665074 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:29.665074 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:29.665074 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:22:29.665074 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:22:29.665074 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 107/213] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:22:29.665074 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34f4ef-f64c-46a3-9171-9211cf7d8aed None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:29.695698 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:29.731689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:29.744571 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73aabae-d308-419e-a362-0220125c2d46 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:29.761500 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34f4ef-f64c-46a3-9171-9211cf7d8aed None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:29.778712 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437038a6-f4aa-4dd8-8a21-6a71594a1fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:29.779340 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437038a6-f4aa-4dd8-8a21-6a71594a1fff None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:29.779620 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437038a6-f4aa-4dd8-8a21-6a71594a1fff None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:29.779897 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437038a6-f4aa-4dd8-8a21-6a71594a1fff None admin] PATH_INFO: `/v3/domains/default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:29.781028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437038a6-f4aa-4dd8-8a21-6a71594a1fff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:29.782459 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437038a6-f4aa-4dd8-8a21-6a71594a1fff None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:29.784028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 107/214] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:29.784810 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437038a6-f4aa-4dd8-8a21-6a71594a1fff None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:29.797520 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256bf59d-375f-4be7-aba2-4fbb878275e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:29.803435 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bf59d-375f-4be7-aba2-4fbb878275e1 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:29.803435 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bf59d-375f-4be7-aba2-4fbb878275e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:29.803435 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bf59d-375f-4be7-aba2-4fbb878275e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:29.803435 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256bf59d-375f-4be7-aba2-4fbb878275e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:29.803435 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256bf59d-375f-4be7-aba2-4fbb878275e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:29.803435 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256bf59d-375f-4be7-aba2-4fbb878275e1 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:29.809716 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 108/215] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Nov 2 07:22:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:29.810542 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256bf59d-375f-4be7-aba2-4fbb878275e1 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:29.888615 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437038a6-f4aa-4dd8-8a21-6a71594a1fff None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:29.906457 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:29.911838 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256bf59d-375f-4be7-aba2-4fbb878275e1 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:29.927923 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae80914a-4073-4c0b-bc97-6da290bdab59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:29.928636 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80914a-4073-4c0b-bc97-6da290bdab59 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:29.928925 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80914a-4073-4c0b-bc97-6da290bdab59 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:29.929178 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80914a-4073-4c0b-bc97-6da290bdab59 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:29.929830 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae80914a-4073-4c0b-bc97-6da290bdab59 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:29.930126 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae80914a-4073-4c0b-bc97-6da290bdab59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:29.931576 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae80914a-4073-4c0b-bc97-6da290bdab59 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:29.940812 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 108/216] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Nov 2 07:22:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:29.941398 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae80914a-4073-4c0b-bc97-6da290bdab59 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:29.950143 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:29.955013 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354296d1-249f-4d98-8fdd-33887ce0ae7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:29.955586 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354296d1-249f-4d98-8fdd-33887ce0ae7d None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:29.955860 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354296d1-249f-4d98-8fdd-33887ce0ae7d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:29.956160 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354296d1-249f-4d98-8fdd-33887ce0ae7d None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:29.956814 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354296d1-249f-4d98-8fdd-33887ce0ae7d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:29.959022 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354296d1-249f-4d98-8fdd-33887ce0ae7d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:30.040164 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 109/217] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Nov 2 07:22:29 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:22:30.040164 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354296d1-249f-4d98-8fdd-33887ce0ae7d None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:30.040443 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae80914a-4073-4c0b-bc97-6da290bdab59 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:30.081321 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da3bf9-6e88-4f82-9cff-35f2fb4480ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:30.082006 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da3bf9-6e88-4f82-9cff-35f2fb4480ab None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:30.082267 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da3bf9-6e88-4f82-9cff-35f2fb4480ab None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:30.082540 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da3bf9-6e88-4f82-9cff-35f2fb4480ab None admin] PATH_INFO: `/v3/users/17ac13fcf3704f0faf3369bc3f8c34d9` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:30.100237 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da3bf9-6e88-4f82-9cff-35f2fb4480ab None admin] RBAC: Authorizing `identity:get_user(user_id=17ac13fcf3704f0faf3369bc3f8c34d9)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:30.101788 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da3bf9-6e88-4f82-9cff-35f2fb4480ab None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:30.103739 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 109/218] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Nov 2 07:22:29 2022] GET /identity/v3/users/17ac13fcf3704f0faf3369bc3f8c34d9 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:30.110251 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da3bf9-6e88-4f82-9cff-35f2fb4480ab None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:30.147598 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:30.162070 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354296d1-249f-4d98-8fdd-33887ce0ae7d None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:30.197686 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3159bc-8a12-43e7-b279-fee4f280a0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:30.198321 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3159bc-8a12-43e7-b279-fee4f280a0bb None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:30.198601 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3159bc-8a12-43e7-b279-fee4f280a0bb None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:30.198871 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3159bc-8a12-43e7-b279-fee4f280a0bb None admin] PATH_INFO: `/v3/users/4aaa0abc65344c7ea474071e1a14b815` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:30.200633 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3159bc-8a12-43e7-b279-fee4f280a0bb None admin] RBAC: Authorizing `identity:get_user(user_id=4aaa0abc65344c7ea474071e1a14b815)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:30.202084 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3159bc-8a12-43e7-b279-fee4f280a0bb None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:30.203699 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 110/219] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Nov 2 07:22:30 2022] GET /identity/v3/users/4aaa0abc65344c7ea474071e1a14b815 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:30.209243 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3159bc-8a12-43e7-b279-fee4f280a0bb None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:30.231341 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da3bf9-6e88-4f82-9cff-35f2fb4480ab None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:30.276193 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:30.279649 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c45277-2e5d-414b-8223-75cfa2f03bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:30.280303 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c45277-2e5d-414b-8223-75cfa2f03bc4 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:30.280578 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c45277-2e5d-414b-8223-75cfa2f03bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:30.280845 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c45277-2e5d-414b-8223-75cfa2f03bc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:30.281558 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c45277-2e5d-414b-8223-75cfa2f03bc4 None admin] RBAC: Adding query filter params (role.id=c80de80e56e34e6caa3c27dcec321efd, user.id=17ac13fcf3704f0faf3369bc3f8c34d9, scope.system=all) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:30.281857 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c45277-2e5d-414b-8223-75cfa2f03bc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:30.283275 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c45277-2e5d-414b-8223-75cfa2f03bc4 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:30.288468 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 110/220] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Nov 2 07:22:30 2022] GET /identity/v3/role_assignments?user.id=17ac13fcf3704f0faf3369bc3f8c34d9&scope.system=all&role.id=c80de80e56e34e6caa3c27dcec321efd => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:30.328828 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3159bc-8a12-43e7-b279-fee4f280a0bb None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:30.368588 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84962f10-299c-441f-be59-fb46baf30073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:30.369561 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84962f10-299c-441f-be59-fb46baf30073 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:30.369844 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84962f10-299c-441f-be59-fb46baf30073 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:30.370123 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84962f10-299c-441f-be59-fb46baf30073 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:30.459185 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84962f10-299c-441f-be59-fb46baf30073 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:30.460722 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84962f10-299c-441f-be59-fb46baf30073 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:30.521880 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:30.566657 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 111/221] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Nov 2 07:22:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Nov 02 07:22:30.572257 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c45277-2e5d-414b-8223-75cfa2f03bc4 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:30.671459 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:30.678262 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c45277-2e5d-414b-8223-75cfa2f03bc4 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:30.712961 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81255f-96b0-49ae-b81a-46f553a5f43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:30.713592 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81255f-96b0-49ae-b81a-46f553a5f43d None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:30.713864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81255f-96b0-49ae-b81a-46f553a5f43d None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:30.714132 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81255f-96b0-49ae-b81a-46f553a5f43d None admin] PATH_INFO: `/v3/projects/83c9c0ecb1ce451abd74d256c2639262` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:30.715476 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c81255f-96b0-49ae-b81a-46f553a5f43d None admin] RBAC: Authorizing `identity:get_project(project_id=83c9c0ecb1ce451abd74d256c2639262)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:30.716932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c81255f-96b0-49ae-b81a-46f553a5f43d None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:30.718722 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 111/222] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Nov 2 07:22:30 2022] GET /identity/v3/projects/83c9c0ecb1ce451abd74d256c2639262 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:30.724381 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84962f10-299c-441f-be59-fb46baf30073 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:30.831105 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84962f10-299c-441f-be59-fb46baf30073 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:30.932098 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a011c12-a642-4d4e-b85d-6576ffa34a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:30.932642 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a011c12-a642-4d4e-b85d-6576ffa34a12 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:30.932918 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a011c12-a642-4d4e-b85d-6576ffa34a12 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:30.933187 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a011c12-a642-4d4e-b85d-6576ffa34a12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:30.934472 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a011c12-a642-4d4e-b85d-6576ffa34a12 None admin] RBAC: Adding query filter params (role.id=ad30a1e0742545958d34a1672de998c1, scope.project.id=83c9c0ecb1ce451abd74d256c2639262, user.id=4aaa0abc65344c7ea474071e1a14b815) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:30.934763 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a011c12-a642-4d4e-b85d-6576ffa34a12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:30.936303 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a011c12-a642-4d4e-b85d-6576ffa34a12 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:30.943148 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 112/223] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Nov 2 07:22:30 2022] GET /identity/v3/role_assignments?user.id=4aaa0abc65344c7ea474071e1a14b815&scope.project.id=83c9c0ecb1ce451abd74d256c2639262&role.id=ad30a1e0742545958d34a1672de998c1 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:32.372012 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa407990-1be4-4c36-9212-3de153a1abf9 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:32.372568 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa407990-1be4-4c36-9212-3de153a1abf9 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:32.372568 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa407990-1be4-4c36-9212-3de153a1abf9 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:32.374047 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 112/224] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:32.379526 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1655036-e084-48d4-9019-3a7170c3b655 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:32.379933 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1655036-e084-48d4-9019-3a7170c3b655 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:32.380165 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1655036-e084-48d4-9019-3a7170c3b655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:32.399643 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-c1655036-e084-48d4-9019-3a7170c3b655 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:32.400910 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c1655036-e084-48d4-9019-3a7170c3b655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:32.417938 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:32.485849 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 113/225] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:32.510992 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a56ff-b61d-4258-a6f3-f8c2592df477 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:32.511266 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a56ff-b61d-4258-a6f3-f8c2592df477 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:32.511542 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a56ff-b61d-4258-a6f3-f8c2592df477 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:32.513840 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 113/226] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:32.518850 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d76f3f-df1e-4dd8-ba6d-5961caab66af None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:32.519135 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d76f3f-df1e-4dd8-ba6d-5961caab66af None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:32.519409 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d76f3f-df1e-4dd8-ba6d-5961caab66af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:32.537208 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-45d76f3f-df1e-4dd8-ba6d-5961caab66af None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:32.538379 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-45d76f3f-df1e-4dd8-ba6d-5961caab66af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:32.559342 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ede908-b7de-4332-aec7-4701b9bf5270 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:32.559804 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ede908-b7de-4332-aec7-4701b9bf5270 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:32.560506 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ede908-b7de-4332-aec7-4701b9bf5270 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:32.562168 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 114/227] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:22:32.567138 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b34519-058f-4fd5-9d96-0393708512ac None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:32.567812 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b34519-058f-4fd5-9d96-0393708512ac None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:32.568201 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b34519-058f-4fd5-9d96-0393708512ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:32.588793 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-48b34519-058f-4fd5-9d96-0393708512ac None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:32.590900 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-48b34519-058f-4fd5-9d96-0393708512ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:32.611074 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 114/228] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:32.658807 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 115/229] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:22:32.755732 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d76f3f-df1e-4dd8-ba6d-5961caab66af None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:32.879642 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:32.880317 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b34519-058f-4fd5-9d96-0393708512ac None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:32.902010 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d76f3f-df1e-4dd8-ba6d-5961caab66af None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:32.938138 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40483772-a203-4652-841d-6bb4720c8176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:32.938689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40483772-a203-4652-841d-6bb4720c8176 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:32.938967 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40483772-a203-4652-841d-6bb4720c8176 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:32.939226 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40483772-a203-4652-841d-6bb4720c8176 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:32.950468 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40483772-a203-4652-841d-6bb4720c8176 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:32.955190 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-40483772-a203-4652-841d-6bb4720c8176 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:22:32.955190 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:32.955190 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:32.955190 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:32.955190 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:32.955190 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:32.955190 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:32.955190 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:32.955190 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:32.955190 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:32.955190 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:32.955190 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:32.955190 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:32.955190 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:32.955190 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:32.955190 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:32.956348 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:32.956348 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:32.956348 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:32.956348 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:32.956348 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:32.956348 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:32.956348 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:32.956348 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:32.956348 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:32.956348 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:32.956348 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:32.956348 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:32.956348 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:32.956348 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:32.956348 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:32.956348 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:32.957149 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:32.957149 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:32.957149 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:32.957149 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:32.957149 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:32.957149 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:32.957149 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:32.957149 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:32.957149 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:32.957149 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:32.957149 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:22:32.957149 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:22:32.957149 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 115/230] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:32.957798 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40483772-a203-4652-841d-6bb4720c8176 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:32.982921 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:32.986500 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b34519-058f-4fd5-9d96-0393708512ac None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:33.020809 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7e0b6-c63a-4a04-8f76-87dd25f5ff6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:33.021681 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7e0b6-c63a-4a04-8f76-87dd25f5ff6c None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:33.021959 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7e0b6-c63a-4a04-8f76-87dd25f5ff6c None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:33.022226 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7e0b6-c63a-4a04-8f76-87dd25f5ff6c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:33.023307 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7e0b6-c63a-4a04-8f76-87dd25f5ff6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:33.024777 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7e0b6-c63a-4a04-8f76-87dd25f5ff6c None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:33.026330 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 116/231] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:33.031519 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7e0b6-c63a-4a04-8f76-87dd25f5ff6c None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:33.056698 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40483772-a203-4652-841d-6bb4720c8176 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:33.089499 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc889d-2194-4507-a290-b817e7f61bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:33.090687 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc889d-2194-4507-a290-b817e7f61bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:33.090964 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc889d-2194-4507-a290-b817e7f61bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:33.091229 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc889d-2194-4507-a290-b817e7f61bd6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:33.098835 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:33.101922 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc889d-2194-4507-a290-b817e7f61bd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:33.106977 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-c7fc889d-2194-4507-a290-b817e7f61bd6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:33.106977 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:33.106977 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:33.106977 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:33.106977 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:33.106977 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:33.106977 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:33.106977 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:33.106977 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:33.106977 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:33.106977 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:33.106977 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:33.106977 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:33.106977 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:33.106977 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:33.106977 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:33.107848 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:33.107848 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:33.107848 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:33.107848 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:33.107848 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:33.107848 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:33.107848 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:33.107848 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:33.107848 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:33.107848 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:33.107848 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:33.107848 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:33.107848 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:33.107848 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:33.107848 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:33.107848 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:33.108727 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:33.108727 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:33.108727 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:33.108727 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:33.108727 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:33.108727 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:33.108727 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:33.108727 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:33.108727 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:33.108727 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:33.108727 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:33.108727 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:22:33.108727 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 116/232] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:33.109384 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc889d-2194-4507-a290-b817e7f61bd6 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:33.129996 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7e0b6-c63a-4a04-8f76-87dd25f5ff6c None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:33.163815 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea084fc-f04b-4826-b0a6-8c9b82dfd502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:33.164473 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea084fc-f04b-4826-b0a6-8c9b82dfd502 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:33.164737 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea084fc-f04b-4826-b0a6-8c9b82dfd502 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:33.165004 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea084fc-f04b-4826-b0a6-8c9b82dfd502 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:33.168956 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea084fc-f04b-4826-b0a6-8c9b82dfd502 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:33.168956 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea084fc-f04b-4826-b0a6-8c9b82dfd502 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:33.168956 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea084fc-f04b-4826-b0a6-8c9b82dfd502 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:33.175087 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 117/233] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Nov 2 07:22:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:33.175862 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea084fc-f04b-4826-b0a6-8c9b82dfd502 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:33.203653 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:33.209697 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc889d-2194-4507-a290-b817e7f61bd6 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:33.244319 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c8661-50ad-458b-a4b1-fc0b9f306678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:33.244929 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c8661-50ad-458b-a4b1-fc0b9f306678 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:33.245205 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c8661-50ad-458b-a4b1-fc0b9f306678 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:33.245474 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c8661-50ad-458b-a4b1-fc0b9f306678 None admin] PATH_INFO: `/v3/groups` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:33.246093 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c8661-50ad-458b-a4b1-fc0b9f306678 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:33.247547 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c8661-50ad-458b-a4b1-fc0b9f306678 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:33.272868 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea084fc-f04b-4826-b0a6-8c9b82dfd502 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:33.305210 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d79616-3210-4a77-8989-a8e96b45cc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:33.305800 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d79616-3210-4a77-8989-a8e96b45cc5d None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:33.306075 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d79616-3210-4a77-8989-a8e96b45cc5d None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:33.306349 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d79616-3210-4a77-8989-a8e96b45cc5d None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:33.306987 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d79616-3210-4a77-8989-a8e96b45cc5d None admin] RBAC: Adding query filter params (name=member) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:33.307286 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d79616-3210-4a77-8989-a8e96b45cc5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:33.308691 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d79616-3210-4a77-8989-a8e96b45cc5d None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:33.314627 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 117/234] 10.222.0.16 () {60 vars in 1134 bytes} [Wed Nov 2 07:22:33 2022] POST /identity/v3/groups => generated 229 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:22:33.321777 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 118/235] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Nov 2 07:22:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:33.321973 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c8661-50ad-458b-a4b1-fc0b9f306678 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:33.325020 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d79616-3210-4a77-8989-a8e96b45cc5d None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:33.389714 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:33.440084 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:33.442486 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c8661-50ad-458b-a4b1-fc0b9f306678 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:33.450224 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d79616-3210-4a77-8989-a8e96b45cc5d None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:33.487637 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd57276-1d4a-4479-8cc9-311e45865bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:33.488236 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd57276-1d4a-4479-8cc9-311e45865bf9 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:33.488518 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd57276-1d4a-4479-8cc9-311e45865bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:33.488792 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd57276-1d4a-4479-8cc9-311e45865bf9 None admin] PATH_INFO: `/v3/users/5b389bd147db4a698c2b7cc672930fd7` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:33.492609 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d703e-b190-4c5c-9194-2255dfc3e297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:33.493254 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d703e-b190-4c5c-9194-2255dfc3e297 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:33.493535 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d703e-b190-4c5c-9194-2255dfc3e297 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:33.493806 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d703e-b190-4c5c-9194-2255dfc3e297 None admin] PATH_INFO: `/v3/users/17ac13fcf3704f0faf3369bc3f8c34d9` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:33.494954 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d703e-b190-4c5c-9194-2255dfc3e297 None admin] RBAC: Authorizing `identity:get_user(user_id=17ac13fcf3704f0faf3369bc3f8c34d9)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:33.496453 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d703e-b190-4c5c-9194-2255dfc3e297 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:33.498282 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 119/236] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Nov 2 07:22:33 2022] GET /identity/v3/users/17ac13fcf3704f0faf3369bc3f8c34d9 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:33.503854 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d703e-b190-4c5c-9194-2255dfc3e297 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:33.504082 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd57276-1d4a-4479-8cc9-311e45865bf9 None admin] RBAC: Authorizing `identity:get_user(user_id=5b389bd147db4a698c2b7cc672930fd7)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:33.506045 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd57276-1d4a-4479-8cc9-311e45865bf9 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:33.507383 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 118/237] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Nov 2 07:22:33 2022] GET /identity/v3/users/5b389bd147db4a698c2b7cc672930fd7 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:33.513416 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd57276-1d4a-4479-8cc9-311e45865bf9 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:33.614570 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d703e-b190-4c5c-9194-2255dfc3e297 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:33.635476 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd57276-1d4a-4479-8cc9-311e45865bf9 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:33.650765 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d5039-bd40-471e-a7c9-3c751c98f921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:33.651414 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d5039-bd40-471e-a7c9-3c751c98f921 None admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:33.651690 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d5039-bd40-471e-a7c9-3c751c98f921 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:33.651957 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d5039-bd40-471e-a7c9-3c751c98f921 None admin] PATH_INFO: `/v3/system/users/17ac13fcf3704f0faf3369bc3f8c34d9/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:33.654030 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d5039-bd40-471e-a7c9-3c751c98f921 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=17ac13fcf3704f0faf3369bc3f8c34d9, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:33.655392 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d5039-bd40-471e-a7c9-3c751c98f921 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:33.655778 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:33.672499 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f419ee-4988-4e15-92af-e9b34c772656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:33.673099 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f419ee-4988-4e15-92af-e9b34c772656 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:33.673374 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f419ee-4988-4e15-92af-e9b34c772656 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:33.673644 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f419ee-4988-4e15-92af-e9b34c772656 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:33.674354 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f419ee-4988-4e15-92af-e9b34c772656 None admin] RBAC: Adding query filter params (role.id=ad30a1e0742545958d34a1672de998c1, user.id=5b389bd147db4a698c2b7cc672930fd7, scope.system=all) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:33.674657 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f419ee-4988-4e15-92af-e9b34c772656 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:33.676166 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f419ee-4988-4e15-92af-e9b34c772656 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:33.680977 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 119/238] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Nov 2 07:22:33 2022] GET /identity/v3/role_assignments?user.id=5b389bd147db4a698c2b7cc672930fd7&scope.system=all&role.id=ad30a1e0742545958d34a1672de998c1 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:33.731808 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 120/239] 10.222.0.16 () {58 vars in 1334 bytes} [Wed Nov 2 07:22:33 2022] PUT /identity/v3/system/users/17ac13fcf3704f0faf3369bc3f8c34d9/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:22:35.512204 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978fd33-d2c9-4cc8-9338-d507bb92ec4b None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:35.512751 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978fd33-d2c9-4cc8-9338-d507bb92ec4b None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:35.512751 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978fd33-d2c9-4cc8-9338-d507bb92ec4b None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:35.514252 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 120/240] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:35.519250 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d5e5b-57e1-4661-b01f-ed75264d5285 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:35.519627 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d5e5b-57e1-4661-b01f-ed75264d5285 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:35.519792 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d5e5b-57e1-4661-b01f-ed75264d5285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:35.538352 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-6e5d5e5b-57e1-4661-b01f-ed75264d5285 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:35.539536 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-6e5d5e5b-57e1-4661-b01f-ed75264d5285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:35.556942 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:35.608365 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 121/241] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:35.877181 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978fd33-d2c9-4cc8-9338-d507bb92ec4b None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:35.905606 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aba624-c1c3-4079-9d73-704a6a7feb9d None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:35.905861 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aba624-c1c3-4079-9d73-704a6a7feb9d None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:35.906136 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aba624-c1c3-4079-9d73-704a6a7feb9d None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:35.907632 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 122/242] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:22:35.912737 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26711d05-5a18-4319-a955-f0361c1ecdde None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:35.913011 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26711d05-5a18-4319-a955-f0361c1ecdde None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:35.913281 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26711d05-5a18-4319-a955-f0361c1ecdde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:35.936312 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-26711d05-5a18-4319-a955-f0361c1ecdde None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:35.937668 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-26711d05-5a18-4319-a955-f0361c1ecdde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:35.989115 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978fd33-d2c9-4cc8-9338-d507bb92ec4b None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:36.009504 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 123/243] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:22:36.010796 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13476d69-95d2-410f-b4e9-72a3fb0dc8b2 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:36.011076 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13476d69-95d2-410f-b4e9-72a3fb0dc8b2 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:36.011342 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13476d69-95d2-410f-b4e9-72a3fb0dc8b2 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:36.016224 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 124/244] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:36.018092 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fbcf33-0a9d-4877-b098-b857fd59ae3b None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:36.018515 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fbcf33-0a9d-4877-b098-b857fd59ae3b None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:36.019032 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fbcf33-0a9d-4877-b098-b857fd59ae3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:36.027141 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222323fa-d621-4206-8ea0-506c085531b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:36.027978 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222323fa-d621-4206-8ea0-506c085531b5 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:36.028453 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222323fa-d621-4206-8ea0-506c085531b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:36.028872 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222323fa-d621-4206-8ea0-506c085531b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:36.030008 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222323fa-d621-4206-8ea0-506c085531b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:36.031445 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222323fa-d621-4206-8ea0-506c085531b5 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:36.033041 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 121/245] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:36.038378 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222323fa-d621-4206-8ea0-506c085531b5 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:36.039992 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-48fbcf33-0a9d-4877-b098-b857fd59ae3b None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:36.041507 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-48fbcf33-0a9d-4877-b098-b857fd59ae3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:36.090697 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:36.119213 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 125/246] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:36.149942 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222323fa-d621-4206-8ea0-506c085531b5 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:36.183971 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217ebba-ea5c-4728-9aeb-1d889ecd7941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:36.184767 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217ebba-ea5c-4728-9aeb-1d889ecd7941 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:36.185047 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217ebba-ea5c-4728-9aeb-1d889ecd7941 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:36.185316 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217ebba-ea5c-4728-9aeb-1d889ecd7941 None admin] PATH_INFO: `/v3/groups` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:36.185932 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217ebba-ea5c-4728-9aeb-1d889ecd7941 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:36.187362 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217ebba-ea5c-4728-9aeb-1d889ecd7941 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:36.274262 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 122/247] 10.222.0.16 () {60 vars in 1134 bytes} [Wed Nov 2 07:22:36 2022] POST /identity/v3/groups => generated 226 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:22:36.281503 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fbcf33-0a9d-4877-b098-b857fd59ae3b None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:36.298039 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:36.394694 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fbcf33-0a9d-4877-b098-b857fd59ae3b None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:36.395516 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217ebba-ea5c-4728-9aeb-1d889ecd7941 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:36.434407 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724fe4c-7b62-4d0d-9dcb-5a48cae5f63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:36.435119 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724fe4c-7b62-4d0d-9dcb-5a48cae5f63a None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:36.435401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724fe4c-7b62-4d0d-9dcb-5a48cae5f63a None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:36.435674 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724fe4c-7b62-4d0d-9dcb-5a48cae5f63a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:36.446953 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c724fe4c-7b62-4d0d-9dcb-5a48cae5f63a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:36.452507 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-c724fe4c-7b62-4d0d-9dcb-5a48cae5f63a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:36.452507 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:36.452507 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:36.452507 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:36.452507 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:36.452507 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:36.452507 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:36.452507 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:36.452507 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:36.452507 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:36.452507 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:36.452507 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:36.452507 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:36.452507 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:36.452507 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:36.452507 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:36.453385 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:36.453385 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:36.453385 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:36.453385 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:36.453385 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:36.453385 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:36.453385 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:36.453385 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:36.453385 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:36.453385 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:36.453385 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:36.453385 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:36.453385 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:36.453385 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:36.453385 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:36.453385 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:36.454187 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:36.454187 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:36.454187 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:36.454187 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:36.454187 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:36.454187 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:36.454187 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:36.454187 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:36.454187 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:36.454187 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:36.454187 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:36.454187 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:22:36.454187 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 126/248] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:36.460017 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724fe4c-7b62-4d0d-9dcb-5a48cae5f63a None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:36.519636 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217ebba-ea5c-4728-9aeb-1d889ecd7941 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:36.530972 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:36.546695 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:36.558067 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b9842-7db2-4a5e-8903-1c9c814c9c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:36.558570 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b9842-7db2-4a5e-8903-1c9c814c9c51 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:36.559459 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b9842-7db2-4a5e-8903-1c9c814c9c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:36.559731 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b9842-7db2-4a5e-8903-1c9c814c9c51 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:36.574725 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b9842-7db2-4a5e-8903-1c9c814c9c51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:36.579550 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-7a3b9842-7db2-4a5e-8903-1c9c814c9c51 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:22:36.579550 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:36.579550 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:36.579550 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:36.579550 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:36.579550 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:36.579550 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:36.579550 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:36.579550 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:36.579550 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:36.579550 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:36.579550 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:36.579550 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:36.579550 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:36.579550 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:36.579550 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:36.581401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:36.581401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:36.581401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:36.581401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:36.581401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:36.581401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:36.581401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:36.581401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:36.581401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:36.581401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:36.581401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:36.581401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:36.581401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:36.581401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:36.581401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:36.581401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:36.582274 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:36.582274 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:36.582274 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:36.582274 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:36.582274 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:36.582274 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:36.582274 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:36.582274 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:36.582274 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:36.582274 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:36.582274 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:22:36.582274 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:22:36.582274 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 123/249] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:36.585068 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724fe4c-7b62-4d0d-9dcb-5a48cae5f63a None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:36.586668 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b9842-7db2-4a5e-8903-1c9c814c9c51 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:36.625582 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a04758-254b-43a6-9648-dbb2548eb4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:36.626367 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a04758-254b-43a6-9648-dbb2548eb4cc None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:36.626752 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a04758-254b-43a6-9648-dbb2548eb4cc None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:36.627118 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a04758-254b-43a6-9648-dbb2548eb4cc None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:36.627876 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a04758-254b-43a6-9648-dbb2548eb4cc None admin] RBAC: Adding query filter params (name=member) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:36.628320 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a04758-254b-43a6-9648-dbb2548eb4cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:36.630053 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a04758-254b-43a6-9648-dbb2548eb4cc None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:36.642128 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 127/250] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Nov 2 07:22:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:36.648071 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a04758-254b-43a6-9648-dbb2548eb4cc None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:36.709898 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b9842-7db2-4a5e-8903-1c9c814c9c51 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:36.748994 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22feec92-897b-4ed1-98c1-d8a21278d445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:36.749608 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22feec92-897b-4ed1-98c1-d8a21278d445 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:36.749883 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22feec92-897b-4ed1-98c1-d8a21278d445 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:36.750152 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22feec92-897b-4ed1-98c1-d8a21278d445 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:36.750881 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22feec92-897b-4ed1-98c1-d8a21278d445 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:36.751183 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22feec92-897b-4ed1-98c1-d8a21278d445 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:36.752607 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22feec92-897b-4ed1-98c1-d8a21278d445 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:36.765534 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 124/251] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Nov 2 07:22:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:36.771234 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22feec92-897b-4ed1-98c1-d8a21278d445 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:36.784744 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a04758-254b-43a6-9648-dbb2548eb4cc None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:36.814920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:36.830242 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f9e51-0afd-4064-8583-5a846f829001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:36.830880 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f9e51-0afd-4064-8583-5a846f829001 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:36.831153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f9e51-0afd-4064-8583-5a846f829001 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:36.831421 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f9e51-0afd-4064-8583-5a846f829001 None admin] PATH_INFO: `/v3/users/17ac13fcf3704f0faf3369bc3f8c34d9` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:36.832715 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f9e51-0afd-4064-8583-5a846f829001 None admin] RBAC: Authorizing `identity:get_user(user_id=17ac13fcf3704f0faf3369bc3f8c34d9)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:36.834141 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f9e51-0afd-4064-8583-5a846f829001 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:36.839332 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 128/252] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Nov 2 07:22:36 2022] GET /identity/v3/users/17ac13fcf3704f0faf3369bc3f8c34d9 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:36.842942 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f9e51-0afd-4064-8583-5a846f829001 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:36.845958 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:36.912670 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22feec92-897b-4ed1-98c1-d8a21278d445 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:36.960560 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2693d46-4480-474b-92dc-4414cf6847cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:36.961411 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2693d46-4480-474b-92dc-4414cf6847cd None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:36.961696 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2693d46-4480-474b-92dc-4414cf6847cd None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:36.961977 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2693d46-4480-474b-92dc-4414cf6847cd None admin] PATH_INFO: `/v3/users/5b389bd147db4a698c2b7cc672930fd7` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:36.963769 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2693d46-4480-474b-92dc-4414cf6847cd None admin] RBAC: Authorizing `identity:get_user(user_id=5b389bd147db4a698c2b7cc672930fd7)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:36.965844 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2693d46-4480-474b-92dc-4414cf6847cd None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:36.967470 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 125/253] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Nov 2 07:22:36 2022] GET /identity/v3/users/5b389bd147db4a698c2b7cc672930fd7 => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:36.975820 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2693d46-4480-474b-92dc-4414cf6847cd None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:36.986558 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f9e51-0afd-4064-8583-5a846f829001 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:37.026784 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9a5a9-58bb-4546-912e-4d710f966c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:37.027389 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9a5a9-58bb-4546-912e-4d710f966c44 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:37.028239 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9a5a9-58bb-4546-912e-4d710f966c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:37.028515 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9a5a9-58bb-4546-912e-4d710f966c44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:37.029240 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a9a5a9-58bb-4546-912e-4d710f966c44 None admin] RBAC: Adding query filter params (role.id=c80de80e56e34e6caa3c27dcec321efd, user.id=17ac13fcf3704f0faf3369bc3f8c34d9, scope.system=all) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:37.029547 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a9a5a9-58bb-4546-912e-4d710f966c44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:37.031697 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a9a5a9-58bb-4546-912e-4d710f966c44 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:37.050801 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 129/254] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Nov 2 07:22:36 2022] GET /identity/v3/role_assignments?user.id=17ac13fcf3704f0faf3369bc3f8c34d9&scope.system=all&role.id=c80de80e56e34e6caa3c27dcec321efd => generated 510 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:37.116269 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2693d46-4480-474b-92dc-4414cf6847cd None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:37.123082 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:37.161825 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16358c21-7c60-420d-8575-c69d69b5f99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:37.162550 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16358c21-7c60-420d-8575-c69d69b5f99c None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:37.162835 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16358c21-7c60-420d-8575-c69d69b5f99c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:37.163107 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16358c21-7c60-420d-8575-c69d69b5f99c None admin] PATH_INFO: `/v3/system/users/5b389bd147db4a698c2b7cc672930fd7/roles/ad30a1e0742545958d34a1672de998c1` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:37.164581 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16358c21-7c60-420d-8575-c69d69b5f99c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5b389bd147db4a698c2b7cc672930fd7, role_id=ad30a1e0742545958d34a1672de998c1)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:37.166094 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16358c21-7c60-420d-8575-c69d69b5f99c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:37.241372 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 126/255] 10.222.0.16 () {58 vars in 1334 bytes} [Wed Nov 2 07:22:36 2022] PUT /identity/v3/system/users/5b389bd147db4a698c2b7cc672930fd7/roles/ad30a1e0742545958d34a1672de998c1 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:22:39.366693 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589470b-3bde-404a-b098-a9d8a18cce8e None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:39.367200 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589470b-3bde-404a-b098-a9d8a18cce8e None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:39.367275 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589470b-3bde-404a-b098-a9d8a18cce8e None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:39.368781 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 130/256] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:39.381805 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db01a9-f874-4101-a1fa-1e2e127a6683 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:39.382280 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db01a9-f874-4101-a1fa-1e2e127a6683 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:39.382353 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db01a9-f874-4101-a1fa-1e2e127a6683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:39.405021 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-48db01a9-f874-4101-a1fa-1e2e127a6683 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:39.406234 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-48db01a9-f874-4101-a1fa-1e2e127a6683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:39.413803 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82a0f5-d041-4f4c-b93e-46deb964687b None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:39.414088 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82a0f5-d041-4f4c-b93e-46deb964687b None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:39.414367 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82a0f5-d041-4f4c-b93e-46deb964687b None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:39.415704 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 131/257] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:22:39.421310 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4bad9-4b6b-4ea2-b23e-88cc896b49c4 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:39.421591 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4bad9-4b6b-4ea2-b23e-88cc896b49c4 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:39.421864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4bad9-4b6b-4ea2-b23e-88cc896b49c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:39.452985 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-bbc4bad9-4b6b-4ea2-b23e-88cc896b49c4 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:39.454193 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-bbc4bad9-4b6b-4ea2-b23e-88cc896b49c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:39.502119 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 127/258] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 02 07:22:39.556756 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 132/259] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 07:22:39.894121 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402403c5-b437-4f34-96b7-09845cd1c107 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:39.894534 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402403c5-b437-4f34-96b7-09845cd1c107 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:39.894655 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402403c5-b437-4f34-96b7-09845cd1c107 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:39.896229 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 128/260] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:39.902136 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa1bf5-3535-48f7-b218-2b138a4fd83b None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:39.902418 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa1bf5-3535-48f7-b218-2b138a4fd83b None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:39.903221 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa1bf5-3535-48f7-b218-2b138a4fd83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:39.919689 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:39.929050 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-e4aa1bf5-3535-48f7-b218-2b138a4fd83b None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:39.930247 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e4aa1bf5-3535-48f7-b218-2b138a4fd83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:39.938996 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 133/261] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 07:22:40.063797 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402403c5-b437-4f34-96b7-09845cd1c107 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:40.082088 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402403c5-b437-4f34-96b7-09845cd1c107 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:40.086532 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ddd82-315b-44f8-a801-a0303fbd3190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:40.087149 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ddd82-315b-44f8-a801-a0303fbd3190 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:40.087422 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ddd82-315b-44f8-a801-a0303fbd3190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:40.087691 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ddd82-315b-44f8-a801-a0303fbd3190 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:40.099293 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ddd82-315b-44f8-a801-a0303fbd3190 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:40.104296 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-0f6ddd82-315b-44f8-a801-a0303fbd3190 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:40.104296 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:40.104296 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:40.104296 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:40.104296 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:40.104296 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:40.104296 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:40.104296 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:40.104296 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:40.104296 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:40.104296 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:40.104296 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:40.104296 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:40.104296 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:40.104296 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:40.104296 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:40.105164 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:40.105164 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:40.105164 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:40.105164 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:40.105164 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:40.105164 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:40.105164 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:40.105164 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:40.105164 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:40.105164 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:40.105164 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:40.105164 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:40.105164 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:40.105164 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:40.105164 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:40.105164 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:40.106111 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:40.106111 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:40.106111 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:40.106111 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:40.106111 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:40.106111 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:40.106111 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:40.106111 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:40.106111 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:40.106111 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:40.106111 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:40.106111 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:22:40.106111 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 129/262] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Nov 2 07:22:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:40.108967 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa1bf5-3535-48f7-b218-2b138a4fd83b None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:40.116527 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ddd82-315b-44f8-a801-a0303fbd3190 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:40.119801 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa1bf5-3535-48f7-b218-2b138a4fd83b None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:40.129828 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4025cae-cf92-4311-ac04-ed3682034c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:40.130468 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4025cae-cf92-4311-ac04-ed3682034c44 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:40.130740 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4025cae-cf92-4311-ac04-ed3682034c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:40.131006 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4025cae-cf92-4311-ac04-ed3682034c44 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:40.143214 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ddd82-315b-44f8-a801-a0303fbd3190 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:40.152302 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4025cae-cf92-4311-ac04-ed3682034c44 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:40.159175 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8894f5f-790c-4ef0-a844-d4dfc5756956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:40.159800 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8894f5f-790c-4ef0-a844-d4dfc5756956 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:40.162111 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8894f5f-790c-4ef0-a844-d4dfc5756956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:40.162425 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8894f5f-790c-4ef0-a844-d4dfc5756956 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:40.163127 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8894f5f-790c-4ef0-a844-d4dfc5756956 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:40.163432 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8894f5f-790c-4ef0-a844-d4dfc5756956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:40.165340 dv-cinder-804757-31-smb devstack@keystone.service[81611]: WARNING py.warnings [None req-c8894f5f-790c-4ef0-a844-d4dfc5756956 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:22:40.165340 dv-cinder-804757-31-smb devstack@keystone.service[81611]: warnings.warn(msg) Nov 02 07:22:40.165340 dv-cinder-804757-31-smb devstack@keystone.service[81611]: Nov 02 07:22:40.166336 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8894f5f-790c-4ef0-a844-d4dfc5756956 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:40.168159 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-f4025cae-cf92-4311-ac04-ed3682034c44 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:22:40.168159 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:40.168159 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:40.168159 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:40.168159 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:40.168159 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:40.168159 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:40.168159 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:40.168159 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:40.168159 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:40.168159 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:40.168159 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:40.168159 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:40.168159 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:40.168159 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:40.168159 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:40.170128 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:40.170128 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:40.170128 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:40.170128 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:40.170128 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:40.170128 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:40.170128 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:40.170128 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:40.170128 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:40.170128 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:40.170128 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:40.170128 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:40.170128 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:40.170128 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:40.170128 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:40.170128 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:40.171996 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:40.171996 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:40.171996 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:40.171996 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:40.171996 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:40.171996 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:40.171996 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:40.171996 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:40.171996 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:40.171996 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:40.171996 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:22:40.171996 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:22:40.171996 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 134/263] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Nov 2 07:22:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:40.176853 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4025cae-cf92-4311-ac04-ed3682034c44 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:40.179702 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 130/264] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Nov 2 07:22:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:40.186609 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8894f5f-790c-4ef0-a844-d4dfc5756956 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:40.195403 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4025cae-cf92-4311-ac04-ed3682034c44 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:40.202207 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8894f5f-790c-4ef0-a844-d4dfc5756956 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:40.207104 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf3ce6-cfb3-4e41-b02c-37654671216a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:40.207765 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf3ce6-cfb3-4e41-b02c-37654671216a admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:40.208165 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf3ce6-cfb3-4e41-b02c-37654671216a admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:40.208398 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf3ce6-cfb3-4e41-b02c-37654671216a admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:40.209062 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaf3ce6-cfb3-4e41-b02c-37654671216a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:40.209357 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaf3ce6-cfb3-4e41-b02c-37654671216a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:40.212162 dv-cinder-804757-31-smb devstack@keystone.service[81610]: WARNING py.warnings [None req-fbaf3ce6-cfb3-4e41-b02c-37654671216a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:22:40.212162 dv-cinder-804757-31-smb devstack@keystone.service[81610]: warnings.warn(msg) Nov 02 07:22:40.212162 dv-cinder-804757-31-smb devstack@keystone.service[81610]: Nov 02 07:22:40.213063 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaf3ce6-cfb3-4e41-b02c-37654671216a admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:40.218451 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca741d5-7fbf-42d0-b743-1352896c6f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:40.223221 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca741d5-7fbf-42d0-b743-1352896c6f9f admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:40.223221 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca741d5-7fbf-42d0-b743-1352896c6f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:40.223221 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca741d5-7fbf-42d0-b743-1352896c6f9f admin admin] PATH_INFO: `/v3/groups/9d83e711de0f4281b2ad5bd81b73ec38` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:40.232212 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 135/265] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Nov 2 07:22:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:40.232846 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca741d5-7fbf-42d0-b743-1352896c6f9f admin admin] RBAC: Authorizing `identity:get_group(group_id=9d83e711de0f4281b2ad5bd81b73ec38)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:40.233940 dv-cinder-804757-31-smb devstack@keystone.service[81611]: WARNING py.warnings [None req-7ca741d5-7fbf-42d0-b743-1352896c6f9f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:22:40.233940 dv-cinder-804757-31-smb devstack@keystone.service[81611]: warnings.warn(msg) Nov 02 07:22:40.233940 dv-cinder-804757-31-smb devstack@keystone.service[81611]: Nov 02 07:22:40.235151 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca741d5-7fbf-42d0-b743-1352896c6f9f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:40.236941 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 131/266] 10.222.0.16 () {56 vars in 1201 bytes} [Wed Nov 2 07:22:40 2022] GET /identity/v3/groups/9d83e711de0f4281b2ad5bd81b73ec38 => generated 226 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:40.237823 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf3ce6-cfb3-4e41-b02c-37654671216a admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:40.243855 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca741d5-7fbf-42d0-b743-1352896c6f9f admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:40.254806 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf3ce6-cfb3-4e41-b02c-37654671216a admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:40.260337 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca741d5-7fbf-42d0-b743-1352896c6f9f admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:40.264793 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526cda7-cc2b-4349-88e2-ffd0e183e492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:40.265644 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526cda7-cc2b-4349-88e2-ffd0e183e492 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:40.266428 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526cda7-cc2b-4349-88e2-ffd0e183e492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:40.266690 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526cda7-cc2b-4349-88e2-ffd0e183e492 admin admin] PATH_INFO: `/v3/groups/9d83e711de0f4281b2ad5bd81b73ec38` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:40.268542 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526cda7-cc2b-4349-88e2-ffd0e183e492 admin admin] RBAC: Authorizing `identity:get_group(group_id=9d83e711de0f4281b2ad5bd81b73ec38)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:40.270206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63e299-ea19-410b-9064-af90bf4466e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:40.271195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: WARNING py.warnings [None req-5526cda7-cc2b-4349-88e2-ffd0e183e492 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:22:40.271195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: warnings.warn(msg) Nov 02 07:22:40.271195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: Nov 02 07:22:40.272127 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63e299-ea19-410b-9064-af90bf4466e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:40.272407 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63e299-ea19-410b-9064-af90bf4466e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:40.272677 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63e299-ea19-410b-9064-af90bf4466e5 admin admin] PATH_INFO: `/v3/projects/3131faaaf63143c4891d5b7ea7131cec` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:40.273617 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526cda7-cc2b-4349-88e2-ffd0e183e492 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:40.275250 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c63e299-ea19-410b-9064-af90bf4466e5 admin admin] RBAC: Authorizing `identity:get_project(project_id=3131faaaf63143c4891d5b7ea7131cec)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:40.277930 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 136/267] 10.222.0.16 () {56 vars in 1201 bytes} [Wed Nov 2 07:22:40 2022] GET /identity/v3/groups/9d83e711de0f4281b2ad5bd81b73ec38 => generated 226 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:40.278498 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c63e299-ea19-410b-9064-af90bf4466e5 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:40.280234 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 132/268] 10.222.0.16 () {56 vars in 1207 bytes} [Wed Nov 2 07:22:40 2022] GET /identity/v3/projects/3131faaaf63143c4891d5b7ea7131cec => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:40.283123 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526cda7-cc2b-4349-88e2-ffd0e183e492 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:40.288831 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63e299-ea19-410b-9064-af90bf4466e5 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:40.297682 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526cda7-cc2b-4349-88e2-ffd0e183e492 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:40.302828 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63e299-ea19-410b-9064-af90bf4466e5 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:40.305635 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d1f1a-b668-499b-982e-51714fbe74bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:40.306506 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d1f1a-b668-499b-982e-51714fbe74bc admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:40.306988 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d1f1a-b668-499b-982e-51714fbe74bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:40.307395 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e6fd6-aa1b-4f44-9098-15baf25c8859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:40.307669 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d1f1a-b668-499b-982e-51714fbe74bc admin admin] PATH_INFO: `/v3/projects/3131faaaf63143c4891d5b7ea7131cec` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:40.308135 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e6fd6-aa1b-4f44-9098-15baf25c8859 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:40.308461 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e6fd6-aa1b-4f44-9098-15baf25c8859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:40.308770 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e6fd6-aa1b-4f44-9098-15baf25c8859 admin admin] PATH_INFO: `/v3/projects/3131faaaf63143c4891d5b7ea7131cec/groups/9d83e711de0f4281b2ad5bd81b73ec38/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:40.309772 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d1f1a-b668-499b-982e-51714fbe74bc admin admin] RBAC: Authorizing `identity:get_project(project_id=3131faaaf63143c4891d5b7ea7131cec)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:40.311593 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e6fd6-aa1b-4f44-9098-15baf25c8859 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3131faaaf63143c4891d5b7ea7131cec, group_id=9d83e711de0f4281b2ad5bd81b73ec38, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:40.312303 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d1f1a-b668-499b-982e-51714fbe74bc admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:40.312697 dv-cinder-804757-31-smb devstack@keystone.service[81611]: WARNING py.warnings [None req-b82e6fd6-aa1b-4f44-9098-15baf25c8859 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:22:40.312697 dv-cinder-804757-31-smb devstack@keystone.service[81611]: warnings.warn(msg) Nov 02 07:22:40.312697 dv-cinder-804757-31-smb devstack@keystone.service[81611]: Nov 02 07:22:40.314823 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e6fd6-aa1b-4f44-9098-15baf25c8859 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:40.316390 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 137/269] 10.222.0.16 () {56 vars in 1207 bytes} [Wed Nov 2 07:22:40 2022] GET /identity/v3/projects/3131faaaf63143c4891d5b7ea7131cec => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:40.321916 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d1f1a-b668-499b-982e-51714fbe74bc admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:40.332980 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d1f1a-b668-499b-982e-51714fbe74bc admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:40.337538 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754037a-7867-4a4c-aa30-9fd3477283a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:40.338247 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754037a-7867-4a4c-aa30-9fd3477283a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:40.338567 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754037a-7867-4a4c-aa30-9fd3477283a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:40.338888 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754037a-7867-4a4c-aa30-9fd3477283a7 admin admin] PATH_INFO: `/v3/projects/3131faaaf63143c4891d5b7ea7131cec/groups/9d83e711de0f4281b2ad5bd81b73ec38/roles/c2071a72276d475daff2d76d195df6c4` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:40.341464 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a754037a-7867-4a4c-aa30-9fd3477283a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3131faaaf63143c4891d5b7ea7131cec, group_id=9d83e711de0f4281b2ad5bd81b73ec38, role_id=c2071a72276d475daff2d76d195df6c4)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:40.342617 dv-cinder-804757-31-smb devstack@keystone.service[81610]: WARNING py.warnings [None req-a754037a-7867-4a4c-aa30-9fd3477283a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:22:40.342617 dv-cinder-804757-31-smb devstack@keystone.service[81610]: warnings.warn(msg) Nov 02 07:22:40.342617 dv-cinder-804757-31-smb devstack@keystone.service[81610]: Nov 02 07:22:40.344650 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a754037a-7867-4a4c-aa30-9fd3477283a7 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:40.424964 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 133/270] 10.222.0.16 () {58 vars in 1463 bytes} [Wed Nov 2 07:22:40 2022] PUT /identity/v3/projects/3131faaaf63143c4891d5b7ea7131cec/groups/9d83e711de0f4281b2ad5bd81b73ec38/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:22:40.425475 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e6fd6-aa1b-4f44-9098-15baf25c8859 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:40.440639 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 138/271] 10.222.0.16 () {58 vars in 1463 bytes} [Wed Nov 2 07:22:40 2022] PUT /identity/v3/projects/3131faaaf63143c4891d5b7ea7131cec/groups/9d83e711de0f4281b2ad5bd81b73ec38/roles/c2071a72276d475daff2d76d195df6c4 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:22:40.442248 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2837d96-b35a-40b7-bdbf-694092c931a4 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:40.442529 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2837d96-b35a-40b7-bdbf-694092c931a4 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:40.442796 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2837d96-b35a-40b7-bdbf-694092c931a4 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:40.448925 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 139/272] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:40.457607 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d143d-a3e4-46d9-b39e-1e5aa3c8d80f None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:40.457920 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d143d-a3e4-46d9-b39e-1e5aa3c8d80f None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:40.458138 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d143d-a3e4-46d9-b39e-1e5aa3c8d80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:40.500606 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-bd0d143d-a3e4-46d9-b39e-1e5aa3c8d80f None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:40.501843 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-bd0d143d-a3e4-46d9-b39e-1e5aa3c8d80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:40.575502 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e6fd6-aa1b-4f44-9098-15baf25c8859 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:40.607871 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:40.645424 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 140/273] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 02 07:22:40.651205 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a1611-4324-4d70-b455-ce526ae4e4a5 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:40.651629 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a1611-4324-4d70-b455-ce526ae4e4a5 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:40.652016 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a1611-4324-4d70-b455-ce526ae4e4a5 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:40.654416 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 141/274] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:22:40.665382 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5999f34-5a0c-4981-91bb-ec74f3744e54 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:40.665652 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5999f34-5a0c-4981-91bb-ec74f3744e54 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:40.665918 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5999f34-5a0c-4981-91bb-ec74f3744e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:40.678959 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e577a-a593-421d-9548-058463fbdaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:40.680141 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e577a-a593-421d-9548-058463fbdaef admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:40.680520 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e577a-a593-421d-9548-058463fbdaef admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:40.680908 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e577a-a593-421d-9548-058463fbdaef admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:40.690357 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-c5999f34-5a0c-4981-91bb-ec74f3744e54 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:40.691606 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c5999f34-5a0c-4981-91bb-ec74f3744e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:40.712780 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e577a-a593-421d-9548-058463fbdaef admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:40.718502 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-904e577a-a593-421d-9548-058463fbdaef admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:40.718502 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:40.718502 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:40.718502 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:40.718502 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:40.718502 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:40.718502 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:40.718502 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:40.718502 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:40.718502 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:40.718502 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:40.718502 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:40.718502 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:40.718502 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:40.718502 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:40.718502 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:40.719621 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:40.719621 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:40.719621 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:40.719621 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:40.719621 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:40.719621 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:40.719621 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:40.719621 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:40.719621 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:40.719621 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:40.719621 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:40.719621 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:40.719621 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:40.719621 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:40.719621 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:40.719621 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:40.720709 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:40.720709 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:40.720709 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:40.720709 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:40.720709 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:40.720709 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:40.720709 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:40.720709 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:40.720709 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:40.720709 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:40.720709 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:40.720709 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:22:40.722657 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 134/275] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Nov 2 07:22:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:40.728857 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e577a-a593-421d-9548-058463fbdaef admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:40.747067 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e577a-a593-421d-9548-058463fbdaef admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:40.766699 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb8752-b2ad-4880-be93-607a518d26ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:40.767479 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb8752-b2ad-4880-be93-607a518d26ee admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:40.767855 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb8752-b2ad-4880-be93-607a518d26ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:40.768255 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb8752-b2ad-4880-be93-607a518d26ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:40.769022 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb8752-b2ad-4880-be93-607a518d26ee admin admin] RBAC: Adding query filter params (name=member) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:40.769413 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb8752-b2ad-4880-be93-607a518d26ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:40.771146 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb8752-b2ad-4880-be93-607a518d26ee admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:40.772095 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 142/276] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:22:40.781507 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 135/277] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Nov 2 07:22:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:40.786896 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5999f34-5a0c-4981-91bb-ec74f3744e54 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:40.798063 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5999f34-5a0c-4981-91bb-ec74f3744e54 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:40.802628 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16fef3-05f2-4c42-825e-8a50cb639337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:40.803335 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16fef3-05f2-4c42-825e-8a50cb639337 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:40.803680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16fef3-05f2-4c42-825e-8a50cb639337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:40.804113 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16fef3-05f2-4c42-825e-8a50cb639337 admin admin] PATH_INFO: `/v3/groups/9d83e711de0f4281b2ad5bd81b73ec38` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:40.805357 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd16fef3-05f2-4c42-825e-8a50cb639337 admin admin] RBAC: Authorizing `identity:get_group(group_id=9d83e711de0f4281b2ad5bd81b73ec38)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:40.807427 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd16fef3-05f2-4c42-825e-8a50cb639337 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:40.810225 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 143/278] 10.222.0.16 () {56 vars in 1201 bytes} [Wed Nov 2 07:22:40 2022] GET /identity/v3/groups/9d83e711de0f4281b2ad5bd81b73ec38 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:40.815667 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb8752-b2ad-4880-be93-607a518d26ee admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:40.828071 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb8752-b2ad-4880-be93-607a518d26ee admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:40.833839 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23b34e-34cf-4a07-a25a-1e164ee52d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:40.834566 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23b34e-34cf-4a07-a25a-1e164ee52d32 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:40.834837 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23b34e-34cf-4a07-a25a-1e164ee52d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:40.835106 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23b34e-34cf-4a07-a25a-1e164ee52d32 admin admin] PATH_INFO: `/v3/projects/83c9c0ecb1ce451abd74d256c2639262` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:40.836364 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c23b34e-34cf-4a07-a25a-1e164ee52d32 admin admin] RBAC: Authorizing `identity:get_project(project_id=83c9c0ecb1ce451abd74d256c2639262)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:40.838575 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c23b34e-34cf-4a07-a25a-1e164ee52d32 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:40.841156 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 136/279] 10.222.0.16 () {56 vars in 1207 bytes} [Wed Nov 2 07:22:40 2022] GET /identity/v3/projects/83c9c0ecb1ce451abd74d256c2639262 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:40.846806 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16fef3-05f2-4c42-825e-8a50cb639337 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:40.857488 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16fef3-05f2-4c42-825e-8a50cb639337 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:40.868198 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3607d9-cc2a-4365-80bd-94ea291c4821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:40.868976 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3607d9-cc2a-4365-80bd-94ea291c4821 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:40.869250 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3607d9-cc2a-4365-80bd-94ea291c4821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:40.869520 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3607d9-cc2a-4365-80bd-94ea291c4821 admin admin] PATH_INFO: `/v3/projects/83c9c0ecb1ce451abd74d256c2639262/groups/9d83e711de0f4281b2ad5bd81b73ec38/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:40.872015 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3607d9-cc2a-4365-80bd-94ea291c4821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83c9c0ecb1ce451abd74d256c2639262, group_id=9d83e711de0f4281b2ad5bd81b73ec38, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:40.874744 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3607d9-cc2a-4365-80bd-94ea291c4821 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:40.955528 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 144/280] 10.222.0.16 () {58 vars in 1463 bytes} [Wed Nov 2 07:22:40 2022] PUT /identity/v3/projects/83c9c0ecb1ce451abd74d256c2639262/groups/9d83e711de0f4281b2ad5bd81b73ec38/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:22:41.075392 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23b34e-34cf-4a07-a25a-1e164ee52d32 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:41.087938 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23b34e-34cf-4a07-a25a-1e164ee52d32 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:41.163737 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235bceb8-0577-4af2-ab94-03ebf5c18ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:41.164398 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bceb8-0577-4af2-ab94-03ebf5c18ebe admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:41.164670 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bceb8-0577-4af2-ab94-03ebf5c18ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:41.164934 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bceb8-0577-4af2-ab94-03ebf5c18ebe admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:41.180605 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235bceb8-0577-4af2-ab94-03ebf5c18ebe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:41.185681 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-235bceb8-0577-4af2-ab94-03ebf5c18ebe admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:22:41.185681 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:41.185681 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:41.185681 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:41.185681 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:41.185681 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:41.185681 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:41.185681 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:41.185681 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:41.185681 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:41.185681 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:41.185681 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:41.185681 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:41.185681 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:41.185681 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:41.185681 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:41.186676 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:41.186676 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:41.186676 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:41.186676 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:41.186676 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:41.186676 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:41.186676 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:41.186676 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:41.186676 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:41.186676 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:41.186676 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:41.186676 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:41.186676 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:41.186676 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:41.186676 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:41.186676 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:41.187448 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:41.187448 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:41.187448 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:41.187448 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:41.187448 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:41.187448 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:41.187448 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:41.187448 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:41.187448 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:41.187448 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:41.187448 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:22:41.187448 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:22:41.187448 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 137/281] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Nov 2 07:22:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 113 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:41.194212 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3607d9-cc2a-4365-80bd-94ea291c4821 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:41.209577 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3607d9-cc2a-4365-80bd-94ea291c4821 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:41.217717 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea5f34-6efd-482e-8478-d147cf65ec17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:41.218350 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea5f34-6efd-482e-8478-d147cf65ec17 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:41.218624 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea5f34-6efd-482e-8478-d147cf65ec17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:41.218891 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea5f34-6efd-482e-8478-d147cf65ec17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:41.219556 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea5f34-6efd-482e-8478-d147cf65ec17 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:41.219851 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea5f34-6efd-482e-8478-d147cf65ec17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:41.221487 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea5f34-6efd-482e-8478-d147cf65ec17 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:41.232475 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 145/282] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Nov 2 07:22:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:41.237912 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235bceb8-0577-4af2-ab94-03ebf5c18ebe admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:41.248522 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235bceb8-0577-4af2-ab94-03ebf5c18ebe admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:41.252963 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52606af-cb3a-43ae-a405-3b4c8ff7410e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:41.253849 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52606af-cb3a-43ae-a405-3b4c8ff7410e admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:41.254120 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52606af-cb3a-43ae-a405-3b4c8ff7410e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:41.254387 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52606af-cb3a-43ae-a405-3b4c8ff7410e admin admin] PATH_INFO: `/v3/groups/9d83e711de0f4281b2ad5bd81b73ec38` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:41.255488 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52606af-cb3a-43ae-a405-3b4c8ff7410e admin admin] RBAC: Authorizing `identity:get_group(group_id=9d83e711de0f4281b2ad5bd81b73ec38)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:41.257423 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52606af-cb3a-43ae-a405-3b4c8ff7410e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:41.259272 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 138/283] 10.222.0.16 () {56 vars in 1201 bytes} [Wed Nov 2 07:22:41 2022] GET /identity/v3/groups/9d83e711de0f4281b2ad5bd81b73ec38 => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:41.265388 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea5f34-6efd-482e-8478-d147cf65ec17 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:41.275611 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea5f34-6efd-482e-8478-d147cf65ec17 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:41.280518 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e8031-cdf6-4828-a381-181980cad050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:41.281222 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e8031-cdf6-4828-a381-181980cad050 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:41.281572 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e8031-cdf6-4828-a381-181980cad050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:41.281912 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e8031-cdf6-4828-a381-181980cad050 admin admin] PATH_INFO: `/v3/projects/83c9c0ecb1ce451abd74d256c2639262` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:41.283090 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e8031-cdf6-4828-a381-181980cad050 admin admin] RBAC: Authorizing `identity:get_project(project_id=83c9c0ecb1ce451abd74d256c2639262)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:41.285231 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e8031-cdf6-4828-a381-181980cad050 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:41.287231 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 146/284] 10.222.0.16 () {56 vars in 1207 bytes} [Wed Nov 2 07:22:41 2022] GET /identity/v3/projects/83c9c0ecb1ce451abd74d256c2639262 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:41.292720 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52606af-cb3a-43ae-a405-3b4c8ff7410e admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:41.305181 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52606af-cb3a-43ae-a405-3b4c8ff7410e admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:41.312404 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2266709-728a-422f-a27c-9b11c1506b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:41.313057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2266709-728a-422f-a27c-9b11c1506b9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:41.313326 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2266709-728a-422f-a27c-9b11c1506b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:41.313588 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2266709-728a-422f-a27c-9b11c1506b9d admin admin] PATH_INFO: `/v3/projects/83c9c0ecb1ce451abd74d256c2639262/groups/9d83e711de0f4281b2ad5bd81b73ec38/roles/c2071a72276d475daff2d76d195df6c4` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:41.324082 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2266709-728a-422f-a27c-9b11c1506b9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=83c9c0ecb1ce451abd74d256c2639262, group_id=9d83e711de0f4281b2ad5bd81b73ec38, role_id=c2071a72276d475daff2d76d195df6c4)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:41.324238 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e8031-cdf6-4828-a381-181980cad050 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:41.327448 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2266709-728a-422f-a27c-9b11c1506b9d admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:41.329347 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:41.444801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 139/285] 10.222.0.16 () {58 vars in 1463 bytes} [Wed Nov 2 07:22:41 2022] PUT /identity/v3/projects/83c9c0ecb1ce451abd74d256c2639262/groups/9d83e711de0f4281b2ad5bd81b73ec38/roles/c2071a72276d475daff2d76d195df6c4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:22:41.452690 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e8031-cdf6-4828-a381-181980cad050 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:41.503008 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba338b98-4cfe-462f-9e70-2aab3f1ad20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:41.504230 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba338b98-4cfe-462f-9e70-2aab3f1ad20c None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:41.504640 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba338b98-4cfe-462f-9e70-2aab3f1ad20c None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:41.505066 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba338b98-4cfe-462f-9e70-2aab3f1ad20c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:41.516849 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba338b98-4cfe-462f-9e70-2aab3f1ad20c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:41.524644 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-ba338b98-4cfe-462f-9e70-2aab3f1ad20c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:22:41.524644 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:41.524644 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:41.524644 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:41.524644 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:41.524644 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:41.524644 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:41.524644 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:41.524644 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:41.524644 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:41.524644 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:41.524644 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:41.524644 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:41.524644 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:41.524644 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:41.524644 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:41.525737 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:41.525737 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:41.525737 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:41.525737 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:41.525737 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:41.525737 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:41.525737 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:41.525737 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:41.525737 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:41.525737 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:41.525737 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:41.525737 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:41.525737 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:41.525737 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:41.525737 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:41.525737 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:41.526703 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:41.526703 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:41.526703 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:41.526703 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:41.526703 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:41.526703 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:41.526703 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:41.526703 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:41.526703 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:41.526703 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:41.526703 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:22:41.526703 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:22:41.529439 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 147/286] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:22:41.540731 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2266709-728a-422f-a27c-9b11c1506b9d admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:41.645478 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:41.695165 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2266709-728a-422f-a27c-9b11c1506b9d admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:41.740627 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5325eb67-dd67-40a5-97e1-933b3abd94b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:41.741247 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325eb67-dd67-40a5-97e1-933b3abd94b6 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:41.741524 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325eb67-dd67-40a5-97e1-933b3abd94b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:41.741798 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325eb67-dd67-40a5-97e1-933b3abd94b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:41.742467 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5325eb67-dd67-40a5-97e1-933b3abd94b6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:41.742770 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5325eb67-dd67-40a5-97e1-933b3abd94b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:41.744174 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5325eb67-dd67-40a5-97e1-933b3abd94b6 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:41.754500 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 140/287] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Nov 2 07:22:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:41.760655 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba338b98-4cfe-462f-9e70-2aab3f1ad20c None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:41.863694 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:41.913403 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba338b98-4cfe-462f-9e70-2aab3f1ad20c None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:41.963391 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb3e35-7f9b-4121-b865-1df50706b756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:41.964117 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb3e35-7f9b-4121-b865-1df50706b756 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:41.964498 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb3e35-7f9b-4121-b865-1df50706b756 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:41.964871 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb3e35-7f9b-4121-b865-1df50706b756 None admin] PATH_INFO: `/v3/users/5b389bd147db4a698c2b7cc672930fd7` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:41.968730 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb3e35-7f9b-4121-b865-1df50706b756 None admin] RBAC: Authorizing `identity:get_user(user_id=5b389bd147db4a698c2b7cc672930fd7)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:41.970292 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb3e35-7f9b-4121-b865-1df50706b756 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:41.972335 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 148/288] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Nov 2 07:22:41 2022] GET /identity/v3/users/5b389bd147db4a698c2b7cc672930fd7 => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:41.977799 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5325eb67-dd67-40a5-97e1-933b3abd94b6 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:41.984117 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b031b8-119f-42b6-a844-717f94f85af3 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:41.984522 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b031b8-119f-42b6-a844-717f94f85af3 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:41.984899 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b031b8-119f-42b6-a844-717f94f85af3 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:41.986543 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 149/289] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:41.991721 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031b888-ce35-41ff-81dc-2818391afc22 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:41.992151 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031b888-ce35-41ff-81dc-2818391afc22 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:41.992528 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031b888-ce35-41ff-81dc-2818391afc22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:42.018449 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-5031b888-ce35-41ff-81dc-2818391afc22 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:42.021196 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-5031b888-ce35-41ff-81dc-2818391afc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:42.108513 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 150/290] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 02 07:22:42.210925 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5325eb67-dd67-40a5-97e1-933b3abd94b6 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:42.242821 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:42.251449 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc368d84-32eb-4b1e-8073-f27180a5b697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:42.252082 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc368d84-32eb-4b1e-8073-f27180a5b697 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:42.252360 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc368d84-32eb-4b1e-8073-f27180a5b697 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:42.252634 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc368d84-32eb-4b1e-8073-f27180a5b697 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:42.253358 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc368d84-32eb-4b1e-8073-f27180a5b697 None admin] RBAC: Adding query filter params (role.id=ad30a1e0742545958d34a1672de998c1, user.id=5b389bd147db4a698c2b7cc672930fd7, scope.system=all) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:42.253927 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc368d84-32eb-4b1e-8073-f27180a5b697 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:42.255359 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc368d84-32eb-4b1e-8073-f27180a5b697 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:42.270065 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 141/291] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Nov 2 07:22:41 2022] GET /identity/v3/role_assignments?user.id=5b389bd147db4a698c2b7cc672930fd7&scope.system=all&role.id=ad30a1e0742545958d34a1672de998c1 => generated 510 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:42.666531 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031b888-ce35-41ff-81dc-2818391afc22 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:42.681134 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031b888-ce35-41ff-81dc-2818391afc22 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:42.686542 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458dd20-f372-4684-9255-3814fcb9d48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:42.687448 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458dd20-f372-4684-9255-3814fcb9d48a admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:42.687916 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458dd20-f372-4684-9255-3814fcb9d48a admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:42.688411 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458dd20-f372-4684-9255-3814fcb9d48a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:42.703647 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b458dd20-f372-4684-9255-3814fcb9d48a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:42.708838 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-b458dd20-f372-4684-9255-3814fcb9d48a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:22:42.708838 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:42.708838 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:42.708838 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:42.708838 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:42.708838 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:42.708838 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:42.708838 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:42.708838 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:42.708838 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:42.708838 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:42.708838 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:42.708838 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:42.708838 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:42.708838 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:42.708838 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:42.709678 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:42.709678 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:42.709678 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:42.709678 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:42.709678 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:42.709678 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:42.709678 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:42.709678 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:42.709678 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:42.709678 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:42.709678 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:42.709678 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:42.709678 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:42.709678 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:42.709678 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:42.709678 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:42.710454 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:42.710454 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:42.710454 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:42.710454 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:42.710454 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:42.710454 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:42.710454 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:42.710454 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:42.710454 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:42.710454 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:42.710454 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:22:42.710454 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:22:42.713020 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 151/292] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Nov 2 07:22:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:42.719085 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc368d84-32eb-4b1e-8073-f27180a5b697 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:42.731775 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc368d84-32eb-4b1e-8073-f27180a5b697 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:42.739323 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da99beb-dd96-41df-9ac6-11df9aec152f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:42.739926 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da99beb-dd96-41df-9ac6-11df9aec152f admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:42.740223 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da99beb-dd96-41df-9ac6-11df9aec152f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:42.740489 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da99beb-dd96-41df-9ac6-11df9aec152f admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:42.741141 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da99beb-dd96-41df-9ac6-11df9aec152f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:42.741435 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da99beb-dd96-41df-9ac6-11df9aec152f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:42.743014 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da99beb-dd96-41df-9ac6-11df9aec152f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:42.755901 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 142/293] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Nov 2 07:22:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:42.761506 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458dd20-f372-4684-9255-3814fcb9d48a admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:42.777284 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458dd20-f372-4684-9255-3814fcb9d48a admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:42.782444 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4041c09-3c58-44bb-ad4e-d6be6058b970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:42.783071 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4041c09-3c58-44bb-ad4e-d6be6058b970 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:42.783351 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4041c09-3c58-44bb-ad4e-d6be6058b970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:42.783616 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4041c09-3c58-44bb-ad4e-d6be6058b970 admin admin] PATH_INFO: `/v3/groups/a567ff23ba7e4cdaa34bf8d00b35beab` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:42.795184 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4041c09-3c58-44bb-ad4e-d6be6058b970 admin admin] RBAC: Authorizing `identity:get_group(group_id=a567ff23ba7e4cdaa34bf8d00b35beab)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:42.797275 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4041c09-3c58-44bb-ad4e-d6be6058b970 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:42.799325 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 152/294] 10.222.0.16 () {56 vars in 1201 bytes} [Wed Nov 2 07:22:42 2022] GET /identity/v3/groups/a567ff23ba7e4cdaa34bf8d00b35beab => generated 229 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:42.804469 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da99beb-dd96-41df-9ac6-11df9aec152f admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:42.817679 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da99beb-dd96-41df-9ac6-11df9aec152f admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:42.822206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a321d25f-ce21-4007-81a3-15be8f3f8e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:42.822831 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321d25f-ce21-4007-81a3-15be8f3f8e9a admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:42.823103 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321d25f-ce21-4007-81a3-15be8f3f8e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:42.823365 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321d25f-ce21-4007-81a3-15be8f3f8e9a admin admin] PATH_INFO: `/v3/projects/3f9bbbd097ac4710887083fd253be149` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:42.828746 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a321d25f-ce21-4007-81a3-15be8f3f8e9a admin admin] RBAC: Authorizing `identity:get_project(project_id=3f9bbbd097ac4710887083fd253be149)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:42.830547 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a321d25f-ce21-4007-81a3-15be8f3f8e9a admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:42.832436 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 143/295] 10.222.0.16 () {56 vars in 1207 bytes} [Wed Nov 2 07:22:42 2022] GET /identity/v3/projects/3f9bbbd097ac4710887083fd253be149 => generated 344 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:42.837956 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4041c09-3c58-44bb-ad4e-d6be6058b970 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:42.848329 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4041c09-3c58-44bb-ad4e-d6be6058b970 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:42.852940 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc39ccf-9cfa-43e0-a303-c0e7ebdc064c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:42.853595 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc39ccf-9cfa-43e0-a303-c0e7ebdc064c admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:42.857290 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc39ccf-9cfa-43e0-a303-c0e7ebdc064c admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:42.857290 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc39ccf-9cfa-43e0-a303-c0e7ebdc064c admin admin] PATH_INFO: `/v3/projects/3f9bbbd097ac4710887083fd253be149/groups/a567ff23ba7e4cdaa34bf8d00b35beab/roles/9252c356af254127896f3626d925a88a` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:42.858496 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc39ccf-9cfa-43e0-a303-c0e7ebdc064c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f9bbbd097ac4710887083fd253be149, group_id=a567ff23ba7e4cdaa34bf8d00b35beab, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:42.861225 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc39ccf-9cfa-43e0-a303-c0e7ebdc064c admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:42.948623 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 153/296] 10.222.0.16 () {58 vars in 1463 bytes} [Wed Nov 2 07:22:42 2022] PUT /identity/v3/projects/3f9bbbd097ac4710887083fd253be149/groups/a567ff23ba7e4cdaa34bf8d00b35beab/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:22:43.902366 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494daff5-f17f-4c71-a7bb-64cdbd385d6d None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:44.033311 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494daff5-f17f-4c71-a7bb-64cdbd385d6d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:44.033311 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494daff5-f17f-4c71-a7bb-64cdbd385d6d None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:44.033311 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 144/297] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:44.034144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775c4f3-4556-4af3-bb88-18dca7f04e78 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:44.034144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775c4f3-4556-4af3-bb88-18dca7f04e78 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:44.034144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775c4f3-4556-4af3-bb88-18dca7f04e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:44.034605 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a68051-5f50-489c-8d05-5910595870f7 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:44.034605 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a68051-5f50-489c-8d05-5910595870f7 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:44.034605 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a68051-5f50-489c-8d05-5910595870f7 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:44.034605 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 145/298] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:44.034605 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d36688-cd24-47a9-8a03-cf043d2150cf None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:44.034605 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d36688-cd24-47a9-8a03-cf043d2150cf None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:44.034964 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d36688-cd24-47a9-8a03-cf043d2150cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:44.035039 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-c775c4f3-4556-4af3-bb88-18dca7f04e78 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:44.035039 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c775c4f3-4556-4af3-bb88-18dca7f04e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:44.035171 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-58d36688-cd24-47a9-8a03-cf043d2150cf None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:44.035171 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-58d36688-cd24-47a9-8a03-cf043d2150cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:44.035303 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:44.046917 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 154/299] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:44.053435 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee325be-6936-492d-beb8-12bdc3fb92fe None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:44.053435 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee325be-6936-492d-beb8-12bdc3fb92fe None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:44.053435 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee325be-6936-492d-beb8-12bdc3fb92fe None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:44.053435 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 155/300] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:44.069389 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 146/301] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:22:44.071600 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59633bd1-59d0-482b-8b51-96f974d36ab5 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:44.072187 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59633bd1-59d0-482b-8b51-96f974d36ab5 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:44.072656 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59633bd1-59d0-482b-8b51-96f974d36ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:44.096164 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-59633bd1-59d0-482b-8b51-96f974d36ab5 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:44.097693 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-59633bd1-59d0-482b-8b51-96f974d36ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:44.194662 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 156/302] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:22:44.352528 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d36688-cd24-47a9-8a03-cf043d2150cf None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:44.389118 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59633bd1-59d0-482b-8b51-96f974d36ab5 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:44.499063 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59633bd1-59d0-482b-8b51-96f974d36ab5 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:44.507701 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:44.513865 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d36688-cd24-47a9-8a03-cf043d2150cf None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:44.516356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:44.541078 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d280f44-89c5-4a96-991c-b7a144266b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:44.541726 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d280f44-89c5-4a96-991c-b7a144266b76 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:44.542003 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d280f44-89c5-4a96-991c-b7a144266b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:44.542270 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d280f44-89c5-4a96-991c-b7a144266b76 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:44.554104 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d280f44-89c5-4a96-991c-b7a144266b76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:44.557901 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7dd2d-0814-47d4-a9f0-39ad68f53e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:44.558611 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7dd2d-0814-47d4-a9f0-39ad68f53e7c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:44.559742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-5d280f44-89c5-4a96-991c-b7a144266b76 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:22:44.559742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:44.559742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:44.559742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:44.559742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:44.559742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:44.559742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:44.559742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:44.559742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:44.559742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:44.559742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:44.559742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:44.559742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:44.559742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:44.559742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:44.559742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:44.560881 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:44.560881 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:44.560881 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:44.560881 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:44.560881 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:44.560881 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:44.560881 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:44.560881 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:44.560881 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:44.560881 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:44.560881 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:44.560881 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:44.560881 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:44.560881 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:44.560881 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:44.560881 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:44.561709 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:44.561709 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:44.561709 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:44.561709 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:44.561709 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:44.561709 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:44.561709 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:44.561709 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:44.561709 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:44.561709 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:44.561709 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:22:44.561709 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:22:44.562568 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7dd2d-0814-47d4-a9f0-39ad68f53e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:44.562568 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7dd2d-0814-47d4-a9f0-39ad68f53e7c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:44.564223 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 157/303] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Nov 2 07:22:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:44.565468 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd62572-7a98-4379-9e23-32af0b1b3cf2 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:44.565977 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd62572-7a98-4379-9e23-32af0b1b3cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:44.566315 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd62572-7a98-4379-9e23-32af0b1b3cf2 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:44.567593 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 158/304] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:44.568316 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd62572-7a98-4379-9e23-32af0b1b3cf2 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:44.589311 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f7dd2d-0814-47d4-a9f0-39ad68f53e7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:44.596236 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-19f7dd2d-0814-47d4-a9f0-39ad68f53e7c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:44.596236 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:44.596236 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:44.596236 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:44.596236 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:44.596236 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:44.596236 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:44.596236 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:44.596236 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:44.596236 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:44.596236 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:44.596236 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:44.596236 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:44.596236 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:44.596236 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:44.596236 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:44.598144 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:44.598144 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:44.598144 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:44.598144 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:44.598144 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:44.598144 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:44.598144 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:44.598144 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:44.598144 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:44.598144 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:44.598144 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:44.598144 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:44.598144 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:44.598144 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:44.598144 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:44.598144 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:44.599591 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:44.599591 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:44.599591 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:44.599591 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:44.599591 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:44.599591 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:44.599591 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:44.599591 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:44.599591 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:44.599591 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:44.599591 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:44.599591 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:22:44.599591 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 147/305] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:44.599591 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb50a70-85bb-4321-bd20-64e545d53370 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:44.600836 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb50a70-85bb-4321-bd20-64e545d53370 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:44.602125 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb50a70-85bb-4321-bd20-64e545d53370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:44.627285 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-dbb50a70-85bb-4321-bd20-64e545d53370 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:44.628830 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-dbb50a70-85bb-4321-bd20-64e545d53370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:44.714113 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd62572-7a98-4379-9e23-32af0b1b3cf2 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:44.718714 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 148/306] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:44.719642 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb50a70-85bb-4321-bd20-64e545d53370 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:44.751161 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5fa66-3b73-44ee-9a19-e9d28f9c8ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:44.751698 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5fa66-3b73-44ee-9a19-e9d28f9c8ca5 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:44.752091 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5fa66-3b73-44ee-9a19-e9d28f9c8ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:44.752372 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5fa66-3b73-44ee-9a19-e9d28f9c8ca5 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:44.753135 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a5fa66-3b73-44ee-9a19-e9d28f9c8ca5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:44.753442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a5fa66-3b73-44ee-9a19-e9d28f9c8ca5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:44.755114 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a5fa66-3b73-44ee-9a19-e9d28f9c8ca5 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:44.766188 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 159/307] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Nov 2 07:22:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:44.767097 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5fa66-3b73-44ee-9a19-e9d28f9c8ca5 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:44.816896 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:44.850064 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:44.863145 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb50a70-85bb-4321-bd20-64e545d53370 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:44.898935 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5fa66-3b73-44ee-9a19-e9d28f9c8ca5 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:44.908091 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4392d1-aa31-4e4b-9281-a4f8bf1528f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:44.908714 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4392d1-aa31-4e4b-9281-a4f8bf1528f7 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:44.908988 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4392d1-aa31-4e4b-9281-a4f8bf1528f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:44.909253 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4392d1-aa31-4e4b-9281-a4f8bf1528f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:44.909918 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4392d1-aa31-4e4b-9281-a4f8bf1528f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:44.910214 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4392d1-aa31-4e4b-9281-a4f8bf1528f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:44.911595 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4392d1-aa31-4e4b-9281-a4f8bf1528f7 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:44.927637 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 149/308] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Nov 2 07:22:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:44.929684 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4392d1-aa31-4e4b-9281-a4f8bf1528f7 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:44.963257 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd5a43-5c80-48e6-879c-402d29586d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:44.964216 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd5a43-5c80-48e6-879c-402d29586d3e None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:44.964684 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd5a43-5c80-48e6-879c-402d29586d3e None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:44.966113 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd5a43-5c80-48e6-879c-402d29586d3e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:44.982934 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd5a43-5c80-48e6-879c-402d29586d3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:44.990241 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-f5cd5a43-5c80-48e6-879c-402d29586d3e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:44.990241 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:44.990241 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:44.990241 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:44.990241 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:44.990241 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:44.990241 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:44.990241 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:44.990241 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:44.990241 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:44.990241 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:44.990241 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:44.990241 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:44.990241 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:44.990241 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:44.990241 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:44.991110 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:44.991110 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:44.991110 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:44.991110 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:44.991110 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:44.991110 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:44.991110 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:44.991110 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:44.991110 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:44.991110 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:44.991110 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:44.991110 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:44.991110 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:44.991110 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:44.991110 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:44.991110 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:44.991964 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:44.991964 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:44.991964 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:44.991964 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:44.991964 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:44.991964 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:44.991964 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:44.991964 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:44.991964 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:44.991964 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:44.991964 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:44.991964 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:22:44.994914 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 160/309] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:44.996320 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd5a43-5c80-48e6-879c-402d29586d3e None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:45.058833 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4392d1-aa31-4e4b-9281-a4f8bf1528f7 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:45.105103 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e29ca-c6a6-4111-8b5b-efdc6d54eb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:45.106198 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e29ca-c6a6-4111-8b5b-efdc6d54eb6a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:45.106504 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e29ca-c6a6-4111-8b5b-efdc6d54eb6a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:45.107020 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e29ca-c6a6-4111-8b5b-efdc6d54eb6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:45.119286 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:45.132784 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd5a43-5c80-48e6-879c-402d29586d3e None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:45.140403 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:45.183255 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a1736-c72b-4990-bada-1fa35c56dc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:45.184565 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a1736-c72b-4990-bada-1fa35c56dc95 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:45.184863 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a1736-c72b-4990-bada-1fa35c56dc95 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:45.185317 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a1736-c72b-4990-bada-1fa35c56dc95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:45.204081 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e29ca-c6a6-4111-8b5b-efdc6d54eb6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:45.206162 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e29ca-c6a6-4111-8b5b-efdc6d54eb6a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:45.266349 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a1736-c72b-4990-bada-1fa35c56dc95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:45.267088 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a1736-c72b-4990-bada-1fa35c56dc95 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:45.345460 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 150/310] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Nov 2 07:22:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:22:45.346050 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e29ca-c6a6-4111-8b5b-efdc6d54eb6a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:45.383190 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:45.411245 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 161/311] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Nov 2 07:22:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:22:45.411245 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a1736-c72b-4990-bada-1fa35c56dc95 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:45.421377 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:45.482379 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e29ca-c6a6-4111-8b5b-efdc6d54eb6a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:45.530699 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91cd234-3f49-4e3f-887a-cb8b70a52e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:45.531315 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cd234-3f49-4e3f-887a-cb8b70a52e1d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:45.531637 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cd234-3f49-4e3f-887a-cb8b70a52e1d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:45.531908 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cd234-3f49-4e3f-887a-cb8b70a52e1d None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:45.532537 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91cd234-3f49-4e3f-887a-cb8b70a52e1d None admin] RBAC: Adding query filter params (name=member) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:45.532833 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91cd234-3f49-4e3f-887a-cb8b70a52e1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:45.534193 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91cd234-3f49-4e3f-887a-cb8b70a52e1d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:45.544737 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 151/312] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Nov 2 07:22:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:45.545953 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91cd234-3f49-4e3f-887a-cb8b70a52e1d None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:45.550226 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a1736-c72b-4990-bada-1fa35c56dc95 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:45.595285 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95505394-a7fc-4a0f-b719-f2ed56494355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:45.596404 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95505394-a7fc-4a0f-b719-f2ed56494355 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:45.596888 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95505394-a7fc-4a0f-b719-f2ed56494355 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:45.597362 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95505394-a7fc-4a0f-b719-f2ed56494355 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:45.610220 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95505394-a7fc-4a0f-b719-f2ed56494355 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:45.615389 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-95505394-a7fc-4a0f-b719-f2ed56494355 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:22:45.615389 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:45.615389 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:45.615389 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:45.615389 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:45.615389 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:45.615389 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:45.615389 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:45.615389 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:45.615389 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:45.615389 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:45.615389 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:45.615389 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:45.615389 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:45.615389 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:45.615389 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:45.616364 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:45.616364 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:45.616364 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:45.616364 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:45.616364 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:45.616364 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:45.616364 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:45.616364 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:45.616364 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:45.616364 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:45.616364 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:45.616364 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:45.616364 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:45.616364 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:45.616364 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:45.616364 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:45.617144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:45.617144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:45.617144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:45.617144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:45.617144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:45.617144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:45.617144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:45.617144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:45.617144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:45.617144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:45.617144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:22:45.617144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:22:45.617144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 162/313] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Nov 2 07:22:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:45.617806 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95505394-a7fc-4a0f-b719-f2ed56494355 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:45.674227 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:45.678343 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91cd234-3f49-4e3f-887a-cb8b70a52e1d None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:45.696337 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:45.726991 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf3db3-76cc-4b00-9a2e-3777b161672b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:45.727639 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf3db3-76cc-4b00-9a2e-3777b161672b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:45.727913 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf3db3-76cc-4b00-9a2e-3777b161672b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:45.728286 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf3db3-76cc-4b00-9a2e-3777b161672b None admin] PATH_INFO: `/v3/projects/3131faaaf63143c4891d5b7ea7131cec` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:45.730125 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbf3db3-76cc-4b00-9a2e-3777b161672b None admin] RBAC: Authorizing `identity:get_project(project_id=3131faaaf63143c4891d5b7ea7131cec)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:45.732270 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbf3db3-76cc-4b00-9a2e-3777b161672b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:45.735150 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 152/314] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Nov 2 07:22:45 2022] GET /identity/v3/projects/3131faaaf63143c4891d5b7ea7131cec => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:45.736037 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf3db3-76cc-4b00-9a2e-3777b161672b None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:45.741898 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95505394-a7fc-4a0f-b719-f2ed56494355 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:45.785564 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107bb447-c894-425c-bc2f-2cafbd0d2a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:45.786481 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107bb447-c894-425c-bc2f-2cafbd0d2a55 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:45.786756 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107bb447-c894-425c-bc2f-2cafbd0d2a55 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:45.787025 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107bb447-c894-425c-bc2f-2cafbd0d2a55 None admin] PATH_INFO: `/v3/projects/83c9c0ecb1ce451abd74d256c2639262` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:45.789813 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107bb447-c894-425c-bc2f-2cafbd0d2a55 None admin] RBAC: Authorizing `identity:get_project(project_id=83c9c0ecb1ce451abd74d256c2639262)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:45.790094 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107bb447-c894-425c-bc2f-2cafbd0d2a55 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:45.792595 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 163/315] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Nov 2 07:22:45 2022] GET /identity/v3/projects/83c9c0ecb1ce451abd74d256c2639262 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:45.793999 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107bb447-c894-425c-bc2f-2cafbd0d2a55 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:45.865376 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf3db3-76cc-4b00-9a2e-3777b161672b None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:45.903857 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2238aca-6e4f-49ae-a3ac-515be93e5816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:45.904773 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2238aca-6e4f-49ae-a3ac-515be93e5816 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:45.905048 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2238aca-6e4f-49ae-a3ac-515be93e5816 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:45.905317 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2238aca-6e4f-49ae-a3ac-515be93e5816 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:45.919102 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107bb447-c894-425c-bc2f-2cafbd0d2a55 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:45.940304 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:45.958949 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdaa17-f8cf-4b14-90b1-f1eea31c7a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:45.959634 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdaa17-f8cf-4b14-90b1-f1eea31c7a08 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:45.959915 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdaa17-f8cf-4b14-90b1-f1eea31c7a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:45.960216 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdaa17-f8cf-4b14-90b1-f1eea31c7a08 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:45.960918 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdaa17-f8cf-4b14-90b1-f1eea31c7a08 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:45.961220 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdaa17-f8cf-4b14-90b1-f1eea31c7a08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:45.962583 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdaa17-f8cf-4b14-90b1-f1eea31c7a08 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:45.972163 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:45.976212 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 164/316] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Nov 2 07:22:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:45.976212 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdaa17-f8cf-4b14-90b1-f1eea31c7a08 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:45.991939 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2238aca-6e4f-49ae-a3ac-515be93e5816 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:45.993413 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2238aca-6e4f-49ae-a3ac-515be93e5816 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:46.076135 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdaa17-f8cf-4b14-90b1-f1eea31c7a08 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:46.096296 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 153/317] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Nov 2 07:22:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:22:46.097155 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2238aca-6e4f-49ae-a3ac-515be93e5816 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:46.110098 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefb3ed-645b-4ba1-81c0-f6c57afd737b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:46.110724 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefb3ed-645b-4ba1-81c0-f6c57afd737b None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:46.111000 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefb3ed-645b-4ba1-81c0-f6c57afd737b None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:46.111266 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefb3ed-645b-4ba1-81c0-f6c57afd737b None admin] PATH_INFO: `/v3/groups/9d83e711de0f4281b2ad5bd81b73ec38` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:46.112430 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefb3ed-645b-4ba1-81c0-f6c57afd737b None admin] RBAC: Authorizing `identity:get_group(group_id=9d83e711de0f4281b2ad5bd81b73ec38)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:46.113853 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefb3ed-645b-4ba1-81c0-f6c57afd737b None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:46.115484 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 165/318] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Nov 2 07:22:45 2022] GET /identity/v3/groups/9d83e711de0f4281b2ad5bd81b73ec38 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:46.116558 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59b56f-2c71-462e-acac-00db21c9fd20 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:46.116855 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59b56f-2c71-462e-acac-00db21c9fd20 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:46.117123 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59b56f-2c71-462e-acac-00db21c9fd20 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:46.118301 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 166/319] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:46.118994 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59b56f-2c71-462e-acac-00db21c9fd20 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:46.169105 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:46.186042 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:46.200923 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2238aca-6e4f-49ae-a3ac-515be93e5816 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:46.222848 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59b56f-2c71-462e-acac-00db21c9fd20 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:46.234432 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa4072-99d3-4fa0-98e3-9d5d59c6f625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:46.235058 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa4072-99d3-4fa0-98e3-9d5d59c6f625 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:46.235332 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa4072-99d3-4fa0-98e3-9d5d59c6f625 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:46.235603 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa4072-99d3-4fa0-98e3-9d5d59c6f625 None admin] PATH_INFO: `/v3/groups/9d83e711de0f4281b2ad5bd81b73ec38` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:46.236729 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa4072-99d3-4fa0-98e3-9d5d59c6f625 None admin] RBAC: Authorizing `identity:get_group(group_id=9d83e711de0f4281b2ad5bd81b73ec38)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:46.238159 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa4072-99d3-4fa0-98e3-9d5d59c6f625 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:46.239721 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 154/320] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Nov 2 07:22:46 2022] GET /identity/v3/groups/9d83e711de0f4281b2ad5bd81b73ec38 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:46.240512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa4072-99d3-4fa0-98e3-9d5d59c6f625 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:46.257056 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0de62-a8d7-4406-b185-2fce0364e7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:46.257659 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0de62-a8d7-4406-b185-2fce0364e7fe None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:46.257937 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0de62-a8d7-4406-b185-2fce0364e7fe None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:46.258203 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0de62-a8d7-4406-b185-2fce0364e7fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:46.324352 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0de62-a8d7-4406-b185-2fce0364e7fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:46.325957 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0de62-a8d7-4406-b185-2fce0364e7fe None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:46.337887 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa4072-99d3-4fa0-98e3-9d5d59c6f625 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:46.370257 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:46.372920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf49da-cddf-49b8-8a50-68e030ad18dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:46.373540 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf49da-cddf-49b8-8a50-68e030ad18dc None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:46.373816 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf49da-cddf-49b8-8a50-68e030ad18dc None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:46.374086 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf49da-cddf-49b8-8a50-68e030ad18dc None admin] PATH_INFO: `/v3/projects/3131faaaf63143c4891d5b7ea7131cec` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:46.375185 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf49da-cddf-49b8-8a50-68e030ad18dc None admin] RBAC: Authorizing `identity:get_project(project_id=3131faaaf63143c4891d5b7ea7131cec)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:46.376716 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf49da-cddf-49b8-8a50-68e030ad18dc None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:46.378499 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 155/321] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Nov 2 07:22:46 2022] GET /identity/v3/projects/3131faaaf63143c4891d5b7ea7131cec => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:46.379352 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf49da-cddf-49b8-8a50-68e030ad18dc None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:46.400863 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:46.423410 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 167/322] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Nov 2 07:22:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:22:46.424848 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfea96-453b-450d-bc69-40e37ba14c2a None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:46.425131 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfea96-453b-450d-bc69-40e37ba14c2a None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:46.425402 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfea96-453b-450d-bc69-40e37ba14c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:46.442296 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-febfea96-453b-450d-bc69-40e37ba14c2a None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:46.443648 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-febfea96-453b-450d-bc69-40e37ba14c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:46.483175 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf49da-cddf-49b8-8a50-68e030ad18dc None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:46.509324 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 168/323] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:46.516080 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916aceb9-c2d9-4484-9360-796ce6968b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:46.516685 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916aceb9-c2d9-4484-9360-796ce6968b0b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:46.516887 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febfea96-453b-450d-bc69-40e37ba14c2a None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:46.516988 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916aceb9-c2d9-4484-9360-796ce6968b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:46.517217 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916aceb9-c2d9-4484-9360-796ce6968b0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:46.517930 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916aceb9-c2d9-4484-9360-796ce6968b0b None admin] RBAC: Adding query filter params (group.id=9d83e711de0f4281b2ad5bd81b73ec38, role.id=c2071a72276d475daff2d76d195df6c4, scope.project.id=3131faaaf63143c4891d5b7ea7131cec) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:46.518232 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916aceb9-c2d9-4484-9360-796ce6968b0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:46.519653 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916aceb9-c2d9-4484-9360-796ce6968b0b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:46.536081 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 156/324] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Nov 2 07:22:46 2022] GET /identity/v3/role_assignments?group.id=9d83e711de0f4281b2ad5bd81b73ec38&scope.project.id=3131faaaf63143c4891d5b7ea7131cec&role.id=c2071a72276d475daff2d76d195df6c4 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:46.536081 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916aceb9-c2d9-4484-9360-796ce6968b0b None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:46.628914 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:46.654400 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febfea96-453b-450d-bc69-40e37ba14c2a None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:46.662594 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:46.686006 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916aceb9-c2d9-4484-9360-796ce6968b0b None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:46.699578 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147abb3b-5a0e-4ab0-aad1-8fb38031b016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:46.700447 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147abb3b-5a0e-4ab0-aad1-8fb38031b016 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:46.700725 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147abb3b-5a0e-4ab0-aad1-8fb38031b016 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:46.700998 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147abb3b-5a0e-4ab0-aad1-8fb38031b016 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:46.701795 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147abb3b-5a0e-4ab0-aad1-8fb38031b016 None admin] RBAC: Adding query filter params (group.id=9d83e711de0f4281b2ad5bd81b73ec38, role.id=c80de80e56e34e6caa3c27dcec321efd, scope.project.id=83c9c0ecb1ce451abd74d256c2639262) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:46.702366 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147abb3b-5a0e-4ab0-aad1-8fb38031b016 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:46.703646 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147abb3b-5a0e-4ab0-aad1-8fb38031b016 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:46.716563 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 169/325] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Nov 2 07:22:46 2022] GET /identity/v3/role_assignments?group.id=9d83e711de0f4281b2ad5bd81b73ec38&scope.project.id=83c9c0ecb1ce451abd74d256c2639262&role.id=c80de80e56e34e6caa3c27dcec321efd => generated 611 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:46.717528 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147abb3b-5a0e-4ab0-aad1-8fb38031b016 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:46.734470 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff834e-d0fc-49f6-9db6-2fab953c5cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:46.735120 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff834e-d0fc-49f6-9db6-2fab953c5cc8 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:46.735402 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff834e-d0fc-49f6-9db6-2fab953c5cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:46.735789 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff834e-d0fc-49f6-9db6-2fab953c5cc8 None admin] PATH_INFO: `/v3/groups/9d83e711de0f4281b2ad5bd81b73ec38` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:46.737077 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbff834e-d0fc-49f6-9db6-2fab953c5cc8 None admin] RBAC: Authorizing `identity:get_group(group_id=9d83e711de0f4281b2ad5bd81b73ec38)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:46.738540 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbff834e-d0fc-49f6-9db6-2fab953c5cc8 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:46.740810 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 157/326] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Nov 2 07:22:46 2022] GET /identity/v3/groups/9d83e711de0f4281b2ad5bd81b73ec38 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:46.748814 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff834e-d0fc-49f6-9db6-2fab953c5cc8 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:46.863192 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147abb3b-5a0e-4ab0-aad1-8fb38031b016 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:46.895290 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff834e-d0fc-49f6-9db6-2fab953c5cc8 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:46.900069 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75efc23-ef07-41d5-b79c-e4395832b50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:46.900752 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75efc23-ef07-41d5-b79c-e4395832b50c None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:46.901027 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75efc23-ef07-41d5-b79c-e4395832b50c None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:46.901293 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75efc23-ef07-41d5-b79c-e4395832b50c None admin] PATH_INFO: `/v3/projects/83c9c0ecb1ce451abd74d256c2639262` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:46.902476 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75efc23-ef07-41d5-b79c-e4395832b50c None admin] RBAC: Authorizing `identity:get_project(project_id=83c9c0ecb1ce451abd74d256c2639262)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:46.904138 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75efc23-ef07-41d5-b79c-e4395832b50c None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:46.905821 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 170/327] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Nov 2 07:22:46 2022] GET /identity/v3/projects/83c9c0ecb1ce451abd74d256c2639262 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:46.906614 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75efc23-ef07-41d5-b79c-e4395832b50c None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:46.921351 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:46.942947 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e02cb-6163-4a9f-abef-61e001017b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:46.943852 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e02cb-6163-4a9f-abef-61e001017b49 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:46.944161 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e02cb-6163-4a9f-abef-61e001017b49 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:46.944442 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e02cb-6163-4a9f-abef-61e001017b49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:46.945171 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e02cb-6163-4a9f-abef-61e001017b49 None admin] RBAC: Adding query filter params (group.id=9d83e711de0f4281b2ad5bd81b73ec38, role.id=c80de80e56e34e6caa3c27dcec321efd, scope.project.id=3131faaaf63143c4891d5b7ea7131cec) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:46.945483 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e02cb-6163-4a9f-abef-61e001017b49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:46.946962 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e02cb-6163-4a9f-abef-61e001017b49 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:46.954143 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 158/328] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Nov 2 07:22:46 2022] GET /identity/v3/role_assignments?group.id=9d83e711de0f4281b2ad5bd81b73ec38&scope.project.id=3131faaaf63143c4891d5b7ea7131cec&role.id=c80de80e56e34e6caa3c27dcec321efd => generated 611 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:46.959971 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e02cb-6163-4a9f-abef-61e001017b49 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:46.991602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:47.042463 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75efc23-ef07-41d5-b79c-e4395832b50c None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:47.084080 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e38872-86f4-4568-90b0-db2431a544d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:47.085032 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e38872-86f4-4568-90b0-db2431a544d4 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:47.085322 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e38872-86f4-4568-90b0-db2431a544d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:47.085599 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e38872-86f4-4568-90b0-db2431a544d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:47.089592 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e02cb-6163-4a9f-abef-61e001017b49 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:47.100269 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e38872-86f4-4568-90b0-db2431a544d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:47.106467 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-98e38872-86f4-4568-90b0-db2431a544d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:22:47.106467 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:47.106467 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:47.106467 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:47.106467 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:47.106467 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:47.106467 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:47.106467 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:47.106467 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:47.106467 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:47.106467 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:47.106467 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:47.106467 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:47.106467 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:47.106467 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:47.106467 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:47.107607 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:47.107607 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:47.107607 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:47.107607 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:47.107607 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:47.107607 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:47.107607 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:47.107607 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:47.107607 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:47.107607 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:47.107607 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:47.107607 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:47.107607 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:47.107607 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:47.107607 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:47.107607 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:47.108472 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:47.108472 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:47.108472 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:47.108472 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:47.108472 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:47.108472 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:47.108472 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:47.108472 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:47.108472 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:47.108472 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:47.108472 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:22:47.108472 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:22:47.108472 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 171/329] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Nov 2 07:22:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:47.113633 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e38872-86f4-4568-90b0-db2431a544d4 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:47.135246 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af66fa-25df-49e4-8cec-7ee10516ed5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:47.135246 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af66fa-25df-49e4-8cec-7ee10516ed5c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:47.135246 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af66fa-25df-49e4-8cec-7ee10516ed5c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:47.135246 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af66fa-25df-49e4-8cec-7ee10516ed5c None admin] PATH_INFO: `/v3/groups/9d83e711de0f4281b2ad5bd81b73ec38` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:47.136772 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af66fa-25df-49e4-8cec-7ee10516ed5c None admin] RBAC: Authorizing `identity:get_group(group_id=9d83e711de0f4281b2ad5bd81b73ec38)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:47.139384 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af66fa-25df-49e4-8cec-7ee10516ed5c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:47.142475 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 159/330] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Nov 2 07:22:46 2022] GET /identity/v3/groups/9d83e711de0f4281b2ad5bd81b73ec38 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:47.147643 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af66fa-25df-49e4-8cec-7ee10516ed5c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:47.189778 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:47.234792 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e38872-86f4-4568-90b0-db2431a544d4 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:47.246836 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:47.268131 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af66fa-25df-49e4-8cec-7ee10516ed5c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:47.275637 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda0656-25e2-47c3-8f0e-e8b26bd001bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:47.276308 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda0656-25e2-47c3-8f0e-e8b26bd001bb None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:47.276593 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda0656-25e2-47c3-8f0e-e8b26bd001bb None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:47.276868 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda0656-25e2-47c3-8f0e-e8b26bd001bb None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:47.279039 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda0656-25e2-47c3-8f0e-e8b26bd001bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:47.279362 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda0656-25e2-47c3-8f0e-e8b26bd001bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:47.280864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda0656-25e2-47c3-8f0e-e8b26bd001bb None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:47.289658 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 172/331] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:47.295650 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda0656-25e2-47c3-8f0e-e8b26bd001bb None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:47.307661 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878bf14e-9d0b-4b0a-9dbb-87997f112621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:47.308324 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bf14e-9d0b-4b0a-9dbb-87997f112621 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:47.308601 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bf14e-9d0b-4b0a-9dbb-87997f112621 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:47.308969 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bf14e-9d0b-4b0a-9dbb-87997f112621 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:47.309876 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878bf14e-9d0b-4b0a-9dbb-87997f112621 None admin] RBAC: Adding query filter params (group.id=9d83e711de0f4281b2ad5bd81b73ec38, role.id=c2071a72276d475daff2d76d195df6c4, scope.project.id=83c9c0ecb1ce451abd74d256c2639262) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:47.310195 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878bf14e-9d0b-4b0a-9dbb-87997f112621 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:47.311653 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878bf14e-9d0b-4b0a-9dbb-87997f112621 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:47.318341 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 160/332] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Nov 2 07:22:47 2022] GET /identity/v3/role_assignments?group.id=9d83e711de0f4281b2ad5bd81b73ec38&scope.project.id=83c9c0ecb1ce451abd74d256c2639262&role.id=c2071a72276d475daff2d76d195df6c4 => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:47.414908 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda0656-25e2-47c3-8f0e-e8b26bd001bb None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:47.449695 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:47.457983 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e22fea-c3fc-4826-a99e-ee58312ddb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:47.458623 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e22fea-c3fc-4826-a99e-ee58312ddb06 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:47.458899 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e22fea-c3fc-4826-a99e-ee58312ddb06 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:47.459178 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e22fea-c3fc-4826-a99e-ee58312ddb06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:47.536186 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e22fea-c3fc-4826-a99e-ee58312ddb06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:47.537676 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e22fea-c3fc-4826-a99e-ee58312ddb06 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:47.643082 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 173/333] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Nov 2 07:22:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Nov 02 07:22:47.648740 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878bf14e-9d0b-4b0a-9dbb-87997f112621 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:47.757855 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878bf14e-9d0b-4b0a-9dbb-87997f112621 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:47.792616 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1623bf-8a53-4f6b-81ee-565e10b2a5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:47.793770 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1623bf-8a53-4f6b-81ee-565e10b2a5e2 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:47.794034 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1623bf-8a53-4f6b-81ee-565e10b2a5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:47.794298 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1623bf-8a53-4f6b-81ee-565e10b2a5e2 None admin] PATH_INFO: `/v3/projects/3f9bbbd097ac4710887083fd253be149` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:47.795390 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1623bf-8a53-4f6b-81ee-565e10b2a5e2 None admin] RBAC: Authorizing `identity:get_project(project_id=3f9bbbd097ac4710887083fd253be149)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:47.796858 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1623bf-8a53-4f6b-81ee-565e10b2a5e2 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:47.798762 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 161/334] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Nov 2 07:22:47 2022] GET /identity/v3/projects/3f9bbbd097ac4710887083fd253be149 => generated 344 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:47.804097 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e22fea-c3fc-4826-a99e-ee58312ddb06 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:47.833917 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:47.899558 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e22fea-c3fc-4826-a99e-ee58312ddb06 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:47.931442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cea121-7780-4f72-8e19-0529ce243729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:47.932084 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cea121-7780-4f72-8e19-0529ce243729 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:47.932356 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cea121-7780-4f72-8e19-0529ce243729 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:47.932624 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cea121-7780-4f72-8e19-0529ce243729 None admin] PATH_INFO: `/v3/groups/a567ff23ba7e4cdaa34bf8d00b35beab` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:47.933743 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cea121-7780-4f72-8e19-0529ce243729 None admin] RBAC: Authorizing `identity:get_group(group_id=a567ff23ba7e4cdaa34bf8d00b35beab)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:47.935672 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cea121-7780-4f72-8e19-0529ce243729 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:47.937246 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 174/335] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Nov 2 07:22:47 2022] GET /identity/v3/groups/a567ff23ba7e4cdaa34bf8d00b35beab => generated 229 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:47.942941 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1623bf-8a53-4f6b-81ee-565e10b2a5e2 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:47.962064 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:48.041507 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1623bf-8a53-4f6b-81ee-565e10b2a5e2 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:48.075010 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6094c-48be-4822-a3cd-cbaf9eecf812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:48.075598 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6094c-48be-4822-a3cd-cbaf9eecf812 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:48.075876 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6094c-48be-4822-a3cd-cbaf9eecf812 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:48.076171 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6094c-48be-4822-a3cd-cbaf9eecf812 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:48.076882 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6094c-48be-4822-a3cd-cbaf9eecf812 None admin] RBAC: Adding query filter params (group.id=a567ff23ba7e4cdaa34bf8d00b35beab, role.id=9252c356af254127896f3626d925a88a, scope.project.id=3f9bbbd097ac4710887083fd253be149) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:48.077185 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6094c-48be-4822-a3cd-cbaf9eecf812 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:48.078603 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6094c-48be-4822-a3cd-cbaf9eecf812 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:48.084332 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 162/336] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Nov 2 07:22:47 2022] GET /identity/v3/role_assignments?group.id=a567ff23ba7e4cdaa34bf8d00b35beab&scope.project.id=3f9bbbd097ac4710887083fd253be149&role.id=9252c356af254127896f3626d925a88a => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:50.595453 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a684c-9c07-4a2b-a7bc-387b90f45e2b None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:50.596676 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a684c-9c07-4a2b-a7bc-387b90f45e2b None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:50.597234 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a684c-9c07-4a2b-a7bc-387b90f45e2b None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:50.598739 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 175/337] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:50.603852 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9a771-2c83-42c7-bcad-5bc808e9daf5 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:50.604373 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9a771-2c83-42c7-bcad-5bc808e9daf5 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:50.604456 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9a771-2c83-42c7-bcad-5bc808e9daf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:50.633047 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-3bc9a771-2c83-42c7-bcad-5bc808e9daf5 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:50.634246 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3bc9a771-2c83-42c7-bcad-5bc808e9daf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:50.786874 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 163/338] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:22:50.922120 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1b0a2-dd0d-4eb9-9170-ed364536371b None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:50.922334 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1b0a2-dd0d-4eb9-9170-ed364536371b None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:50.922974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1b0a2-dd0d-4eb9-9170-ed364536371b None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:50.924870 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 176/339] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:50.934325 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e02e5f-17db-434b-81e1-847b1a9a0532 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:50.934603 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e02e5f-17db-434b-81e1-847b1a9a0532 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:50.935054 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e02e5f-17db-434b-81e1-847b1a9a0532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:50.965630 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-85e02e5f-17db-434b-81e1-847b1a9a0532 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:50.967098 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-85e02e5f-17db-434b-81e1-847b1a9a0532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:50.970375 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:51.100853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 164/340] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:51.242379 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956a1e5-abb3-442c-9f65-98ec2d3846ae None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:51.242681 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956a1e5-abb3-442c-9f65-98ec2d3846ae None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:51.242868 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956a1e5-abb3-442c-9f65-98ec2d3846ae None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:51.244188 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 177/341] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:51.254830 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d54bfa-8726-4bf7-a8c5-22097f72e5eb None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:51.255391 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d54bfa-8726-4bf7-a8c5-22097f72e5eb None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:51.255869 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d54bfa-8726-4bf7-a8c5-22097f72e5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:51.269511 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956a1e5-abb3-442c-9f65-98ec2d3846ae None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:51.285636 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-c8d54bfa-8726-4bf7-a8c5-22097f72e5eb None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:51.287156 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c8d54bfa-8726-4bf7-a8c5-22097f72e5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:51.442041 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 165/342] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:51.457755 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:51.461996 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d54bfa-8726-4bf7-a8c5-22097f72e5eb None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:51.465875 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956a1e5-abb3-442c-9f65-98ec2d3846ae None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:51.528658 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf5fa9-22f6-4b72-8777-d4fd0ceeaad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:51.533509 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf5fa9-22f6-4b72-8777-d4fd0ceeaad8 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:51.533796 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf5fa9-22f6-4b72-8777-d4fd0ceeaad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:51.534069 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf5fa9-22f6-4b72-8777-d4fd0ceeaad8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:51.552336 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf5fa9-22f6-4b72-8777-d4fd0ceeaad8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:51.556139 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf5fa9-22f6-4b72-8777-d4fd0ceeaad8 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:51.583006 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-b8bf5fa9-22f6-4b72-8777-d4fd0ceeaad8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:51.583006 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:51.583006 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:51.583006 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:51.583006 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:51.583006 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:51.583006 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:51.583006 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:51.583006 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:51.583006 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:51.583006 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:51.583006 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:51.583006 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:51.583006 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:51.583006 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:51.583006 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:51.584014 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:51.584014 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:51.584014 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:51.584014 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:51.584014 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:51.584014 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:51.584014 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:51.584014 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:51.584014 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:51.584014 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:51.584014 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:51.584014 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:51.584014 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:51.584014 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:51.584014 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:51.584014 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:51.584014 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:51.585542 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:51.585542 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:51.585542 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:22:51.585542 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 178/343] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:22:51.597631 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf5fa9-22f6-4b72-8777-d4fd0ceeaad8 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:51.603466 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:51.667849 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d54bfa-8726-4bf7-a8c5-22097f72e5eb None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:51.727120 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40444b8a-5809-42ff-b5cf-57b4f93c9824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:51.728099 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40444b8a-5809-42ff-b5cf-57b4f93c9824 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:51.728563 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40444b8a-5809-42ff-b5cf-57b4f93c9824 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:51.729008 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40444b8a-5809-42ff-b5cf-57b4f93c9824 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:51.740250 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf5fa9-22f6-4b72-8777-d4fd0ceeaad8 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:51.740503 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40444b8a-5809-42ff-b5cf-57b4f93c9824 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:51.742219 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40444b8a-5809-42ff-b5cf-57b4f93c9824 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:51.757817 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-40444b8a-5809-42ff-b5cf-57b4f93c9824 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:51.757817 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:51.757817 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:51.757817 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:51.757817 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:51.757817 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:51.757817 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:51.757817 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:51.757817 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:51.757817 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:51.757817 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:51.757817 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:51.757817 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:51.757817 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:51.757817 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:51.757817 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:51.758721 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:51.758721 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:51.758721 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:51.758721 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:51.758721 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:51.758721 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:51.758721 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:51.758721 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:51.758721 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:51.758721 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:51.758721 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:51.758721 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:51.758721 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:51.758721 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:51.758721 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:51.758721 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:51.758721 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:51.759584 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:51.759584 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:51.759584 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:22:51.761096 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 166/344] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:22:51.763340 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1b188-2d08-4bcf-b862-7d56aa638021 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:51.763827 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1b188-2d08-4bcf-b862-7d56aa638021 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:51.764330 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1b188-2d08-4bcf-b862-7d56aa638021 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:51.766152 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 167/345] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:51.767169 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1b188-2d08-4bcf-b862-7d56aa638021 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:51.778513 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f7f08-fecb-4dd2-b374-451995c88ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:51.779179 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f7f08-fecb-4dd2-b374-451995c88ce9 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:51.779513 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f7f08-fecb-4dd2-b374-451995c88ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:51.779781 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f7f08-fecb-4dd2-b374-451995c88ce9 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:51.780438 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f7f08-fecb-4dd2-b374-451995c88ce9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:51.780736 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f7f08-fecb-4dd2-b374-451995c88ce9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:51.782194 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f7f08-fecb-4dd2-b374-451995c88ce9 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:51.796128 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 179/346] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:51.797606 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e4622-98a0-4408-a98a-d4cae6c47452 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:51.797950 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e4622-98a0-4408-a98a-d4cae6c47452 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:51.798295 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e4622-98a0-4408-a98a-d4cae6c47452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:51.815897 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-ee1e4622-98a0-4408-a98a-d4cae6c47452 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:51.817304 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-ee1e4622-98a0-4408-a98a-d4cae6c47452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:51.820340 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:51.878154 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1b188-2d08-4bcf-b862-7d56aa638021 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:51.890181 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 180/347] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:51.891475 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e4622-98a0-4408-a98a-d4cae6c47452 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:51.912554 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:51.934871 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e1e78-0066-40a2-b084-966d11f1feb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:51.935764 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e1e78-0066-40a2-b084-966d11f1feb5 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:51.936208 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e1e78-0066-40a2-b084-966d11f1feb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:51.936629 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e1e78-0066-40a2-b084-966d11f1feb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:51.948581 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e1e78-0066-40a2-b084-966d11f1feb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:51.950315 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e1e78-0066-40a2-b084-966d11f1feb5 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:51.966284 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-bf2e1e78-0066-40a2-b084-966d11f1feb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:51.966284 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:51.966284 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:51.966284 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:51.966284 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:51.966284 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:51.966284 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:51.966284 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:51.966284 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:51.966284 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:51.966284 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:51.966284 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:51.966284 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:51.966284 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:51.966284 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:51.966284 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:51.967210 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:51.967210 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:51.967210 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:51.967210 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:51.967210 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:51.967210 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:51.967210 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:51.967210 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:51.967210 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:51.967210 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:51.967210 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:51.967210 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:51.967210 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:51.967210 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:51.967210 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:51.967210 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:51.967210 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:51.968037 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:51.968037 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:51.968037 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:22:51.970092 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 168/348] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:51.971120 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e1e78-0066-40a2-b084-966d11f1feb5 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:52.032522 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e4622-98a0-4408-a98a-d4cae6c47452 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:52.073694 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e4e455-8ad6-42c1-944f-c1214e3f733a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:52.074562 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4e455-8ad6-42c1-944f-c1214e3f733a None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:52.074882 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4e455-8ad6-42c1-944f-c1214e3f733a None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:52.075214 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4e455-8ad6-42c1-944f-c1214e3f733a None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:52.076310 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e4e455-8ad6-42c1-944f-c1214e3f733a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:52.076616 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e4e455-8ad6-42c1-944f-c1214e3f733a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:52.078253 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e4e455-8ad6-42c1-944f-c1214e3f733a None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:52.088263 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e1e78-0066-40a2-b084-966d11f1feb5 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:52.088955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:52.094653 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 181/349] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:52.095436 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e4e455-8ad6-42c1-944f-c1214e3f733a None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:52.131032 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2639852-efbb-4f8f-9e82-e77f14ccd9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:52.132465 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2639852-efbb-4f8f-9e82-e77f14ccd9d2 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:52.133201 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2639852-efbb-4f8f-9e82-e77f14ccd9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:52.133670 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2639852-efbb-4f8f-9e82-e77f14ccd9d2 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:52.134669 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2639852-efbb-4f8f-9e82-e77f14ccd9d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:52.137077 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2639852-efbb-4f8f-9e82-e77f14ccd9d2 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:52.205932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e4e455-8ad6-42c1-944f-c1214e3f733a None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:52.232099 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 169/350] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Nov 2 07:22:51 2022] POST /identity/v3/users => generated 246 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:22:52.232099 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2639852-efbb-4f8f-9e82-e77f14ccd9d2 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:52.253319 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2efda-5b93-4929-8e14-7a2c8eb3873c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:52.254206 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2efda-5b93-4929-8e14-7a2c8eb3873c None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:52.254481 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2efda-5b93-4929-8e14-7a2c8eb3873c None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:52.254748 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2efda-5b93-4929-8e14-7a2c8eb3873c None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:52.255392 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2efda-5b93-4929-8e14-7a2c8eb3873c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:52.255689 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2efda-5b93-4929-8e14-7a2c8eb3873c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:52.257244 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2efda-5b93-4929-8e14-7a2c8eb3873c None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:52.267762 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:52.278916 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 182/351] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:52.284397 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2efda-5b93-4929-8e14-7a2c8eb3873c None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:52.365216 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:52.368401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2639852-efbb-4f8f-9e82-e77f14ccd9d2 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:52.408843 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b866c418-0f7d-4a6a-8a0d-d718df2d1ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:52.409491 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866c418-0f7d-4a6a-8a0d-d718df2d1ac7 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:52.409769 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866c418-0f7d-4a6a-8a0d-d718df2d1ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:52.410037 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866c418-0f7d-4a6a-8a0d-d718df2d1ac7 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:52.410688 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b866c418-0f7d-4a6a-8a0d-d718df2d1ac7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:52.412167 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b866c418-0f7d-4a6a-8a0d-d718df2d1ac7 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:52.413170 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2efda-5b93-4929-8e14-7a2c8eb3873c None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:52.450283 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c805097-40b9-4f5e-860c-939aebc47dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:52.450962 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c805097-40b9-4f5e-860c-939aebc47dfc None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:52.451238 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c805097-40b9-4f5e-860c-939aebc47dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:52.451510 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c805097-40b9-4f5e-860c-939aebc47dfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:52.461499 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c805097-40b9-4f5e-860c-939aebc47dfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:52.462915 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c805097-40b9-4f5e-860c-939aebc47dfc None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:52.477912 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-9c805097-40b9-4f5e-860c-939aebc47dfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:52.477912 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:52.477912 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:52.477912 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:52.477912 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:52.477912 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:52.477912 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:52.477912 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:52.477912 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:52.477912 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:52.477912 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:52.477912 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:52.477912 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:52.477912 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:52.477912 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:52.477912 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:52.478893 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:52.478893 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:52.478893 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:52.478893 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:52.478893 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:52.478893 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:52.478893 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:52.478893 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:52.478893 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:52.478893 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:52.478893 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:52.478893 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:52.478893 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:52.478893 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:52.478893 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:52.478893 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:52.478893 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:52.479779 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:52.479779 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:52.479779 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:22:52.479779 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 183/352] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:52.484664 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c805097-40b9-4f5e-860c-939aebc47dfc None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:52.520091 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 170/353] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Nov 2 07:22:52 2022] POST /identity/v3/users => generated 248 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:22:52.520091 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cff733-73b6-49aa-915a-bc7736112af3 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:52.520091 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cff733-73b6-49aa-915a-bc7736112af3 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:52.520091 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cff733-73b6-49aa-915a-bc7736112af3 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:52.520091 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 171/354] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:52.520091 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cff733-73b6-49aa-915a-bc7736112af3 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:52.626409 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:52.636037 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c805097-40b9-4f5e-860c-939aebc47dfc None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:52.651361 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cff733-73b6-49aa-915a-bc7736112af3 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:52.652190 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:52.677765 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f779f8-e77b-46ec-858f-e70045ab1582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:52.682875 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f779f8-e77b-46ec-858f-e70045ab1582 None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:52.682875 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f779f8-e77b-46ec-858f-e70045ab1582 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:52.682875 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f779f8-e77b-46ec-858f-e70045ab1582 None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:52.682875 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f779f8-e77b-46ec-858f-e70045ab1582 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:52.682875 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f779f8-e77b-46ec-858f-e70045ab1582 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:52.705752 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9421094b-6d41-4aae-8fc3-20a0ffee076c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:52.709178 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421094b-6d41-4aae-8fc3-20a0ffee076c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:52.709178 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421094b-6d41-4aae-8fc3-20a0ffee076c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:52.709178 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421094b-6d41-4aae-8fc3-20a0ffee076c None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:52.709178 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9421094b-6d41-4aae-8fc3-20a0ffee076c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:52.709178 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9421094b-6d41-4aae-8fc3-20a0ffee076c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:52.709529 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9421094b-6d41-4aae-8fc3-20a0ffee076c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:52.729192 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 172/355] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:52.730519 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d1ef1-7ea3-4c70-871d-e0d7b34c75ca None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:52.730519 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d1ef1-7ea3-4c70-871d-e0d7b34c75ca None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:52.731022 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d1ef1-7ea3-4c70-871d-e0d7b34c75ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:52.749969 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-bf6d1ef1-7ea3-4c70-871d-e0d7b34c75ca None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:52.751186 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-bf6d1ef1-7ea3-4c70-871d-e0d7b34c75ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:52.802639 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 184/356] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Nov 2 07:22:52 2022] POST /identity/v3/users => generated 248 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:22:52.808281 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f779f8-e77b-46ec-858f-e70045ab1582 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:52.854181 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 173/357] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:52.971828 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f779f8-e77b-46ec-858f-e70045ab1582 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:53.022001 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534241a-769f-4117-88c8-ba8644f0298f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:53.022619 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534241a-769f-4117-88c8-ba8644f0298f None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:53.022899 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534241a-769f-4117-88c8-ba8644f0298f None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:53.023171 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534241a-769f-4117-88c8-ba8644f0298f None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:53.023819 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534241a-769f-4117-88c8-ba8644f0298f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:53.025350 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534241a-769f-4117-88c8-ba8644f0298f None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:53.127003 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 185/358] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Nov 2 07:22:52 2022] POST /identity/v3/users => generated 249 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:22:53.173932 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d1ef1-7ea3-4c70-871d-e0d7b34c75ca None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:53.264142 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:53.289985 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d1ef1-7ea3-4c70-871d-e0d7b34c75ca None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:53.333887 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58163d73-a764-43dc-b829-64118485f1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:53.334506 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58163d73-a764-43dc-b829-64118485f1fb None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:53.334784 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58163d73-a764-43dc-b829-64118485f1fb None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:53.335056 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58163d73-a764-43dc-b829-64118485f1fb None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:53.335728 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58163d73-a764-43dc-b829-64118485f1fb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:53.337128 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58163d73-a764-43dc-b829-64118485f1fb None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:53.377419 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.sql.core [None req-58163d73-a764-43dc-b829-64118485f1fb None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Nov 02 07:22:53.377419 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Nov 02 07:22:53.377419 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [parameters: {'id': 'a483c84d399c4d58ada526c9a4a5228a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Nov 02 07:22:53.377419 dv-cinder-804757-31-smb devstack@keystone.service[81611]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81611) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 07:22:53.394250 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-58163d73-a764-43dc-b829-64118485f1fb None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Nov 02 07:22:53.394250 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:53.394250 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 07:22:53.394250 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 07:22:53.394250 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 07:22:53.394250 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 07:22:53.394250 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 07:22:53.394250 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 07:22:53.394250 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 07:22:53.394250 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application conn.query(q) Nov 02 07:22:53.394250 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 07:22:53.394250 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 07:22:53.394250 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 07:22:53.394250 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application result.read() Nov 02 07:22:53.394250 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 07:22:53.395160 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 07:22:53.395160 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 07:22:53.395160 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 07:22:53.395160 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 07:22:53.395160 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 07:22:53.395160 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 07:22:53.395160 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 07:22:53.395160 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Nov 02 07:22:53.395160 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:22:53.395160 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Nov 02 07:22:53.395160 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:22:53.395160 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:53.395160 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Nov 02 07:22:53.395160 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return method(*args, **kwargs) Nov 02 07:22:53.395160 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Nov 02 07:22:53.395160 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return ref.to_dict() Nov 02 07:22:53.395160 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 07:22:53.395160 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application next(self.gen) Nov 02 07:22:53.396745 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Nov 02 07:22:53.396745 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application yield resource Nov 02 07:22:53.396745 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 07:22:53.396745 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application next(self.gen) Nov 02 07:22:53.396745 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Nov 02 07:22:53.396745 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self.session.rollback() Nov 02 07:22:53.396745 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 07:22:53.396745 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self.force_reraise() Nov 02 07:22:53.396745 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 07:22:53.396745 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise self.value Nov 02 07:22:53.396745 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Nov 02 07:22:53.396745 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Nov 02 07:22:53.396745 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Nov 02 07:22:53.396745 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application session.commit() Nov 02 07:22:53.396745 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Nov 02 07:22:53.396745 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Nov 02 07:22:53.396745 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Nov 02 07:22:53.397602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._prepare_impl() Nov 02 07:22:53.397602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Nov 02 07:22:53.397602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self.session.flush() Nov 02 07:22:53.397602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 07:22:53.397602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._flush(objects) Nov 02 07:22:53.397602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 07:22:53.397602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Nov 02 07:22:53.397602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 07:22:53.397602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application compat.raise_( Nov 02 07:22:53.397602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 07:22:53.397602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception Nov 02 07:22:53.397602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 07:22:53.397602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application flush_context.execute() Nov 02 07:22:53.397602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 07:22:53.397602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rec.execute(self) Nov 02 07:22:53.397602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 07:22:53.397602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Nov 02 07:22:53.398428 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 07:22:53.398428 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application _emit_insert_statements( Nov 02 07:22:53.398428 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Nov 02 07:22:53.398428 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application c = connection._execute_20( Nov 02 07:22:53.398428 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 07:22:53.398428 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 07:22:53.398428 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 07:22:53.398428 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Nov 02 07:22:53.398428 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 07:22:53.398428 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ret = self._execute_context( Nov 02 07:22:53.398428 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 07:22:53.398428 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Nov 02 07:22:53.398428 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 07:22:53.398428 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 07:22:53.398428 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 07:22:53.398428 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception Nov 02 07:22:53.399202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 07:22:53.399202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 07:22:53.399202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 07:22:53.399202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 07:22:53.399202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 07:22:53.399202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 07:22:53.399202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 07:22:53.399202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application conn.query(q) Nov 02 07:22:53.399202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 07:22:53.399202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 07:22:53.399202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 07:22:53.399202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application result.read() Nov 02 07:22:53.399202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 07:22:53.399202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 07:22:53.399202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 07:22:53.399202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 07:22:53.400831 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 07:22:53.400831 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 07:22:53.400831 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 07:22:53.400831 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 07:22:53.400831 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Nov 02 07:22:53.400831 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Nov 02 07:22:53.400831 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [parameters: {'id': 'a483c84d399c4d58ada526c9a4a5228a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Nov 02 07:22:53.400831 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 07:22:53.400831 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:22:53.400831 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:22:53.400831 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:22:53.400831 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:53.400831 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:53.400831 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:53.400831 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:53.400831 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:53.403669 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:53.403669 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:53.403669 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:53.403669 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:53.403669 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:53.403669 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:53.403669 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Nov 02 07:22:53.403669 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Nov 02 07:22:53.403669 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:53.403669 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:53.403669 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Nov 02 07:22:53.403669 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Nov 02 07:22:53.403669 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Nov 02 07:22:53.403669 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Nov 02 07:22:53.403669 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Nov 02 07:22:53.403669 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:22:53.405718 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 174/359] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Nov 2 07:22:53 2022] POST /identity/v3/roles => generated 144 bytes in 222 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:53.405849 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534241a-769f-4117-88c8-ba8644f0298f None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:53.444962 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:53.549469 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534241a-769f-4117-88c8-ba8644f0298f None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:53.595512 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a67c4-0884-4585-9c4f-ba97589d234f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:53.596177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a67c4-0884-4585-9c4f-ba97589d234f None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:53.596456 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a67c4-0884-4585-9c4f-ba97589d234f None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:53.596733 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a67c4-0884-4585-9c4f-ba97589d234f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:53.612962 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a67c4-0884-4585-9c4f-ba97589d234f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:53.617800 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-5e0a67c4-0884-4585-9c4f-ba97589d234f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:22:53.617800 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:53.617800 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:53.617800 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:53.617800 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:53.617800 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:53.617800 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:53.617800 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:53.617800 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:53.617800 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:53.617800 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:53.617800 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:53.617800 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:53.617800 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:53.617800 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:53.617800 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:53.619971 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:53.619971 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:53.619971 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:53.619971 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:53.619971 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:53.619971 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:53.619971 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:53.619971 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:53.619971 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:53.619971 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:53.619971 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:53.619971 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:53.619971 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:53.619971 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:53.619971 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:53.619971 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:53.622510 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:53.622510 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:53.622510 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:53.622510 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:53.622510 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:53.622510 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:53.622510 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:53.622510 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:53.622510 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:53.622510 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:53.622510 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:22:53.622510 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:22:53.622510 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 186/360] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Nov 2 07:22:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:53.626044 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58163d73-a764-43dc-b829-64118485f1fb None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:53.764642 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58163d73-a764-43dc-b829-64118485f1fb None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:53.816448 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ae099-d6c8-4582-8ebe-49f6a0d2acb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:53.816983 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ae099-d6c8-4582-8ebe-49f6a0d2acb9 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:53.817259 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ae099-d6c8-4582-8ebe-49f6a0d2acb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:53.817531 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ae099-d6c8-4582-8ebe-49f6a0d2acb9 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:53.818191 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ae099-d6c8-4582-8ebe-49f6a0d2acb9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:53.818491 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ae099-d6c8-4582-8ebe-49f6a0d2acb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:53.819864 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ae099-d6c8-4582-8ebe-49f6a0d2acb9 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:53.832404 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 175/361] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Nov 2 07:22:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:54.666751 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d40b5-0164-4fd6-abff-c479423f5a16 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:54.667257 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d40b5-0164-4fd6-abff-c479423f5a16 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:54.667330 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d40b5-0164-4fd6-abff-c479423f5a16 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:54.668804 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 187/362] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:54.674078 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeadcad-7c81-4d85-9d70-3bf7b5b07f54 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:54.674371 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeadcad-7c81-4d85-9d70-3bf7b5b07f54 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:54.674647 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeadcad-7c81-4d85-9d70-3bf7b5b07f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:54.681751 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:54.697041 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-ebeadcad-7c81-4d85-9d70-3bf7b5b07f54 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:54.698252 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ebeadcad-7c81-4d85-9d70-3bf7b5b07f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:54.797742 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 176/363] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:54.971955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a647d1-229c-4936-8770-0ef90957f0bb None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:54.972263 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a647d1-229c-4936-8770-0ef90957f0bb None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:54.972540 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a647d1-229c-4936-8770-0ef90957f0bb None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:54.974419 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 188/364] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:54.979786 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060fa29f-bf59-4777-b9aa-e824b7d5ba71 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:54.980204 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060fa29f-bf59-4777-b9aa-e824b7d5ba71 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:54.981135 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060fa29f-bf59-4777-b9aa-e824b7d5ba71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:55.009514 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-060fa29f-bf59-4777-b9aa-e824b7d5ba71 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:55.010675 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-060fa29f-bf59-4777-b9aa-e824b7d5ba71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:55.101368 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 177/365] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:55.169638 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a647d1-229c-4936-8770-0ef90957f0bb None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:55.268079 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:55.294468 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a647d1-229c-4936-8770-0ef90957f0bb None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:55.341044 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb713ce2-a674-4827-bd8d-e1a562d3392e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:55.341684 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb713ce2-a674-4827-bd8d-e1a562d3392e None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:55.341961 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb713ce2-a674-4827-bd8d-e1a562d3392e None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:55.342226 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb713ce2-a674-4827-bd8d-e1a562d3392e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:55.361240 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb713ce2-a674-4827-bd8d-e1a562d3392e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:55.366353 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-eb713ce2-a674-4827-bd8d-e1a562d3392e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:22:55.366353 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:55.366353 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:55.366353 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:55.366353 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:55.366353 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:55.366353 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:55.366353 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:55.366353 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:55.366353 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:55.366353 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:55.366353 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:55.366353 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:55.366353 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:55.366353 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:55.366353 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:55.367226 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:55.367226 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:55.367226 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:55.367226 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:55.367226 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:55.367226 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:55.367226 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:55.367226 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:55.367226 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:55.367226 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:55.367226 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:55.367226 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:55.367226 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:55.367226 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:55.367226 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:55.367226 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:55.367991 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:55.367991 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:55.367991 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:55.367991 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:55.367991 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:55.367991 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:55.367991 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:55.367991 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:55.367991 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:55.367991 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:55.367991 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:22:55.367991 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:22:55.370820 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 189/366] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Nov 2 07:22:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:55.376927 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060fa29f-bf59-4777-b9aa-e824b7d5ba71 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:55.421383 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb713ce2-a674-4827-bd8d-e1a562d3392e None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:55.476399 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:55.550068 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060fa29f-bf59-4777-b9aa-e824b7d5ba71 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:55.575929 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb713ce2-a674-4827-bd8d-e1a562d3392e None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:55.612336 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee9cfe-b5db-459f-b563-23da2ba1eb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:55.613215 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee9cfe-b5db-459f-b563-23da2ba1eb49 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:55.613497 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee9cfe-b5db-459f-b563-23da2ba1eb49 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:55.613769 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee9cfe-b5db-459f-b563-23da2ba1eb49 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:55.624852 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee9cfe-b5db-459f-b563-23da2ba1eb49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:55.630682 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-35ee9cfe-b5db-459f-b563-23da2ba1eb49 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:22:55.630682 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:55.630682 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:55.630682 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:55.630682 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:55.630682 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:55.630682 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:55.630682 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:55.630682 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:55.630682 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:55.630682 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:55.630682 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:55.630682 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:55.630682 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:55.630682 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:55.630682 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:55.631595 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:55.631595 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:55.631595 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:55.631595 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:55.631595 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:55.631595 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:55.631595 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:55.631595 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:55.631595 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:55.631595 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:55.631595 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:55.631595 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:55.631595 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:55.631595 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:55.631595 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:55.631595 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:55.632680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:55.632680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:55.632680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:55.632680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:55.632680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:55.632680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:55.632680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:55.632680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:55.632680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:55.632680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:55.632680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:22:55.632680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:22:55.632680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 190/367] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Nov 2 07:22:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:55.636749 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae886a80-ba51-4c13-b401-33d16c9ff32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:55.637463 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae886a80-ba51-4c13-b401-33d16c9ff32c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:55.637803 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae886a80-ba51-4c13-b401-33d16c9ff32c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:55.638134 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae886a80-ba51-4c13-b401-33d16c9ff32c None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:55.638858 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae886a80-ba51-4c13-b401-33d16c9ff32c None admin] RBAC: Adding query filter params (name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:55.639217 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae886a80-ba51-4c13-b401-33d16c9ff32c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:55.641009 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee9cfe-b5db-459f-b563-23da2ba1eb49 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:55.649064 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae886a80-ba51-4c13-b401-33d16c9ff32c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:55.656457 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:55.669254 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 178/368] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Nov 2 07:22:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:55.674789 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae886a80-ba51-4c13-b401-33d16c9ff32c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:55.773940 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee9cfe-b5db-459f-b563-23da2ba1eb49 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:55.813505 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c19496a-9765-4f21-8cb9-34fdda1a665a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:55.814037 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19496a-9765-4f21-8cb9-34fdda1a665a None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:55.814312 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19496a-9765-4f21-8cb9-34fdda1a665a None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:55.814578 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19496a-9765-4f21-8cb9-34fdda1a665a None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:55.815227 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c19496a-9765-4f21-8cb9-34fdda1a665a None admin] RBAC: Adding query filter params (name=service) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:55.815530 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c19496a-9765-4f21-8cb9-34fdda1a665a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:55.817557 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c19496a-9765-4f21-8cb9-34fdda1a665a None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:55.827607 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 191/369] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Nov 2 07:22:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:55.834411 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e65bc-1be3-47a4-adb1-673b02e552ad None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:55.834905 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e65bc-1be3-47a4-adb1-673b02e552ad None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:55.835778 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e65bc-1be3-47a4-adb1-673b02e552ad None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:55.837327 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 192/370] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:55.838157 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e65bc-1be3-47a4-adb1-673b02e552ad None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:55.844735 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae886a80-ba51-4c13-b401-33d16c9ff32c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:55.870890 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:55.903378 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46d9fb-8819-49c7-89d4-dc4a69852e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:55.904036 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46d9fb-8819-49c7-89d4-dc4a69852e02 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:55.904363 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46d9fb-8819-49c7-89d4-dc4a69852e02 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:55.904633 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46d9fb-8819-49c7-89d4-dc4a69852e02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:55.916944 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46d9fb-8819-49c7-89d4-dc4a69852e02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:55.919162 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46d9fb-8819-49c7-89d4-dc4a69852e02 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:55.935792 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-6f46d9fb-8819-49c7-89d4-dc4a69852e02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:55.935792 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:55.935792 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:55.935792 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:55.935792 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:55.935792 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:55.935792 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:55.935792 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:55.935792 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:55.935792 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:55.935792 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:55.935792 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:55.935792 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:55.935792 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:55.935792 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:55.935792 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:55.936801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:55.936801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:55.936801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:55.936801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:55.936801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:55.936801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:55.936801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:55.936801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:55.936801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:55.936801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:55.936801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:55.936801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:55.936801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:55.936801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:55.936801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:55.936801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:55.936801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:55.937632 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:55.937632 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:55.937632 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:22:55.937632 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 179/371] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:55.938377 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075d1c5-02b5-49d1-9df0-31cf16a5558a None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:55.938377 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075d1c5-02b5-49d1-9df0-31cf16a5558a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:55.938655 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075d1c5-02b5-49d1-9df0-31cf16a5558a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:55.956982 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-4075d1c5-02b5-49d1-9df0-31cf16a5558a None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:55.958172 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4075d1c5-02b5-49d1-9df0-31cf16a5558a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:55.977408 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:56.020095 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e65bc-1be3-47a4-adb1-673b02e552ad None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:56.030174 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 180/372] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:56.030862 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075d1c5-02b5-49d1-9df0-31cf16a5558a None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:56.071525 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b3bba-00a4-46f0-b13d-34a566b5bf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:56.072614 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b3bba-00a4-46f0-b13d-34a566b5bf2a None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:56.073115 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b3bba-00a4-46f0-b13d-34a566b5bf2a None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:56.073595 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b3bba-00a4-46f0-b13d-34a566b5bf2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:56.089138 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b3bba-00a4-46f0-b13d-34a566b5bf2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:56.090980 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b3bba-00a4-46f0-b13d-34a566b5bf2a None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:56.111856 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-639b3bba-00a4-46f0-b13d-34a566b5bf2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:56.111856 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:56.111856 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:56.111856 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:56.111856 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:56.111856 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:56.111856 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:56.111856 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:56.111856 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:56.111856 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:56.111856 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:56.111856 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:56.111856 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:56.111856 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:56.111856 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:56.111856 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:56.112823 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:56.112823 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:56.112823 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:56.112823 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:56.112823 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:56.112823 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:56.112823 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:56.112823 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:56.112823 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:56.112823 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:56.112823 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:56.112823 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:56.112823 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:56.112823 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:56.112823 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:56.112823 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:56.112823 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:56.113821 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:56.113821 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:56.113821 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:22:56.115472 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 193/373] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:56.116928 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c830f9d-a3da-4926-a6bf-8c67be93c87b None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:56.117428 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c830f9d-a3da-4926-a6bf-8c67be93c87b None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:56.117946 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c830f9d-a3da-4926-a6bf-8c67be93c87b None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:56.123857 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 194/374] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:56.125171 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c830f9d-a3da-4926-a6bf-8c67be93c87b None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:56.149883 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075d1c5-02b5-49d1-9df0-31cf16a5558a None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:56.159591 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:56.193031 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05dafe-9a79-47b8-ac4b-4afec3c5bde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:56.193790 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05dafe-9a79-47b8-ac4b-4afec3c5bde3 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:56.194667 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05dafe-9a79-47b8-ac4b-4afec3c5bde3 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:56.195368 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05dafe-9a79-47b8-ac4b-4afec3c5bde3 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:56.196537 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa05dafe-9a79-47b8-ac4b-4afec3c5bde3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:56.197282 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa05dafe-9a79-47b8-ac4b-4afec3c5bde3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:56.198762 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa05dafe-9a79-47b8-ac4b-4afec3c5bde3 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:56.214158 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 181/375] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:56.217526 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b632c2-cfb0-4858-af6d-1d109166faf7 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:56.217944 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b632c2-cfb0-4858-af6d-1d109166faf7 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:56.218418 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b632c2-cfb0-4858-af6d-1d109166faf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:56.238892 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-17b632c2-cfb0-4858-af6d-1d109166faf7 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:56.240599 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-17b632c2-cfb0-4858-af6d-1d109166faf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:56.259144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c830f9d-a3da-4926-a6bf-8c67be93c87b None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:56.279621 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:56.299054 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc81be1-4c29-42ab-ba78-afcaa8e51f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:56.299811 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc81be1-4c29-42ab-ba78-afcaa8e51f6c None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:56.300369 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc81be1-4c29-42ab-ba78-afcaa8e51f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:56.300740 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc81be1-4c29-42ab-ba78-afcaa8e51f6c None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:56.301774 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc81be1-4c29-42ab-ba78-afcaa8e51f6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:56.302175 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc81be1-4c29-42ab-ba78-afcaa8e51f6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:56.303630 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc81be1-4c29-42ab-ba78-afcaa8e51f6c None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:56.316536 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 195/376] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:56.317497 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc81be1-4c29-42ab-ba78-afcaa8e51f6c None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:56.321254 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 182/377] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:56.322400 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b632c2-cfb0-4858-af6d-1d109166faf7 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:56.426439 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:56.433142 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b632c2-cfb0-4858-af6d-1d109166faf7 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:56.439292 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc81be1-4c29-42ab-ba78-afcaa8e51f6c None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:56.471269 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e38181-ab59-4245-a5e1-641278cde8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:56.472232 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e38181-ab59-4245-a5e1-641278cde8c3 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:56.472675 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e38181-ab59-4245-a5e1-641278cde8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:56.473350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e38181-ab59-4245-a5e1-641278cde8c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:56.478536 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ae971-90ff-43a5-8374-bc4530b0b83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:56.479194 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ae971-90ff-43a5-8374-bc4530b0b83e None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:56.479466 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ae971-90ff-43a5-8374-bc4530b0b83e None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:56.479726 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ae971-90ff-43a5-8374-bc4530b0b83e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:56.487117 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e38181-ab59-4245-a5e1-641278cde8c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:56.487707 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4ae971-90ff-43a5-8374-bc4530b0b83e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:56.489158 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4ae971-90ff-43a5-8374-bc4530b0b83e None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:56.493365 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-f3e38181-ab59-4245-a5e1-641278cde8c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:22:56.493365 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:56.493365 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:56.493365 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:56.493365 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:56.493365 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:56.493365 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:56.493365 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:56.493365 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:56.493365 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:56.493365 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:56.493365 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:56.493365 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:56.493365 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:56.493365 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:56.493365 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:56.494230 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:56.494230 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:56.494230 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:56.494230 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:56.494230 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:56.494230 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:56.494230 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:56.494230 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:56.494230 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:56.494230 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:56.494230 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:56.494230 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:56.494230 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:56.494230 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:56.494230 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:56.494230 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:56.495035 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:56.495035 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:56.495035 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:56.495035 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:56.495035 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:56.495035 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:56.495035 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:56.495035 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:56.495035 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:56.495035 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:56.495035 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:22:56.495035 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:22:56.498151 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 183/378] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Nov 2 07:22:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:56.499149 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e38181-ab59-4245-a5e1-641278cde8c3 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:56.507790 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-ee4ae971-90ff-43a5-8374-bc4530b0b83e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:22:56.507790 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:56.507790 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:56.507790 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:56.507790 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:56.507790 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:56.507790 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:56.507790 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:56.507790 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:56.507790 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:56.507790 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:56.507790 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:56.507790 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:22:56.507790 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:22:56.507790 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:22:56.507790 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:22:56.508715 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:56.508715 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:56.508715 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:22:56.508715 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:22:56.508715 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:22:56.508715 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:22:56.508715 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:56.508715 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:56.508715 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:56.508715 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:56.508715 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:56.508715 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:56.508715 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:56.508715 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:56.508715 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:56.508715 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:56.508715 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:56.508715 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:56.509597 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:56.509597 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:56.509597 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:22:56.509597 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:22:56.509597 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:22:56.509597 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:22:56.509597 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:22:56.509597 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:22:56.509597 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:22:56.509597 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:22:56.509597 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 196/379] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Nov 2 07:22:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:56.516624 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ae971-90ff-43a5-8374-bc4530b0b83e None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:56.560918 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:56.617258 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e38181-ab59-4245-a5e1-641278cde8c3 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:56.634097 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ae971-90ff-43a5-8374-bc4530b0b83e None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:56.655134 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28616335-38e2-4db6-bacb-0b267f4e5936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:56.655786 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28616335-38e2-4db6-bacb-0b267f4e5936 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:56.656042 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28616335-38e2-4db6-bacb-0b267f4e5936 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:56.656337 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28616335-38e2-4db6-bacb-0b267f4e5936 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:56.663973 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28616335-38e2-4db6-bacb-0b267f4e5936 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:56.665447 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28616335-38e2-4db6-bacb-0b267f4e5936 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:56.669775 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757ab97-3e78-47b4-b728-014a6bfe23ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:56.670378 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757ab97-3e78-47b4-b728-014a6bfe23ff None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:56.670652 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757ab97-3e78-47b4-b728-014a6bfe23ff None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:56.670920 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757ab97-3e78-47b4-b728-014a6bfe23ff None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:56.671566 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757ab97-3e78-47b4-b728-014a6bfe23ff None admin] RBAC: Adding query filter params (name=service) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:56.671863 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757ab97-3e78-47b4-b728-014a6bfe23ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:56.673264 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757ab97-3e78-47b4-b728-014a6bfe23ff None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:56.678861 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-28616335-38e2-4db6-bacb-0b267f4e5936 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 02 07:22:56.678861 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:56.678861 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:56.678861 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:56.678861 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:56.678861 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:56.678861 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:56.678861 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:56.678861 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:56.678861 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:56.678861 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:56.678861 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:56.678861 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:22:56.678861 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:22:56.678861 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:22:56.678861 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:22:56.679720 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:56.679720 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:56.679720 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:22:56.679720 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:22:56.679720 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:22:56.679720 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:22:56.679720 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:56.679720 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:56.679720 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:56.679720 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:56.679720 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:56.679720 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:56.679720 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:56.679720 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:56.679720 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:56.679720 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:56.679720 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:56.679720 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:56.680986 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:56.680986 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:56.680986 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:22:56.680986 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:22:56.680986 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:22:56.680986 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:22:56.680986 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:22:56.680986 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:22:56.680986 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Nov 02 07:22:56.680986 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:22:56.680986 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 184/380] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:56.680986 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28616335-38e2-4db6-bacb-0b267f4e5936 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:56.691494 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 197/381] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Nov 2 07:22:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:56.691494 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757ab97-3e78-47b4-b728-014a6bfe23ff None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:56.702381 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:56.785466 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28616335-38e2-4db6-bacb-0b267f4e5936 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:56.791742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:56.795164 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757ab97-3e78-47b4-b728-014a6bfe23ff None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:56.819826 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dcd469-b461-4807-882d-35cafa040c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:56.820464 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcd469-b461-4807-882d-35cafa040c37 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:56.820744 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcd469-b461-4807-882d-35cafa040c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:56.821017 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcd469-b461-4807-882d-35cafa040c37 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:56.821738 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dcd469-b461-4807-882d-35cafa040c37 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:56.822039 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dcd469-b461-4807-882d-35cafa040c37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:56.823477 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dcd469-b461-4807-882d-35cafa040c37 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:56.829367 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db10c7-3d53-48bb-9fd0-2a7fa28d0dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:56.829990 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db10c7-3d53-48bb-9fd0-2a7fa28d0dbe None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:56.830266 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db10c7-3d53-48bb-9fd0-2a7fa28d0dbe None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:56.830535 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db10c7-3d53-48bb-9fd0-2a7fa28d0dbe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:56.840736 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db10c7-3d53-48bb-9fd0-2a7fa28d0dbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:56.846203 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-a8db10c7-3d53-48bb-9fd0-2a7fa28d0dbe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:22:56.846203 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:56.846203 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:56.846203 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:56.846203 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:56.846203 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:56.846203 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:56.846203 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:56.846203 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:56.846203 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:56.846203 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:56.846203 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:56.846203 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:56.846203 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:56.846203 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:56.846203 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:56.847242 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:56.847242 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:56.847242 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:56.847242 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:56.847242 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:56.847242 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:56.847242 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:56.847242 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:56.847242 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:56.847242 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:56.847242 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:56.847242 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:56.847242 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:56.847242 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:56.847242 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:56.847242 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:56.848086 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:56.848086 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:56.848086 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:56.848086 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:56.848086 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:56.848086 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:56.848086 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:56.848086 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:56.848086 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:56.848086 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:56.848086 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:22:56.848086 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:22:56.848086 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 198/382] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Nov 2 07:22:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:56.848782 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db10c7-3d53-48bb-9fd0-2a7fa28d0dbe None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:56.862339 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 185/383] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Nov 2 07:22:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:56.863176 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dcd469-b461-4807-882d-35cafa040c37 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:56.939386 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:56.960508 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db10c7-3d53-48bb-9fd0-2a7fa28d0dbe None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:56.964779 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dcd469-b461-4807-882d-35cafa040c37 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:56.994871 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f57a5e-f814-4fa1-b33b-60cce9ec2dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:56.995470 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f57a5e-f814-4fa1-b33b-60cce9ec2dfe None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:56.995747 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f57a5e-f814-4fa1-b33b-60cce9ec2dfe None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:56.996016 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f57a5e-f814-4fa1-b33b-60cce9ec2dfe None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:56.997346 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f57a5e-f814-4fa1-b33b-60cce9ec2dfe None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:56.997729 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f57a5e-f814-4fa1-b33b-60cce9ec2dfe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:56.999147 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f57a5e-f814-4fa1-b33b-60cce9ec2dfe None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:56.999893 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04504ae0-8acb-4cf3-86a5-f9f812fdc740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:57.000556 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04504ae0-8acb-4cf3-86a5-f9f812fdc740 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:57.000833 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04504ae0-8acb-4cf3-86a5-f9f812fdc740 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:57.001102 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04504ae0-8acb-4cf3-86a5-f9f812fdc740 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:57.011530 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04504ae0-8acb-4cf3-86a5-f9f812fdc740 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:57.013271 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04504ae0-8acb-4cf3-86a5-f9f812fdc740 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:57.026889 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-04504ae0-8acb-4cf3-86a5-f9f812fdc740 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:57.026889 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:57.026889 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:57.026889 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:57.026889 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:57.026889 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:57.026889 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:57.026889 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:57.026889 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:57.026889 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:57.026889 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:57.026889 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:57.026889 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:57.026889 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:57.026889 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:57.026889 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:57.027752 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:57.027752 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:57.027752 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:57.027752 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:57.027752 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:57.027752 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:57.027752 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:57.027752 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:57.027752 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:57.027752 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:57.027752 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:57.027752 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:57.027752 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:57.027752 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:57.027752 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:57.027752 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:57.027752 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:57.028625 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:57.028625 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:57.028625 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:22:57.028625 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 186/384] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:57.029369 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228d3ec-c324-43a1-9164-2f831551a352 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:57.029645 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228d3ec-c324-43a1-9164-2f831551a352 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:57.029913 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228d3ec-c324-43a1-9164-2f831551a352 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:57.031132 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 187/385] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:22:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:57.031820 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228d3ec-c324-43a1-9164-2f831551a352 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:57.037650 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 199/386] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Nov 2 07:22:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:57.038481 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f57a5e-f814-4fa1-b33b-60cce9ec2dfe None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:57.057181 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:57.131875 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228d3ec-c324-43a1-9164-2f831551a352 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:57.136618 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f57a5e-f814-4fa1-b33b-60cce9ec2dfe None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:57.157945 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:57.166434 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f3233-fbbe-4cba-928d-bf682034210b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:57.167029 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f3233-fbbe-4cba-928d-bf682034210b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:57.167304 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f3233-fbbe-4cba-928d-bf682034210b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:57.167570 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f3233-fbbe-4cba-928d-bf682034210b None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:57.168821 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f3233-fbbe-4cba-928d-bf682034210b None admin] RBAC: Adding query filter params (name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:57.169116 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f3233-fbbe-4cba-928d-bf682034210b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:57.170494 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f3233-fbbe-4cba-928d-bf682034210b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:57.170941 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f6acc-68d2-4c7d-8d9c-19c55f88c9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:57.171571 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f6acc-68d2-4c7d-8d9c-19c55f88c9e3 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:57.171849 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f6acc-68d2-4c7d-8d9c-19c55f88c9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:57.172156 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f6acc-68d2-4c7d-8d9c-19c55f88c9e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:57.178385 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 188/387] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Nov 2 07:22:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:57.179159 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f3233-fbbe-4cba-928d-bf682034210b None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:57.186911 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f6acc-68d2-4c7d-8d9c-19c55f88c9e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:57.188398 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f6acc-68d2-4c7d-8d9c-19c55f88c9e3 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:57.203162 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-ca5f6acc-68d2-4c7d-8d9c-19c55f88c9e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:57.203162 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:57.203162 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:57.203162 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:57.203162 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:57.203162 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:57.203162 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:57.203162 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:57.203162 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:57.203162 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:57.203162 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:57.203162 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:57.203162 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:57.203162 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:57.203162 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:57.203162 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:57.204336 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:57.204336 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:57.204336 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:57.204336 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:57.204336 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:57.204336 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:57.204336 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:57.204336 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:57.204336 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:57.204336 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:57.204336 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:57.204336 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:57.204336 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:57.204336 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:57.204336 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:57.204336 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:57.204336 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:57.205542 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:57.205542 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:57.205542 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:22:57.205542 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 200/388] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:57.205542 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72330e2e-d6b1-4fca-9712-2c6169abe301 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:57.205821 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72330e2e-d6b1-4fca-9712-2c6169abe301 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:57.205893 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72330e2e-d6b1-4fca-9712-2c6169abe301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:57.223748 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-72330e2e-d6b1-4fca-9712-2c6169abe301 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:57.225048 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-72330e2e-d6b1-4fca-9712-2c6169abe301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:57.278992 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f3233-fbbe-4cba-928d-bf682034210b None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:57.286344 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:57.290654 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 201/389] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:57.291635 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72330e2e-d6b1-4fca-9712-2c6169abe301 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:57.313573 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c64ca-43d2-47be-881a-6107df096a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:57.314294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c64ca-43d2-47be-881a-6107df096a14 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:57.314639 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c64ca-43d2-47be-881a-6107df096a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:57.314973 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c64ca-43d2-47be-881a-6107df096a14 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:57.315613 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c64ca-43d2-47be-881a-6107df096a14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:57.315913 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c64ca-43d2-47be-881a-6107df096a14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:57.317302 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c64ca-43d2-47be-881a-6107df096a14 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:57.332828 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 189/390] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:57.332828 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c64ca-43d2-47be-881a-6107df096a14 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:57.383350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:57.404919 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72330e2e-d6b1-4fca-9712-2c6169abe301 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:57.437351 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c64ca-43d2-47be-881a-6107df096a14 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:57.442560 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8e558-dade-4b43-bfbc-8cb81bc8552e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:57.443198 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8e558-dade-4b43-bfbc-8cb81bc8552e None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:57.443476 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8e558-dade-4b43-bfbc-8cb81bc8552e None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:57.443747 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8e558-dade-4b43-bfbc-8cb81bc8552e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:57.455572 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8e558-dade-4b43-bfbc-8cb81bc8552e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:57.457319 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8e558-dade-4b43-bfbc-8cb81bc8552e None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:57.473049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-46b8e558-dade-4b43-bfbc-8cb81bc8552e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:57.473049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:57.473049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:57.473049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:57.473049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:57.473049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:57.473049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:57.473049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:57.473049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:57.473049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:57.473049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:57.473049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:57.473049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:57.473049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:57.473049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:57.473049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:57.473939 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:57.473939 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:57.473939 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:57.473939 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:57.473939 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:57.473939 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:57.473939 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:57.473939 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:57.473939 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:57.473939 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:57.473939 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:57.473939 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:57.473939 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:57.473939 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:57.473939 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:57.473939 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:57.473939 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:57.474802 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:57.474802 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:57.474802 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:22:57.474802 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 202/391] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:57.475010 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8e558-dade-4b43-bfbc-8cb81bc8552e None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:57.476265 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005c9a7-66b2-4833-bee7-0f40fc561d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:57.476892 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005c9a7-66b2-4833-bee7-0f40fc561d8d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:57.477168 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005c9a7-66b2-4833-bee7-0f40fc561d8d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:57.477436 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005c9a7-66b2-4833-bee7-0f40fc561d8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:57.488872 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005c9a7-66b2-4833-bee7-0f40fc561d8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:57.490335 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005c9a7-66b2-4833-bee7-0f40fc561d8d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:57.504751 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-e005c9a7-66b2-4833-bee7-0f40fc561d8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:57.504751 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:57.504751 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:57.504751 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:57.504751 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:57.504751 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:57.504751 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:57.504751 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:57.504751 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:57.504751 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:57.504751 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:57.504751 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:57.504751 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:57.504751 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:57.504751 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:57.504751 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:57.505638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:57.505638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:57.505638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:57.505638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:57.505638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:57.505638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:57.505638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:57.505638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:57.505638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:57.505638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:57.505638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:57.505638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:57.505638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:57.505638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:57.505638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:57.505638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:57.505638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:57.506538 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:57.506538 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:57.506538 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:22:57.506538 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 190/392] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:57.506748 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005c9a7-66b2-4833-bee7-0f40fc561d8d None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:57.541965 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:57.594884 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8e558-dade-4b43-bfbc-8cb81bc8552e None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:57.616350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:57.619019 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005c9a7-66b2-4833-bee7-0f40fc561d8d None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:57.626935 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ea56e-a132-42a4-9d1d-624563d3b2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:57.627536 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ea56e-a132-42a4-9d1d-624563d3b2ee None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:57.627811 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ea56e-a132-42a4-9d1d-624563d3b2ee None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:57.628095 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ea56e-a132-42a4-9d1d-624563d3b2ee None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:57.628720 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ea56e-a132-42a4-9d1d-624563d3b2ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:57.629278 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ea56e-a132-42a4-9d1d-624563d3b2ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:57.631399 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ea56e-a132-42a4-9d1d-624563d3b2ee None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:57.642535 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 203/393] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:57.643352 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ea56e-a132-42a4-9d1d-624563d3b2ee None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:57.654294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c923cb6-78af-4187-8fee-8fa938aac117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:57.654923 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c923cb6-78af-4187-8fee-8fa938aac117 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:57.655199 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c923cb6-78af-4187-8fee-8fa938aac117 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:57.655469 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c923cb6-78af-4187-8fee-8fa938aac117 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:57.662557 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c923cb6-78af-4187-8fee-8fa938aac117 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:57.664003 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c923cb6-78af-4187-8fee-8fa938aac117 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:57.675281 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-3c923cb6-78af-4187-8fee-8fa938aac117 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 07:22:57.675281 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:57.675281 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:57.675281 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:57.675281 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:57.675281 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:57.675281 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:57.675281 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:57.675281 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:57.675281 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:57.675281 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:57.675281 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:57.675281 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:22:57.675281 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:22:57.675281 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:22:57.675281 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:22:57.676356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:57.676356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:57.676356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:22:57.676356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:22:57.676356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:22:57.676356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:22:57.676356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:57.676356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:57.676356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:57.676356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:57.676356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:57.676356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:57.676356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:57.676356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:57.676356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:57.676356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:57.676356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:57.676356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:57.677597 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:57.677597 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:57.677597 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:22:57.677597 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:22:57.677597 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:22:57.677597 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:22:57.677597 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:22:57.677597 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:22:57.677597 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 07:22:57.677597 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:22:57.677597 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 191/394] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:57.677597 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c923cb6-78af-4187-8fee-8fa938aac117 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:57.742770 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ea56e-a132-42a4-9d1d-624563d3b2ee None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:57.755891 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:57.776144 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c923cb6-78af-4187-8fee-8fa938aac117 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:57.778542 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d34292-b25f-46d3-a98b-0a9971d2b4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:57.779157 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d34292-b25f-46d3-a98b-0a9971d2b4a4 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:57.779427 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d34292-b25f-46d3-a98b-0a9971d2b4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:57.779698 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d34292-b25f-46d3-a98b-0a9971d2b4a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:57.780356 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d34292-b25f-46d3-a98b-0a9971d2b4a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:57.780655 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d34292-b25f-46d3-a98b-0a9971d2b4a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:57.782058 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d34292-b25f-46d3-a98b-0a9971d2b4a4 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:57.793888 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 204/395] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:57.794693 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d34292-b25f-46d3-a98b-0a9971d2b4a4 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:57.809951 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0fc2d-d7cc-44bd-8919-61956442f23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:57.810642 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0fc2d-d7cc-44bd-8919-61956442f23e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:57.810918 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0fc2d-d7cc-44bd-8919-61956442f23e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:57.811188 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0fc2d-d7cc-44bd-8919-61956442f23e None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:57.811817 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e0fc2d-d7cc-44bd-8919-61956442f23e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:57.812144 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e0fc2d-d7cc-44bd-8919-61956442f23e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:57.813534 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e0fc2d-d7cc-44bd-8919-61956442f23e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:57.825834 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 192/396] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:57.826456 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0fc2d-d7cc-44bd-8919-61956442f23e None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:57.847920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:57.901734 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d34292-b25f-46d3-a98b-0a9971d2b4a4 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:57.925918 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0fc2d-d7cc-44bd-8919-61956442f23e None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:57.934902 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4899b0-49e5-48c7-b866-9ff37e6c9604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:57.935535 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4899b0-49e5-48c7-b866-9ff37e6c9604 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:57.935809 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4899b0-49e5-48c7-b866-9ff37e6c9604 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:57.936098 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4899b0-49e5-48c7-b866-9ff37e6c9604 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:57.950363 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4899b0-49e5-48c7-b866-9ff37e6c9604 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:57.951813 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4899b0-49e5-48c7-b866-9ff37e6c9604 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:57.959543 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee06bc-2daa-4138-8c7e-1b3f681fb7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:57.960191 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee06bc-2daa-4138-8c7e-1b3f681fb7f3 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:57.960471 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee06bc-2daa-4138-8c7e-1b3f681fb7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:57.960736 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee06bc-2daa-4138-8c7e-1b3f681fb7f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:57.966185 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-6e4899b0-49e5-48c7-b866-9ff37e6c9604 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:57.966185 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:57.966185 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:57.966185 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:57.966185 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:57.966185 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:57.966185 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:57.966185 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:57.966185 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:57.966185 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:57.966185 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:57.966185 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:57.966185 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:57.966185 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:57.966185 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:57.966185 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:57.967054 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:57.967054 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:57.967054 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:57.967054 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:57.967054 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:57.967054 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:57.967054 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:57.967054 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:57.967054 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:57.967054 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:57.967054 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:57.967054 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:57.967054 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:57.967054 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:57.967054 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:57.967054 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:57.967054 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:57.967874 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:57.967874 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:57.967874 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:22:57.967874 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 205/397] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:57.968132 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4899b0-49e5-48c7-b866-9ff37e6c9604 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:57.972436 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee06bc-2daa-4138-8c7e-1b3f681fb7f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:57.973774 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee06bc-2daa-4138-8c7e-1b3f681fb7f3 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:57.986166 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-c0ee06bc-2daa-4138-8c7e-1b3f681fb7f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:22:57.986166 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:57.986166 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:57.986166 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:57.986166 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:57.986166 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:57.986166 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:57.986166 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:57.986166 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:57.986166 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:57.986166 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:57.986166 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:57.986166 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:22:57.986166 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:22:57.986166 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:22:57.987057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:22:57.987057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:57.987057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:57.987057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:57.987057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:57.987057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:57.987057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:57.987057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:57.987057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:57.987057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:57.987057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:57.987057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:57.987057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:57.987057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:57.987057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:57.987057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:57.987057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:57.988682 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:22:57.988682 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:22:57.988682 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:22:57.988682 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:22:57.988682 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:22:57.988682 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:22:57.988682 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:22:57.988682 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:22:57.988682 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 193/398] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Nov 2 07:22:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:57.988682 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee06bc-2daa-4138-8c7e-1b3f681fb7f3 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:57.995444 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:58.066649 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:58.071066 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4899b0-49e5-48c7-b866-9ff37e6c9604 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:58.084873 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee06bc-2daa-4138-8c7e-1b3f681fb7f3 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:58.106832 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eff8e0-3da3-4a93-bebb-5df32870886f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:58.107430 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eff8e0-3da3-4a93-bebb-5df32870886f None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:58.107705 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eff8e0-3da3-4a93-bebb-5df32870886f None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:58.107972 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eff8e0-3da3-4a93-bebb-5df32870886f None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:58.108730 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eff8e0-3da3-4a93-bebb-5df32870886f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:58.109029 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eff8e0-3da3-4a93-bebb-5df32870886f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:58.110447 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eff8e0-3da3-4a93-bebb-5df32870886f None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:58.119616 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fdb4d-2ff1-49d3-9802-a78d484bd597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:58.120328 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fdb4d-2ff1-49d3-9802-a78d484bd597 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:58.120608 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fdb4d-2ff1-49d3-9802-a78d484bd597 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:58.120879 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fdb4d-2ff1-49d3-9802-a78d484bd597 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:58.127421 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 206/399] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Nov 2 07:22:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:58.127880 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56fdb4d-2ff1-49d3-9802-a78d484bd597 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:58.128236 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eff8e0-3da3-4a93-bebb-5df32870886f None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:58.129694 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56fdb4d-2ff1-49d3-9802-a78d484bd597 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:58.141929 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-a56fdb4d-2ff1-49d3-9802-a78d484bd597 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:22:58.141929 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:58.141929 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:58.141929 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:58.141929 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:58.141929 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:58.141929 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:58.141929 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:58.141929 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:58.141929 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:58.141929 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:58.141929 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:58.141929 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:22:58.141929 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:22:58.141929 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:22:58.142935 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:22:58.142935 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:58.142935 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:58.142935 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:58.142935 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:58.142935 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:58.142935 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:58.142935 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:58.142935 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:58.142935 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:58.142935 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:58.142935 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:58.142935 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:58.142935 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:58.142935 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:58.142935 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:58.142935 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:58.143789 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:22:58.143789 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:22:58.143789 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:22:58.143789 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:22:58.143789 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:22:58.143789 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:22:58.143789 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:22:58.143789 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:22:58.143789 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 194/400] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Nov 2 07:22:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:58.143789 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fdb4d-2ff1-49d3-9802-a78d484bd597 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:58.218602 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:58.236446 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eff8e0-3da3-4a93-bebb-5df32870886f None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:58.242912 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fdb4d-2ff1-49d3-9802-a78d484bd597 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:58.271245 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e82d3-1ef2-47bf-aa3b-d6eac4aeff5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:58.271892 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e82d3-1ef2-47bf-aa3b-d6eac4aeff5e None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:58.272197 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e82d3-1ef2-47bf-aa3b-d6eac4aeff5e None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:58.272469 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e82d3-1ef2-47bf-aa3b-d6eac4aeff5e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:58.277313 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8cf1eb-42e2-41f1-983c-3891eb135854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:58.278109 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cf1eb-42e2-41f1-983c-3891eb135854 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:58.278385 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cf1eb-42e2-41f1-983c-3891eb135854 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:58.278650 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cf1eb-42e2-41f1-983c-3891eb135854 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:58.279272 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8cf1eb-42e2-41f1-983c-3891eb135854 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:58.279460 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e82d3-1ef2-47bf-aa3b-d6eac4aeff5e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:58.279558 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8cf1eb-42e2-41f1-983c-3891eb135854 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:58.280917 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e82d3-1ef2-47bf-aa3b-d6eac4aeff5e None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:58.281023 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8cf1eb-42e2-41f1-983c-3891eb135854 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:58.289324 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:58.292015 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-6b4e82d3-1ef2-47bf-aa3b-d6eac4aeff5e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 02 07:22:58.292015 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:58.292015 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:58.292015 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:58.292015 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:58.292015 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:58.292015 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:58.292015 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:58.292015 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:58.292015 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:58.292015 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:58.292015 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:58.292015 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:22:58.292015 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:22:58.292015 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:22:58.292015 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:22:58.292983 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:58.292983 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:58.292983 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:22:58.292983 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:22:58.292983 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:22:58.292983 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:22:58.292983 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:58.292983 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:58.292983 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:58.292983 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:58.292983 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:58.292983 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:58.292983 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:58.292983 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:58.292983 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:58.292983 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:58.292983 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:58.292983 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:58.294640 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:58.294640 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:58.294640 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:22:58.294640 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:22:58.294640 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:22:58.294640 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:22:58.294640 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:22:58.294640 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:22:58.294640 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Nov 02 07:22:58.294640 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:22:58.295142 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 195/401] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:58.295209 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 207/402] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Nov 2 07:22:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:58.295209 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e82d3-1ef2-47bf-aa3b-d6eac4aeff5e None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:58.295628 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8cf1eb-42e2-41f1-983c-3891eb135854 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:58.393341 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e82d3-1ef2-47bf-aa3b-d6eac4aeff5e None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:58.393955 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8cf1eb-42e2-41f1-983c-3891eb135854 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:58.425865 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a3df2-a99c-417e-afda-029c4754f91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:58.426505 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a3df2-a99c-417e-afda-029c4754f91b None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:58.426782 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a3df2-a99c-417e-afda-029c4754f91b None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:58.426877 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbf05a-b292-4eeb-9415-ebf89dfc696f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:58.427054 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a3df2-a99c-417e-afda-029c4754f91b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:58.427370 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbf05a-b292-4eeb-9415-ebf89dfc696f None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:58.427642 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbf05a-b292-4eeb-9415-ebf89dfc696f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:58.427909 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbf05a-b292-4eeb-9415-ebf89dfc696f None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:58.428612 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fbf05a-b292-4eeb-9415-ebf89dfc696f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:58.428915 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fbf05a-b292-4eeb-9415-ebf89dfc696f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:58.430332 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fbf05a-b292-4eeb-9415-ebf89dfc696f None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:58.437309 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a3df2-a99c-417e-afda-029c4754f91b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:58.438814 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a3df2-a99c-417e-afda-029c4754f91b None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:58.440534 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:58.448062 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 196/403] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Nov 2 07:22:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:58.448825 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbf05a-b292-4eeb-9415-ebf89dfc696f None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:58.454725 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-715a3df2-a99c-417e-afda-029c4754f91b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:58.454725 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:58.454725 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:58.454725 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:58.454725 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:58.454725 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:58.454725 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:58.454725 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:58.454725 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:58.454725 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:58.454725 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:58.454725 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:58.454725 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:58.454725 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:58.454725 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:58.454725 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:58.460325 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:58.460325 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:58.460325 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:58.460325 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:58.460325 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:58.460325 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:58.460325 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:58.460325 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:58.460325 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:58.460325 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:58.460325 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:58.460325 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:58.460325 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:58.460325 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:58.460325 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:58.460325 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:58.460325 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:58.461338 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:58.461338 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:58.461338 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:22:58.461338 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 208/404] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:58.461338 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a3df2-a99c-417e-afda-029c4754f91b None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:58.506771 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:58.546661 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbf05a-b292-4eeb-9415-ebf89dfc696f None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:58.555391 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a3df2-a99c-417e-afda-029c4754f91b None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:58.579602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50898a5a-c121-450f-8f83-bc5e7622d3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:58.580229 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50898a5a-c121-450f-8f83-bc5e7622d3bb None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:58.580508 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50898a5a-c121-450f-8f83-bc5e7622d3bb None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:58.580778 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50898a5a-c121-450f-8f83-bc5e7622d3bb None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:58.581437 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50898a5a-c121-450f-8f83-bc5e7622d3bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:58.581733 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50898a5a-c121-450f-8f83-bc5e7622d3bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:58.583143 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50898a5a-c121-450f-8f83-bc5e7622d3bb None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:58.588379 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18386e11-70c3-4712-afe8-54e10b7e12ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:58.588970 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18386e11-70c3-4712-afe8-54e10b7e12ee None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:58.589245 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18386e11-70c3-4712-afe8-54e10b7e12ee None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:58.589512 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18386e11-70c3-4712-afe8-54e10b7e12ee None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:58.590663 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18386e11-70c3-4712-afe8-54e10b7e12ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:58.592548 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18386e11-70c3-4712-afe8-54e10b7e12ee None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:58.594747 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 197/405] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Nov 2 07:22:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:58.595519 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50898a5a-c121-450f-8f83-bc5e7622d3bb None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:58.674394 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 209/406] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Nov 2 07:22:58 2022] POST /identity/v3/users => generated 247 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:22:58.675037 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18386e11-70c3-4712-afe8-54e10b7e12ee None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:58.706729 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50898a5a-c121-450f-8f83-bc5e7622d3bb None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:58.730426 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:58.736466 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:58.747278 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d5ead-0390-4d47-9b32-07667c1401e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:58.747904 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d5ead-0390-4d47-9b32-07667c1401e1 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:58.748212 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d5ead-0390-4d47-9b32-07667c1401e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:58.748481 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d5ead-0390-4d47-9b32-07667c1401e1 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:58.749216 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d5ead-0390-4d47-9b32-07667c1401e1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:58.749521 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d5ead-0390-4d47-9b32-07667c1401e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:58.750976 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d5ead-0390-4d47-9b32-07667c1401e1 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:58.775294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 198/407] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Nov 2 07:22:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:58.775294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d5ead-0390-4d47-9b32-07667c1401e1 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:58.799547 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18386e11-70c3-4712-afe8-54e10b7e12ee None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:58.841133 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c76f13-de77-484f-809e-b356da107e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:58.842064 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c76f13-de77-484f-809e-b356da107e77 None admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:58.842515 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c76f13-de77-484f-809e-b356da107e77 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:58.842785 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c76f13-de77-484f-809e-b356da107e77 None admin] PATH_INFO: `/v3/projects/2c3bf3e930dd407f8401c0487edc8c20/users/232210eabdfd4969a348d7333c50c438/roles/4d61be0c9e7b454abd3b0a3330428290` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:58.860766 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c76f13-de77-484f-809e-b356da107e77 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c3bf3e930dd407f8401c0487edc8c20, user_id=232210eabdfd4969a348d7333c50c438, role_id=4d61be0c9e7b454abd3b0a3330428290)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:58.862216 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c76f13-de77-484f-809e-b356da107e77 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:58.885243 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d5ead-0390-4d47-9b32-07667c1401e1 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:58.918861 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557284cc-0339-4cb0-a556-9eabbeebaa1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:58.919499 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557284cc-0339-4cb0-a556-9eabbeebaa1e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:58.919769 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557284cc-0339-4cb0-a556-9eabbeebaa1e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:58.920032 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557284cc-0339-4cb0-a556-9eabbeebaa1e None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:58.920683 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557284cc-0339-4cb0-a556-9eabbeebaa1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:58.920978 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557284cc-0339-4cb0-a556-9eabbeebaa1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:58.922345 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557284cc-0339-4cb0-a556-9eabbeebaa1e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:58.934766 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 199/408] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:58.936384 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557284cc-0339-4cb0-a556-9eabbeebaa1e None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:58.967677 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 210/409] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Nov 2 07:22:58 2022] PUT /identity/v3/projects/2c3bf3e930dd407f8401c0487edc8c20/users/232210eabdfd4969a348d7333c50c438/roles/4d61be0c9e7b454abd3b0a3330428290 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:22:58.970337 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c76f13-de77-484f-809e-b356da107e77 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:58.990627 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:59.062158 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557284cc-0339-4cb0-a556-9eabbeebaa1e None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:59.102418 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474762d-c37a-4ce6-b73a-06ca4422166e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:59.103379 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474762d-c37a-4ce6-b73a-06ca4422166e None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:59.103752 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474762d-c37a-4ce6-b73a-06ca4422166e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:59.104256 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474762d-c37a-4ce6-b73a-06ca4422166e None admin] PATH_INFO: `/v3/projects/2c3bf3e930dd407f8401c0487edc8c20/users/475f6e94957a4ae2b1248c8035231ebd/roles/4d61be0c9e7b454abd3b0a3330428290` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:59.112501 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:59.116651 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c76f13-de77-484f-809e-b356da107e77 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:59.122609 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474762d-c37a-4ce6-b73a-06ca4422166e None admin] RBAC: Authorizing `identity:create_grant(project_id=2c3bf3e930dd407f8401c0487edc8c20, user_id=475f6e94957a4ae2b1248c8035231ebd, role_id=4d61be0c9e7b454abd3b0a3330428290)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:59.124238 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474762d-c37a-4ce6-b73a-06ca4422166e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:59.157197 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7358eb7f-2f19-4a8c-bd8e-4d09f74d8952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:59.157844 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358eb7f-2f19-4a8c-bd8e-4d09f74d8952 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:59.158197 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358eb7f-2f19-4a8c-bd8e-4d09f74d8952 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:59.158501 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358eb7f-2f19-4a8c-bd8e-4d09f74d8952 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:59.169861 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7358eb7f-2f19-4a8c-bd8e-4d09f74d8952 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:59.171331 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7358eb7f-2f19-4a8c-bd8e-4d09f74d8952 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:59.186815 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-7358eb7f-2f19-4a8c-bd8e-4d09f74d8952 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:59.186815 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:59.186815 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:59.186815 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:59.186815 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:59.186815 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:59.186815 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:59.186815 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:59.186815 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:59.186815 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:59.186815 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:59.186815 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:59.186815 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:59.186815 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:59.186815 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:59.186815 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:59.187902 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:59.187902 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:59.187902 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:59.187902 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:59.187902 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:59.187902 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:59.187902 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:59.187902 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:59.187902 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:59.187902 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:59.187902 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:59.187902 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:59.187902 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:59.187902 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:59.187902 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:59.187902 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:59.187902 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:59.188787 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:59.188787 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:59.188787 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:22:59.188787 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 211/410] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:59.188787 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7358eb7f-2f19-4a8c-bd8e-4d09f74d8952 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:59.211942 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 200/411] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Nov 2 07:22:58 2022] PUT /identity/v3/projects/2c3bf3e930dd407f8401c0487edc8c20/users/475f6e94957a4ae2b1248c8035231ebd/roles/4d61be0c9e7b454abd3b0a3330428290 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:22:59.215740 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474762d-c37a-4ce6-b73a-06ca4422166e None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:59.378382 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7358eb7f-2f19-4a8c-bd8e-4d09f74d8952 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:59.390941 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:59.414901 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474762d-c37a-4ce6-b73a-06ca4422166e None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:59.439717 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b655c-35a1-42f7-bc7e-e3e09125a770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:59.441015 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b655c-35a1-42f7-bc7e-e3e09125a770 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:59.444621 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b655c-35a1-42f7-bc7e-e3e09125a770 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:59.444621 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b655c-35a1-42f7-bc7e-e3e09125a770 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:59.451062 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b655c-35a1-42f7-bc7e-e3e09125a770 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:59.453506 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b655c-35a1-42f7-bc7e-e3e09125a770 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:59.461145 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3beec36-b586-43dd-b4d0-5790700b11b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:59.461936 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3beec36-b586-43dd-b4d0-5790700b11b3 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:59.462253 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3beec36-b586-43dd-b4d0-5790700b11b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:59.462559 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3beec36-b586-43dd-b4d0-5790700b11b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:59.463775 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3beec36-b586-43dd-b4d0-5790700b11b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:59.465657 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3beec36-b586-43dd-b4d0-5790700b11b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:59.467044 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3beec36-b586-43dd-b4d0-5790700b11b3 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:59.471996 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-fd8b655c-35a1-42f7-bc7e-e3e09125a770 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:22:59.471996 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:59.471996 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:59.471996 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:59.471996 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:59.471996 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:59.471996 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:59.471996 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:59.471996 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:59.471996 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:59.471996 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:59.471996 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:59.471996 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:22:59.471996 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:22:59.471996 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:22:59.472859 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:22:59.472859 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:59.472859 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:59.472859 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:59.472859 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:59.472859 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:59.472859 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:59.472859 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:59.472859 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:59.472859 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:59.472859 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:59.472859 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:59.472859 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:59.472859 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:59.472859 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:59.472859 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:59.472859 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:59.473680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:22:59.473680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:22:59.473680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:22:59.473680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:22:59.473680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:22:59.473680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:22:59.473680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:22:59.473680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:22:59.477135 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 212/412] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Nov 2 07:22:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:59.482195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b655c-35a1-42f7-bc7e-e3e09125a770 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:59.489532 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 201/413] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:59.492849 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3beec36-b586-43dd-b4d0-5790700b11b3 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:59.541444 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:59.598472 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b655c-35a1-42f7-bc7e-e3e09125a770 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:59.607053 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3beec36-b586-43dd-b4d0-5790700b11b3 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:59.640551 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255387af-3372-4d85-9351-39a00af622b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:59.641686 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255387af-3372-4d85-9351-39a00af622b2 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:59.642171 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255387af-3372-4d85-9351-39a00af622b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:59.642620 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255387af-3372-4d85-9351-39a00af622b2 None admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:59.643495 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa57de4-bc05-4a96-a9dd-228250e1b889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:59.643803 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255387af-3372-4d85-9351-39a00af622b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:59.644307 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255387af-3372-4d85-9351-39a00af622b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:59.644427 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa57de4-bc05-4a96-a9dd-228250e1b889 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:59.644649 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa57de4-bc05-4a96-a9dd-228250e1b889 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:59.644987 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa57de4-bc05-4a96-a9dd-228250e1b889 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:59.646654 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255387af-3372-4d85-9351-39a00af622b2 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:59.653795 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa57de4-bc05-4a96-a9dd-228250e1b889 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:59.655343 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa57de4-bc05-4a96-a9dd-228250e1b889 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:59.668648 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 213/414] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Nov 2 07:22:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:59.673482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-caa57de4-bc05-4a96-a9dd-228250e1b889 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:22:59.673482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:59.673482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:59.673482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:59.673482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:59.673482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:59.673482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:59.673482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:59.673482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:59.673482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:59.673482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:59.673482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:59.673482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:22:59.673482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:22:59.673482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:22:59.674294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:22:59.674294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:59.674294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:59.674294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:59.674294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:59.674294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:59.674294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:59.674294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:59.674294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:59.674294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:59.674294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:59.674294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:59.674294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:59.674294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:59.674294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:59.674294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:59.674294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:59.675123 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:22:59.675123 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:22:59.675123 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:22:59.675123 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:22:59.675123 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:22:59.675123 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:22:59.675123 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:22:59.675123 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:22:59.675123 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 202/415] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Nov 2 07:22:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:59.676656 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255387af-3372-4d85-9351-39a00af622b2 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:59.677003 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa57de4-bc05-4a96-a9dd-228250e1b889 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:59.692653 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:59.778209 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:59.812569 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255387af-3372-4d85-9351-39a00af622b2 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:59.858310 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4b5d0-8901-4e8e-8406-391ef80fdd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:59.858972 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4b5d0-8901-4e8e-8406-391ef80fdd6e None admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:59.864363 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4b5d0-8901-4e8e-8406-391ef80fdd6e None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:59.864680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4b5d0-8901-4e8e-8406-391ef80fdd6e None admin] PATH_INFO: `/v3/projects/2c3bf3e930dd407f8401c0487edc8c20/users/6c09b7eff03645ab9b7252ea96543719/roles/4d61be0c9e7b454abd3b0a3330428290` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:59.880286 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa57de4-bc05-4a96-a9dd-228250e1b889 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:59.901026 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4b5d0-8901-4e8e-8406-391ef80fdd6e None admin] RBAC: Authorizing `identity:create_grant(project_id=2c3bf3e930dd407f8401c0487edc8c20, user_id=6c09b7eff03645ab9b7252ea96543719, role_id=4d61be0c9e7b454abd3b0a3330428290)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:59.902533 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4b5d0-8901-4e8e-8406-391ef80fdd6e None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:59.920132 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b524d-4d66-4faa-a876-40a5fba6e625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:59.928208 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b524d-4d66-4faa-a876-40a5fba6e625 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:59.928208 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b524d-4d66-4faa-a876-40a5fba6e625 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:59.928208 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b524d-4d66-4faa-a876-40a5fba6e625 None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:59.928208 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b524d-4d66-4faa-a876-40a5fba6e625 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:59.928208 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b524d-4d66-4faa-a876-40a5fba6e625 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:59.928208 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b524d-4d66-4faa-a876-40a5fba6e625 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:59.942532 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 203/416] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Nov 2 07:22:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:59.944016 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b524d-4d66-4faa-a876-40a5fba6e625 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:00.016415 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:00.022192 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 214/417] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Nov 2 07:22:59 2022] PUT /identity/v3/projects/2c3bf3e930dd407f8401c0487edc8c20/users/6c09b7eff03645ab9b7252ea96543719/roles/4d61be0c9e7b454abd3b0a3330428290 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:23:00.053841 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b524d-4d66-4faa-a876-40a5fba6e625 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:00.091234 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbea2ba-156d-4e22-babf-0d4e84aba9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:00.091902 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbea2ba-156d-4e22-babf-0d4e84aba9e9 None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:00.092278 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbea2ba-156d-4e22-babf-0d4e84aba9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:00.092592 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbea2ba-156d-4e22-babf-0d4e84aba9e9 None admin] PATH_INFO: `/v3/projects/2c3bf3e930dd407f8401c0487edc8c20/users/c35fe87fc263440980ce70680748e5af/roles/4d61be0c9e7b454abd3b0a3330428290` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:00.109537 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbea2ba-156d-4e22-babf-0d4e84aba9e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c3bf3e930dd407f8401c0487edc8c20, user_id=c35fe87fc263440980ce70680748e5af, role_id=4d61be0c9e7b454abd3b0a3330428290)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:00.110985 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbea2ba-156d-4e22-babf-0d4e84aba9e9 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:00.191707 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 204/418] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Nov 2 07:22:59 2022] PUT /identity/v3/projects/2c3bf3e930dd407f8401c0487edc8c20/users/c35fe87fc263440980ce70680748e5af/roles/4d61be0c9e7b454abd3b0a3330428290 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:23:01.167590 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2c9c1-5342-46f5-babb-8ae8d044b36c None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:01.168171 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2c9c1-5342-46f5-babb-8ae8d044b36c None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:01.168248 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2c9c1-5342-46f5-babb-8ae8d044b36c None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:01.170449 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 215/419] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:01.176089 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95adca-2491-4d1d-8a89-9185c30f777e None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:01.176498 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95adca-2491-4d1d-8a89-9185c30f777e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:01.176713 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95adca-2491-4d1d-8a89-9185c30f777e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:01.202487 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-7a95adca-2491-4d1d-8a89-9185c30f777e None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:01.203614 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7a95adca-2491-4d1d-8a89-9185c30f777e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:01.291986 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 205/420] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:23:01.789913 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8657de-99db-42c0-95f4-9f8e32e904a2 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:01.790623 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8657de-99db-42c0-95f4-9f8e32e904a2 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:01.791100 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8657de-99db-42c0-95f4-9f8e32e904a2 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:01.792651 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 216/421] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:01.798066 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637e6f0-8e05-45d0-87c6-4aeb4798455c None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:01.798627 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637e6f0-8e05-45d0-87c6-4aeb4798455c None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:01.799179 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637e6f0-8e05-45d0-87c6-4aeb4798455c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:01.822366 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-2637e6f0-8e05-45d0-87c6-4aeb4798455c None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:01.823870 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2637e6f0-8e05-45d0-87c6-4aeb4798455c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:01.859984 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1aadf-0f14-4a29-b031-14db1396738a None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:01.860615 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1aadf-0f14-4a29-b031-14db1396738a None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:01.861125 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1aadf-0f14-4a29-b031-14db1396738a None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:01.862680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 217/422] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:01.864090 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1aadf-0f14-4a29-b031-14db1396738a None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:01.887981 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:01.914557 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 206/423] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:23:01.919816 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8dd97c-2d52-4dd7-a00a-aef5c2e2cdea None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:01.919816 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8dd97c-2d52-4dd7-a00a-aef5c2e2cdea None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:01.919816 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8dd97c-2d52-4dd7-a00a-aef5c2e2cdea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:01.948338 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-fd8dd97c-2d52-4dd7-a00a-aef5c2e2cdea None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:01.949876 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-fd8dd97c-2d52-4dd7-a00a-aef5c2e2cdea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:02.039231 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1aadf-0f14-4a29-b031-14db1396738a None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:02.053716 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 207/424] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:23:02.069480 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:02.082108 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257c343-5528-4d7f-9078-74add6bcc822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:02.082737 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257c343-5528-4d7f-9078-74add6bcc822 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:02.083014 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257c343-5528-4d7f-9078-74add6bcc822 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:02.083323 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257c343-5528-4d7f-9078-74add6bcc822 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:02.094188 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257c343-5528-4d7f-9078-74add6bcc822 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:23:02.099127 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-4257c343-5528-4d7f-9078-74add6bcc822 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:23:02.099127 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:02.099127 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:02.099127 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:02.099127 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:02.099127 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:02.099127 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:02.099127 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:02.099127 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:02.099127 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:02.099127 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:02.099127 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:02.099127 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:23:02.099127 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:23:02.099127 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:23:02.099127 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:23:02.099974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:23:02.099974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:23:02.099974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:23:02.099974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:23:02.099974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:02.099974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:02.099974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:02.099974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:02.099974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:02.099974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:02.099974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:02.099974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:02.099974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:02.099974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:02.099974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:02.099974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:02.100777 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:02.100777 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:02.100777 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:02.100777 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:02.100777 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:23:02.100777 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:23:02.100777 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:23:02.100777 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:23:02.100777 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:23:02.100777 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:23:02.100777 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:23:02.100777 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:02.100777 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 218/425] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Nov 2 07:23:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:02.106815 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8dd97c-2d52-4dd7-a00a-aef5c2e2cdea None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:02.263387 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8dd97c-2d52-4dd7-a00a-aef5c2e2cdea None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:02.274319 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257c343-5528-4d7f-9078-74add6bcc822 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:02.276721 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:02.320846 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152a039-d8c2-4728-83fe-3fb4e00a7a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:02.321382 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152a039-d8c2-4728-83fe-3fb4e00a7a35 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:02.321662 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152a039-d8c2-4728-83fe-3fb4e00a7a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:02.321932 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152a039-d8c2-4728-83fe-3fb4e00a7a35 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:02.322591 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152a039-d8c2-4728-83fe-3fb4e00a7a35 None admin] RBAC: Adding query filter params (name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:02.322889 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152a039-d8c2-4728-83fe-3fb4e00a7a35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:02.324857 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152a039-d8c2-4728-83fe-3fb4e00a7a35 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:02.339683 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 208/426] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Nov 2 07:23:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:02.344931 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152a039-d8c2-4728-83fe-3fb4e00a7a35 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:02.408612 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257c343-5528-4d7f-9078-74add6bcc822 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:02.447094 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61261bb9-f83c-4838-9bb7-4547fe9fc005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:02.448358 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61261bb9-f83c-4838-9bb7-4547fe9fc005 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:02.449288 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61261bb9-f83c-4838-9bb7-4547fe9fc005 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:02.449768 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61261bb9-f83c-4838-9bb7-4547fe9fc005 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:02.464317 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61261bb9-f83c-4838-9bb7-4547fe9fc005 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:23:02.471955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-61261bb9-f83c-4838-9bb7-4547fe9fc005 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:23:02.471955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:02.471955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:02.471955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:02.471955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:02.471955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:02.471955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:02.471955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:02.471955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:02.471955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:02.471955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:02.471955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:02.471955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:23:02.471955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:23:02.471955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:23:02.471955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:23:02.472897 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:23:02.472897 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:23:02.472897 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:23:02.472897 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:23:02.472897 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:02.472897 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:02.472897 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:02.472897 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:02.472897 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:02.472897 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:02.472897 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:02.472897 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:02.472897 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:02.472897 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:02.472897 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:02.472897 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:02.473697 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:02.473697 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:02.473697 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:02.473697 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:02.473697 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:23:02.473697 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:23:02.473697 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:23:02.473697 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:23:02.473697 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:23:02.473697 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:23:02.473697 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:23:02.473697 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:02.474294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152a039-d8c2-4728-83fe-3fb4e00a7a35 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:02.481230 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 219/427] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Nov 2 07:23:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:02.481230 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61261bb9-f83c-4838-9bb7-4547fe9fc005 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:02.524962 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831cc53-b39e-40b5-8a43-9a58a93bdffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:02.525975 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831cc53-b39e-40b5-8a43-9a58a93bdffc None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:02.526920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831cc53-b39e-40b5-8a43-9a58a93bdffc None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:02.527918 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831cc53-b39e-40b5-8a43-9a58a93bdffc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:02.531412 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:02.543246 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2831cc53-b39e-40b5-8a43-9a58a93bdffc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:02.546557 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2831cc53-b39e-40b5-8a43-9a58a93bdffc None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:02.565435 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-2831cc53-b39e-40b5-8a43-9a58a93bdffc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:02.565435 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:02.565435 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:02.565435 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:02.565435 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:02.565435 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:02.565435 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:02.565435 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:02.565435 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:02.565435 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:02.565435 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:02.565435 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:02.565435 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:02.565435 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:02.565435 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:02.565435 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:02.566375 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:02.566375 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:02.566375 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:02.566375 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:02.566375 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:02.566375 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:02.566375 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:02.566375 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:02.566375 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:02.566375 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:02.566375 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:02.566375 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:02.566375 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:02.566375 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:02.566375 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:02.566375 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:02.566375 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:02.567205 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:02.567205 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:02.567205 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:02.569506 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 209/428] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:23:02.570450 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831cc53-b39e-40b5-8a43-9a58a93bdffc None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:02.596482 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61261bb9-f83c-4838-9bb7-4547fe9fc005 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:02.600680 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:02.637025 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117af6a6-fb5e-4c3b-aa72-6962a1192164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:02.637918 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117af6a6-fb5e-4c3b-aa72-6962a1192164 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:02.638257 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117af6a6-fb5e-4c3b-aa72-6962a1192164 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:02.638596 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117af6a6-fb5e-4c3b-aa72-6962a1192164 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:02.651277 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117af6a6-fb5e-4c3b-aa72-6962a1192164 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:23:02.657826 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-117af6a6-fb5e-4c3b-aa72-6962a1192164 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:23:02.657826 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:02.657826 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:02.657826 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:02.657826 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:02.657826 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:02.657826 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:02.657826 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:02.657826 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:02.657826 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:02.657826 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:02.657826 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:02.657826 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:23:02.657826 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:23:02.657826 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:23:02.657826 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:23:02.658739 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:23:02.658739 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:23:02.658739 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:23:02.658739 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:23:02.658739 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:02.658739 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:02.658739 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:02.658739 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:02.658739 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:02.658739 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:02.658739 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:02.658739 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:02.658739 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:02.658739 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:02.658739 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:02.658739 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:02.659512 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:02.659512 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:02.659512 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:02.659512 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:02.659512 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:23:02.659512 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:23:02.659512 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:23:02.659512 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:23:02.659512 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:23:02.659512 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:23:02.659512 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:23:02.659512 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:02.659512 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 220/429] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Nov 2 07:23:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:02.660208 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117af6a6-fb5e-4c3b-aa72-6962a1192164 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:02.696760 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831cc53-b39e-40b5-8a43-9a58a93bdffc None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:02.740291 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d7a6be-8f12-47f7-95e8-b5b5bd2088f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:02.741026 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7a6be-8f12-47f7-95e8-b5b5bd2088f5 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:02.741417 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7a6be-8f12-47f7-95e8-b5b5bd2088f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:02.741711 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7a6be-8f12-47f7-95e8-b5b5bd2088f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:02.742372 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d7a6be-8f12-47f7-95e8-b5b5bd2088f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:02.742670 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d7a6be-8f12-47f7-95e8-b5b5bd2088f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:02.744036 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d7a6be-8f12-47f7-95e8-b5b5bd2088f5 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:02.753011 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 210/430] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Nov 2 07:23:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:02.753948 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d7a6be-8f12-47f7-95e8-b5b5bd2088f5 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:02.787841 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117af6a6-fb5e-4c3b-aa72-6962a1192164 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:02.789389 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:02.823121 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df96962-7c80-4801-abbd-45370303675d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:02.824909 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df96962-7c80-4801-abbd-45370303675d None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:02.825293 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df96962-7c80-4801-abbd-45370303675d None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:02.825563 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df96962-7c80-4801-abbd-45370303675d None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:02.826195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df96962-7c80-4801-abbd-45370303675d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:02.826495 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df96962-7c80-4801-abbd-45370303675d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:02.827998 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df96962-7c80-4801-abbd-45370303675d None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:02.844686 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 221/431] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:02.844686 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d7da1-24a7-4d49-840f-eab824514313 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:02.844686 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d7da1-24a7-4d49-840f-eab824514313 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:02.844686 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d7da1-24a7-4d49-840f-eab824514313 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:02.844686 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 222/432] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:02.844686 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d7da1-24a7-4d49-840f-eab824514313 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:02.854854 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:02.873353 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d7a6be-8f12-47f7-95e8-b5b5bd2088f5 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:02.927556 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef6702-78f0-462b-b3db-493f444cee5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:02.928200 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef6702-78f0-462b-b3db-493f444cee5f None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:02.928478 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef6702-78f0-462b-b3db-493f444cee5f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:02.928864 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef6702-78f0-462b-b3db-493f444cee5f None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:02.929528 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef6702-78f0-462b-b3db-493f444cee5f None admin] RBAC: Adding query filter params (name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:02.929825 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef6702-78f0-462b-b3db-493f444cee5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:02.931335 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef6702-78f0-462b-b3db-493f444cee5f None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:02.947513 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 211/433] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Nov 2 07:23:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:02.947513 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef6702-78f0-462b-b3db-493f444cee5f None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:02.960790 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d7da1-24a7-4d49-840f-eab824514313 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:02.994901 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da097d91-bf6e-4d0d-a1e1-db0ad3c4aaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:02.995528 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da097d91-bf6e-4d0d-a1e1-db0ad3c4aaf2 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:02.995802 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da097d91-bf6e-4d0d-a1e1-db0ad3c4aaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:02.996093 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da097d91-bf6e-4d0d-a1e1-db0ad3c4aaf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:03.007470 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da097d91-bf6e-4d0d-a1e1-db0ad3c4aaf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:03.008918 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da097d91-bf6e-4d0d-a1e1-db0ad3c4aaf2 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:03.022429 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-da097d91-bf6e-4d0d-a1e1-db0ad3c4aaf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:03.022429 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:03.022429 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:03.022429 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:03.022429 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:03.022429 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:03.022429 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:03.022429 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:03.022429 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:03.022429 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:03.022429 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:03.022429 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:03.022429 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:03.022429 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:03.022429 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:03.022429 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:03.023379 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:03.023379 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:03.023379 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:03.023379 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:03.023379 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:03.023379 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:03.023379 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:03.023379 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:03.023379 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:03.023379 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:03.023379 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:03.023379 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:03.023379 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:03.023379 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:03.023379 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:03.023379 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:03.023379 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:03.024787 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:03.024787 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:03.024787 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:03.024787 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 223/434] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:03.024998 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21b5ec-f434-4f9d-bb34-646459ecde56 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:03.025207 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21b5ec-f434-4f9d-bb34-646459ecde56 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:03.025476 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21b5ec-f434-4f9d-bb34-646459ecde56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:03.042463 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-cb21b5ec-f434-4f9d-bb34-646459ecde56 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:03.044214 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-cb21b5ec-f434-4f9d-bb34-646459ecde56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:03.047509 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef6702-78f0-462b-b3db-493f444cee5f None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:03.053163 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:03.081261 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e184c-ef45-4da5-ac95-0f685958f059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:03.081881 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e184c-ef45-4da5-ac95-0f685958f059 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:03.082161 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e184c-ef45-4da5-ac95-0f685958f059 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:03.082434 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e184c-ef45-4da5-ac95-0f685958f059 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:03.090139 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e184c-ef45-4da5-ac95-0f685958f059 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:03.091749 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e184c-ef45-4da5-ac95-0f685958f059 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:03.103556 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-a65e184c-ef45-4da5-ac95-0f685958f059 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 02 07:23:03.103556 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:03.103556 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:03.103556 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:03.103556 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:03.103556 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:03.103556 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:03.103556 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:03.103556 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:03.103556 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:03.103556 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:03.103556 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:03.103556 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:23:03.103556 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:23:03.103556 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:23:03.103556 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:23:03.104471 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:03.104471 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:03.104471 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:23:03.104471 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:03.104471 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:23:03.104471 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:03.104471 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:03.104471 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:03.104471 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:03.104471 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:03.104471 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:03.104471 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:03.104471 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:03.104471 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:03.104471 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:03.104471 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:03.104471 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:03.104471 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:03.106132 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:03.106132 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:03.106132 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:23:03.106132 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:23:03.106132 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:23:03.106132 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:23:03.106132 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:23:03.106132 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:23:03.106132 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Nov 02 07:23:03.106132 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:03.106132 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 212/435] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Nov 2 07:23:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:03.106132 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e184c-ef45-4da5-ac95-0f685958f059 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:03.111657 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 224/436] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:23:03.112992 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f210b-c777-427a-83fa-456d4856f5e8 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:03.113277 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f210b-c777-427a-83fa-456d4856f5e8 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:03.113548 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f210b-c777-427a-83fa-456d4856f5e8 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:03.114759 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 225/437] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:03.115446 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f210b-c777-427a-83fa-456d4856f5e8 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:03.117711 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:03.213682 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e184c-ef45-4da5-ac95-0f685958f059 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:03.223899 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f210b-c777-427a-83fa-456d4856f5e8 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:03.250428 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5649f-9cf2-411f-9750-a2293002e450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:03.251309 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5649f-9cf2-411f-9750-a2293002e450 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:03.251757 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5649f-9cf2-411f-9750-a2293002e450 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:03.252215 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5649f-9cf2-411f-9750-a2293002e450 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:03.258320 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09a56c-390b-41c7-acca-a8f97bcc09c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:03.258922 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09a56c-390b-41c7-acca-a8f97bcc09c6 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:03.259198 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09a56c-390b-41c7-acca-a8f97bcc09c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:03.259466 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09a56c-390b-41c7-acca-a8f97bcc09c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:03.260120 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09a56c-390b-41c7-acca-a8f97bcc09c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:03.260425 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09a56c-390b-41c7-acca-a8f97bcc09c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:03.261862 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09a56c-390b-41c7-acca-a8f97bcc09c6 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:03.264788 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae5649f-9cf2-411f-9750-a2293002e450 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:03.266716 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae5649f-9cf2-411f-9750-a2293002e450 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:03.272828 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 226/438] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:03.273616 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09a56c-390b-41c7-acca-a8f97bcc09c6 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:03.279492 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:03.287760 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-bae5649f-9cf2-411f-9750-a2293002e450 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:03.287760 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:03.287760 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:03.287760 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:03.287760 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:03.287760 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:03.287760 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:03.287760 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:03.287760 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:03.287760 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:03.287760 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:03.287760 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:03.287760 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:03.287760 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:03.287760 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:03.287760 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:03.293108 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:03.293108 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:03.293108 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:03.293108 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:03.293108 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:03.293108 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:03.293108 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:03.293108 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:03.293108 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:03.293108 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:03.293108 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:03.293108 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:03.293108 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:03.293108 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:03.293108 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:03.293108 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:03.293108 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:03.294730 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:03.294730 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:03.294730 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:03.294730 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 213/439] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:03.294730 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5d114-b135-41e1-9fea-e80c774df19b None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:03.294730 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5d114-b135-41e1-9fea-e80c774df19b None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:03.294730 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5d114-b135-41e1-9fea-e80c774df19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:03.311704 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-20d5d114-b135-41e1-9fea-e80c774df19b None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:03.312925 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-20d5d114-b135-41e1-9fea-e80c774df19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:03.367693 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:03.381323 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 214/440] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:23:03.382188 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5d114-b135-41e1-9fea-e80c774df19b None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:03.389941 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09a56c-390b-41c7-acca-a8f97bcc09c6 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:03.424530 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb57c8c-08ae-46dc-a64b-b8f55dafd355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:03.425135 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb57c8c-08ae-46dc-a64b-b8f55dafd355 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:03.425409 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb57c8c-08ae-46dc-a64b-b8f55dafd355 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:03.425675 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb57c8c-08ae-46dc-a64b-b8f55dafd355 None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:03.426500 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb57c8c-08ae-46dc-a64b-b8f55dafd355 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:03.426800 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb57c8c-08ae-46dc-a64b-b8f55dafd355 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:03.428360 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb57c8c-08ae-46dc-a64b-b8f55dafd355 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:03.446730 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 227/441] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Nov 2 07:23:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:03.447530 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb57c8c-08ae-46dc-a64b-b8f55dafd355 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:03.493458 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5d114-b135-41e1-9fea-e80c774df19b None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:03.519257 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:03.530239 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72261ed-af9e-4b9f-bc60-913a2b6d7861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:03.530869 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72261ed-af9e-4b9f-bc60-913a2b6d7861 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:03.531147 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72261ed-af9e-4b9f-bc60-913a2b6d7861 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:03.531418 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72261ed-af9e-4b9f-bc60-913a2b6d7861 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:03.538533 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72261ed-af9e-4b9f-bc60-913a2b6d7861 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:03.539999 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72261ed-af9e-4b9f-bc60-913a2b6d7861 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:03.552165 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-e72261ed-af9e-4b9f-bc60-913a2b6d7861 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 02 07:23:03.552165 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:03.552165 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:03.552165 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:03.552165 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:03.552165 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:03.552165 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:03.552165 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:03.552165 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:03.552165 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:03.552165 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:03.552165 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:03.552165 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:23:03.552165 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:23:03.552165 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:23:03.552165 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:23:03.553402 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:03.553402 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:03.553402 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:23:03.553402 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:03.553402 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:23:03.553402 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:03.553402 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:03.553402 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:03.553402 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:03.553402 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:03.553402 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:03.553402 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:03.553402 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:03.553402 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:03.553402 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:03.553402 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:03.553402 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:03.553402 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:03.554307 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:03.554307 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:03.554307 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:23:03.554307 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:23:03.554307 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:23:03.554307 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:23:03.554307 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:23:03.554307 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:23:03.554307 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Nov 02 07:23:03.554307 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:03.554307 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 215/442] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Nov 2 07:23:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:03.554874 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72261ed-af9e-4b9f-bc60-913a2b6d7861 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:03.562820 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb57c8c-08ae-46dc-a64b-b8f55dafd355 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:03.598181 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e29002-c947-4067-99f9-16a6316b3965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:03.598776 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e29002-c947-4067-99f9-16a6316b3965 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:03.599051 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e29002-c947-4067-99f9-16a6316b3965 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:03.599317 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e29002-c947-4067-99f9-16a6316b3965 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:03.599933 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e29002-c947-4067-99f9-16a6316b3965 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:03.600253 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e29002-c947-4067-99f9-16a6316b3965 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:03.601605 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e29002-c947-4067-99f9-16a6316b3965 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:03.605331 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:03.613729 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 228/443] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:03.619095 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e29002-c947-4067-99f9-16a6316b3965 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:03.659129 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72261ed-af9e-4b9f-bc60-913a2b6d7861 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:03.690949 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76401e0e-f2c9-4d00-bccc-a1014f1a607d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:03.691564 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76401e0e-f2c9-4d00-bccc-a1014f1a607d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:03.691836 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76401e0e-f2c9-4d00-bccc-a1014f1a607d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:03.692127 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76401e0e-f2c9-4d00-bccc-a1014f1a607d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:03.702555 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76401e0e-f2c9-4d00-bccc-a1014f1a607d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:23:03.707685 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-76401e0e-f2c9-4d00-bccc-a1014f1a607d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:23:03.707685 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:03.707685 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:03.707685 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:03.707685 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:03.707685 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:03.707685 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:03.707685 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:03.707685 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:03.707685 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:03.707685 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:03.707685 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:03.707685 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:23:03.707685 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:23:03.707685 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:23:03.707685 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:23:03.708585 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:23:03.708585 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:23:03.708585 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:23:03.708585 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:23:03.708585 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:03.708585 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:03.708585 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:03.708585 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:03.708585 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:03.708585 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:03.708585 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:03.708585 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:03.708585 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:03.708585 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:03.708585 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:03.708585 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:03.709368 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:03.709368 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:03.709368 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:03.709368 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:03.709368 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:23:03.709368 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:23:03.709368 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:23:03.709368 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:23:03.709368 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:23:03.709368 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:23:03.709368 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:23:03.709368 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:03.709368 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 216/444] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Nov 2 07:23:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:03.710000 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76401e0e-f2c9-4d00-bccc-a1014f1a607d None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:03.724556 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e29002-c947-4067-99f9-16a6316b3965 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:03.746604 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:03.758321 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8363bd-0511-4a8a-85f1-8c9f6356d05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:03.758941 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8363bd-0511-4a8a-85f1-8c9f6356d05d None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:03.759212 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8363bd-0511-4a8a-85f1-8c9f6356d05d None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:03.759476 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8363bd-0511-4a8a-85f1-8c9f6356d05d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:03.770220 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8363bd-0511-4a8a-85f1-8c9f6356d05d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:03.771636 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8363bd-0511-4a8a-85f1-8c9f6356d05d None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:03.786556 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-6f8363bd-0511-4a8a-85f1-8c9f6356d05d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:03.786556 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:03.786556 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:03.786556 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:03.786556 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:03.786556 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:03.786556 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:03.786556 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:03.786556 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:03.786556 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:03.786556 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:03.786556 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:03.786556 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:03.786556 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:03.786556 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:03.786556 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:03.787430 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:03.787430 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:03.787430 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:03.787430 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:03.787430 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:03.787430 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:03.787430 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:03.787430 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:03.787430 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:03.787430 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:03.787430 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:03.787430 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:03.787430 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:03.787430 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:03.787430 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:03.787430 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:03.787430 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:03.788310 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:03.788310 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:03.788310 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:03.788310 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 229/445] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:03.788526 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8363bd-0511-4a8a-85f1-8c9f6356d05d None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:03.811160 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76401e0e-f2c9-4d00-bccc-a1014f1a607d None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:03.819731 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:03.844273 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2a493-71ac-4fd0-9e31-694ece6faee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:03.844882 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2a493-71ac-4fd0-9e31-694ece6faee7 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:03.845415 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2a493-71ac-4fd0-9e31-694ece6faee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:03.845725 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2a493-71ac-4fd0-9e31-694ece6faee7 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:03.846559 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2a493-71ac-4fd0-9e31-694ece6faee7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:03.846872 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2a493-71ac-4fd0-9e31-694ece6faee7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:03.848658 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2a493-71ac-4fd0-9e31-694ece6faee7 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:03.891009 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 217/446] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Nov 2 07:23:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:03.891751 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2a493-71ac-4fd0-9e31-694ece6faee7 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:03.912148 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8363bd-0511-4a8a-85f1-8c9f6356d05d None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:03.945439 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fde4b-349a-431f-9ce3-9dc8c3194da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:03.946063 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fde4b-349a-431f-9ce3-9dc8c3194da3 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:03.946340 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fde4b-349a-431f-9ce3-9dc8c3194da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:03.946605 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fde4b-349a-431f-9ce3-9dc8c3194da3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:03.954178 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002fde4b-349a-431f-9ce3-9dc8c3194da3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:03.955610 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002fde4b-349a-431f-9ce3-9dc8c3194da3 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:03.966938 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-002fde4b-349a-431f-9ce3-9dc8c3194da3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:23:03.966938 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:03.966938 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:03.966938 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:03.966938 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:03.966938 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:03.966938 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:03.966938 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:03.966938 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:03.966938 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:03.966938 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:03.966938 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:03.966938 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:23:03.966938 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:23:03.966938 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:23:03.966938 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:23:03.967915 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:03.967915 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:03.967915 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:23:03.967915 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:03.967915 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:23:03.967915 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:03.967915 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:03.967915 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:03.967915 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:03.967915 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:03.967915 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:03.967915 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:03.967915 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:03.967915 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:03.967915 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:03.967915 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:03.967915 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:03.967915 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:03.968845 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:03.968845 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:03.968845 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:23:03.968845 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:23:03.968845 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:23:03.968845 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:23:03.968845 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:23:03.968845 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:23:03.968845 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:23:03.968845 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:03.968845 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 230/447] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Nov 2 07:23:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:03.968845 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fde4b-349a-431f-9ce3-9dc8c3194da3 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:04.001443 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2a493-71ac-4fd0-9e31-694ece6faee7 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:04.002731 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:04.034899 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc8158-bbf9-4013-ac82-946f2a39c8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:04.035511 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc8158-bbf9-4013-ac82-946f2a39c8e4 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:04.035784 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc8158-bbf9-4013-ac82-946f2a39c8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:04.036058 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc8158-bbf9-4013-ac82-946f2a39c8e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:04.046664 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc8158-bbf9-4013-ac82-946f2a39c8e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:23:04.051314 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-7abc8158-bbf9-4013-ac82-946f2a39c8e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:23:04.051314 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:04.051314 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:04.051314 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:04.051314 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:04.051314 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:04.051314 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:04.051314 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:04.051314 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:04.051314 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:04.051314 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:04.051314 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:04.051314 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:23:04.051314 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:23:04.051314 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:23:04.051314 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:23:04.052242 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:23:04.052242 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:23:04.052242 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:23:04.052242 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:23:04.052242 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:04.052242 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:04.052242 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:04.052242 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:04.052242 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:04.052242 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:04.052242 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:04.052242 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:04.052242 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:04.052242 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:04.052242 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:04.052242 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:04.053026 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:04.053026 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:04.053026 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:04.053026 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:04.053026 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:23:04.053026 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:23:04.053026 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:23:04.053026 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:23:04.053026 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:23:04.053026 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:23:04.053026 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:23:04.053026 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:04.053026 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 218/448] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Nov 2 07:23:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:04.053661 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc8158-bbf9-4013-ac82-946f2a39c8e4 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:04.073631 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fde4b-349a-431f-9ce3-9dc8c3194da3 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:04.079520 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:04.108008 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2859fb7a-f954-4f0a-99a1-f37941157427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:04.108760 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859fb7a-f954-4f0a-99a1-f37941157427 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:04.109103 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859fb7a-f954-4f0a-99a1-f37941157427 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:04.109391 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859fb7a-f954-4f0a-99a1-f37941157427 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:04.110040 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2859fb7a-f954-4f0a-99a1-f37941157427 None admin] RBAC: Adding query filter params (name=service) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:04.110342 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2859fb7a-f954-4f0a-99a1-f37941157427 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:04.111698 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2859fb7a-f954-4f0a-99a1-f37941157427 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:04.119307 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 231/449] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Nov 2 07:23:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:04.120109 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2859fb7a-f954-4f0a-99a1-f37941157427 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:04.154848 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc8158-bbf9-4013-ac82-946f2a39c8e4 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:04.188635 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d428b6-aa83-4620-9e7a-cf4882b1f6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:04.189229 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d428b6-aa83-4620-9e7a-cf4882b1f6eb None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:04.189508 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d428b6-aa83-4620-9e7a-cf4882b1f6eb None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:04.189782 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d428b6-aa83-4620-9e7a-cf4882b1f6eb None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:04.190412 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d428b6-aa83-4620-9e7a-cf4882b1f6eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:04.190710 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d428b6-aa83-4620-9e7a-cf4882b1f6eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:04.192136 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d428b6-aa83-4620-9e7a-cf4882b1f6eb None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:04.202978 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 219/450] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:04.203756 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d428b6-aa83-4620-9e7a-cf4882b1f6eb None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:04.210384 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:04.216443 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2859fb7a-f954-4f0a-99a1-f37941157427 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:04.254432 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f7c73-8f74-43de-83c4-e006d4d13462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:04.255040 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f7c73-8f74-43de-83c4-e006d4d13462 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:04.255315 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f7c73-8f74-43de-83c4-e006d4d13462 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:04.255587 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f7c73-8f74-43de-83c4-e006d4d13462 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:04.295605 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:04.310963 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d428b6-aa83-4620-9e7a-cf4882b1f6eb None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:04.323194 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f7c73-8f74-43de-83c4-e006d4d13462 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:04.325087 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f7c73-8f74-43de-83c4-e006d4d13462 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:04.344642 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d14056-344a-47d5-9ed8-144d2f4c0b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:04.345264 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d14056-344a-47d5-9ed8-144d2f4c0b53 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:04.345545 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d14056-344a-47d5-9ed8-144d2f4c0b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:04.345815 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d14056-344a-47d5-9ed8-144d2f4c0b53 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:04.346527 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d14056-344a-47d5-9ed8-144d2f4c0b53 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:04.346827 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d14056-344a-47d5-9ed8-144d2f4c0b53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:04.348269 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d14056-344a-47d5-9ed8-144d2f4c0b53 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:04.365568 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 220/451] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Nov 2 07:23:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:04.366363 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d14056-344a-47d5-9ed8-144d2f4c0b53 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:04.415439 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:04.422238 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 232/452] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Nov 2 07:23:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:23:04.423271 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f7c73-8f74-43de-83c4-e006d4d13462 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:04.464730 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d14056-344a-47d5-9ed8-144d2f4c0b53 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:04.498054 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc65901-8553-4b3f-a4bd-37b123564e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:04.498649 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc65901-8553-4b3f-a4bd-37b123564e32 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:04.498928 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc65901-8553-4b3f-a4bd-37b123564e32 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:04.499200 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc65901-8553-4b3f-a4bd-37b123564e32 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:04.499840 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc65901-8553-4b3f-a4bd-37b123564e32 None admin] RBAC: Adding query filter params (name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:04.500164 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc65901-8553-4b3f-a4bd-37b123564e32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:04.501528 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc65901-8553-4b3f-a4bd-37b123564e32 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:04.509718 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 221/453] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Nov 2 07:23:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:04.510481 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc65901-8553-4b3f-a4bd-37b123564e32 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:04.519783 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:04.520837 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f7c73-8f74-43de-83c4-e006d4d13462 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:04.553735 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786ead1-aaa1-43e6-841d-061b5da9f4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:04.554357 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786ead1-aaa1-43e6-841d-061b5da9f4d0 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:04.554632 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786ead1-aaa1-43e6-841d-061b5da9f4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:04.554910 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786ead1-aaa1-43e6-841d-061b5da9f4d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:04.564518 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5786ead1-aaa1-43e6-841d-061b5da9f4d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:04.565933 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5786ead1-aaa1-43e6-841d-061b5da9f4d0 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:04.580361 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-5786ead1-aaa1-43e6-841d-061b5da9f4d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:04.580361 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:04.580361 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:04.580361 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:04.580361 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:04.580361 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:04.580361 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:04.580361 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:04.580361 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:04.580361 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:04.580361 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:04.580361 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:04.580361 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:04.580361 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:04.580361 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:04.580361 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:04.581434 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:04.581434 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:04.581434 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:04.581434 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:04.581434 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:04.581434 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:04.581434 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:04.581434 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:04.581434 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:04.581434 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:04.581434 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:04.581434 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:04.581434 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:04.581434 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:04.581434 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:04.581434 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:04.581434 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:04.587132 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:04.587132 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:04.587132 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:04.587132 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 233/454] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:04.587132 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786ead1-aaa1-43e6-841d-061b5da9f4d0 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:04.608847 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc65901-8553-4b3f-a4bd-37b123564e32 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:04.629628 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:04.642370 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b57aa2-75a0-4bae-b3f1-ae7b4917a5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:04.642990 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b57aa2-75a0-4bae-b3f1-ae7b4917a5f4 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:04.643266 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b57aa2-75a0-4bae-b3f1-ae7b4917a5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:04.643535 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b57aa2-75a0-4bae-b3f1-ae7b4917a5f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:04.650054 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b57aa2-75a0-4bae-b3f1-ae7b4917a5f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:04.651494 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b57aa2-75a0-4bae-b3f1-ae7b4917a5f4 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:04.663083 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-38b57aa2-75a0-4bae-b3f1-ae7b4917a5f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:04.663083 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:04.663083 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:04.663083 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:04.663083 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:04.663083 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:04.663083 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:04.663083 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:04.663083 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:04.663083 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:04.663083 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:04.663083 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:04.663083 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:23:04.663083 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:23:04.663083 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:23:04.663903 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:23:04.663903 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:04.663903 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:04.663903 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:04.663903 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:04.663903 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:04.663903 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:04.663903 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:04.663903 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:04.663903 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:04.663903 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:04.663903 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:04.663903 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:04.663903 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:04.663903 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:04.663903 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:04.663903 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:04.664793 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:23:04.664793 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:23:04.664793 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:23:04.664793 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:23:04.664793 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:23:04.664793 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:23:04.664793 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:04.664793 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:04.664793 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 222/455] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Nov 2 07:23:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:04.665493 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b57aa2-75a0-4bae-b3f1-ae7b4917a5f4 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:04.680750 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786ead1-aaa1-43e6-841d-061b5da9f4d0 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:04.717627 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b3a83-c61d-4919-adb2-e2d27b2b4d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:04.718226 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b3a83-c61d-4919-adb2-e2d27b2b4d52 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:04.718509 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b3a83-c61d-4919-adb2-e2d27b2b4d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:04.718781 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b3a83-c61d-4919-adb2-e2d27b2b4d52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:04.731486 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:04.765074 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b57aa2-75a0-4bae-b3f1-ae7b4917a5f4 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:04.784339 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b3a83-c61d-4919-adb2-e2d27b2b4d52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:04.785801 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b3a83-c61d-4919-adb2-e2d27b2b4d52 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:04.797658 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9abe2-fc96-497c-9c43-abca51cd834e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:04.798275 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9abe2-fc96-497c-9c43-abca51cd834e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:04.798556 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9abe2-fc96-497c-9c43-abca51cd834e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:04.798823 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9abe2-fc96-497c-9c43-abca51cd834e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:04.809848 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e9abe2-fc96-497c-9c43-abca51cd834e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:04.811354 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e9abe2-fc96-497c-9c43-abca51cd834e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:04.825319 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-52e9abe2-fc96-497c-9c43-abca51cd834e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:04.825319 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:04.825319 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:04.825319 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:04.825319 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:04.825319 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:04.825319 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:04.825319 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:04.825319 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:04.825319 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:04.825319 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:04.825319 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:04.825319 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:04.825319 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:04.825319 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:04.825319 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:04.826623 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:04.826623 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:04.826623 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:04.826623 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:04.826623 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:04.826623 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:04.826623 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:04.826623 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:04.826623 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:04.826623 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:04.826623 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:04.826623 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:04.826623 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:04.826623 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:04.826623 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:04.826623 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:04.826623 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:04.827588 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:04.827588 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:04.827588 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:04.828074 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 223/456] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:04.830417 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9abe2-fc96-497c-9c43-abca51cd834e None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:04.834319 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:04.886159 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 234/457] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Nov 2 07:23:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:23:04.887035 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b3a83-c61d-4919-adb2-e2d27b2b4d52 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:04.933834 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9abe2-fc96-497c-9c43-abca51cd834e None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:04.951018 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:04.968324 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a8c75-dc7b-4f29-8d7b-ef7ee9d702f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:04.968944 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a8c75-dc7b-4f29-8d7b-ef7ee9d702f5 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:04.969221 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a8c75-dc7b-4f29-8d7b-ef7ee9d702f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:04.969486 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a8c75-dc7b-4f29-8d7b-ef7ee9d702f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:04.979664 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a8c75-dc7b-4f29-8d7b-ef7ee9d702f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:04.981209 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a8c75-dc7b-4f29-8d7b-ef7ee9d702f5 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:04.989777 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b3a83-c61d-4919-adb2-e2d27b2b4d52 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:04.995019 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-616a8c75-dc7b-4f29-8d7b-ef7ee9d702f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:04.995019 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:04.995019 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:04.995019 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:04.995019 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:04.995019 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:04.995019 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:04.995019 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:04.995019 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:04.995019 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:04.995019 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:04.995019 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:04.995019 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:04.995019 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:04.995019 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:04.995019 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:04.996692 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:04.996692 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:04.996692 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:04.996692 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:04.996692 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:04.996692 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:04.996692 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:04.996692 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:04.996692 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:04.996692 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:04.996692 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:04.996692 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:04.996692 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:04.996692 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:04.996692 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:04.996692 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:04.996692 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:04.998103 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:04.998103 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:04.998103 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:04.998103 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 224/458] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:04.998103 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a8c75-dc7b-4f29-8d7b-ef7ee9d702f5 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:05.026509 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb08c75-7b2a-480a-a770-8a1e6eacf981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:05.027110 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb08c75-7b2a-480a-a770-8a1e6eacf981 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:05.027408 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb08c75-7b2a-480a-a770-8a1e6eacf981 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:05.027685 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb08c75-7b2a-480a-a770-8a1e6eacf981 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:05.028341 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb08c75-7b2a-480a-a770-8a1e6eacf981 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:05.028643 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb08c75-7b2a-480a-a770-8a1e6eacf981 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:05.030009 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb08c75-7b2a-480a-a770-8a1e6eacf981 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:05.040851 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 235/459] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:05.041638 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb08c75-7b2a-480a-a770-8a1e6eacf981 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:05.055622 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:05.097213 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a8c75-dc7b-4f29-8d7b-ef7ee9d702f5 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:05.130230 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62afc7-f300-4b50-b64e-ed3b859a8f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:05.130825 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62afc7-f300-4b50-b64e-ed3b859a8f3f None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:05.131106 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62afc7-f300-4b50-b64e-ed3b859a8f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:05.131375 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62afc7-f300-4b50-b64e-ed3b859a8f3f None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:05.132039 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62afc7-f300-4b50-b64e-ed3b859a8f3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:05.132364 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62afc7-f300-4b50-b64e-ed3b859a8f3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:05.133772 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62afc7-f300-4b50-b64e-ed3b859a8f3f None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:05.142995 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb08c75-7b2a-480a-a770-8a1e6eacf981 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:05.145701 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 225/460] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Nov 2 07:23:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:05.146473 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62afc7-f300-4b50-b64e-ed3b859a8f3f None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:05.176561 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979fcff-e23b-43ce-8c6d-447f7a052e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:05.177175 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979fcff-e23b-43ce-8c6d-447f7a052e38 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:05.177301 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:05.177451 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979fcff-e23b-43ce-8c6d-447f7a052e38 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:05.177727 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979fcff-e23b-43ce-8c6d-447f7a052e38 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:05.178355 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979fcff-e23b-43ce-8c6d-447f7a052e38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:05.178652 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979fcff-e23b-43ce-8c6d-447f7a052e38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:05.180007 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979fcff-e23b-43ce-8c6d-447f7a052e38 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:05.193914 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 236/461] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:05.193914 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979fcff-e23b-43ce-8c6d-447f7a052e38 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:05.245106 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62afc7-f300-4b50-b64e-ed3b859a8f3f None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:05.260195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:05.278909 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fdeebe-e3ab-4158-95c1-462ec4cad693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:05.279527 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fdeebe-e3ab-4158-95c1-462ec4cad693 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:05.279801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fdeebe-e3ab-4158-95c1-462ec4cad693 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:05.280089 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fdeebe-e3ab-4158-95c1-462ec4cad693 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:05.289798 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fdeebe-e3ab-4158-95c1-462ec4cad693 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:05.291240 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fdeebe-e3ab-4158-95c1-462ec4cad693 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:05.292069 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979fcff-e23b-43ce-8c6d-447f7a052e38 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:05.306228 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-a2fdeebe-e3ab-4158-95c1-462ec4cad693 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:05.306228 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:05.306228 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:05.306228 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:05.306228 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:05.306228 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:05.306228 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:05.306228 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:05.306228 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:05.306228 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:05.306228 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:05.306228 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:05.306228 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:05.306228 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:05.306228 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:05.306228 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:05.307463 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:05.307463 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:05.307463 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:05.307463 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:05.307463 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:05.307463 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:05.307463 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:05.307463 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:05.307463 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:05.307463 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:05.307463 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:05.307463 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:05.307463 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:05.307463 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:05.307463 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:05.307463 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:05.307463 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:05.309006 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:05.309006 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:05.309006 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:05.309006 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 226/462] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:05.309006 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fdeebe-e3ab-4158-95c1-462ec4cad693 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:05.330135 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a16e7-6a6f-4603-90b1-0c9985465f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:05.330737 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a16e7-6a6f-4603-90b1-0c9985465f05 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:05.331012 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a16e7-6a6f-4603-90b1-0c9985465f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:05.331279 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a16e7-6a6f-4603-90b1-0c9985465f05 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:05.331904 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a16e7-6a6f-4603-90b1-0c9985465f05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:05.332229 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a16e7-6a6f-4603-90b1-0c9985465f05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:05.333570 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a16e7-6a6f-4603-90b1-0c9985465f05 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:05.344633 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 237/463] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:05.345450 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a16e7-6a6f-4603-90b1-0c9985465f05 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:05.396352 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:05.414395 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fdeebe-e3ab-4158-95c1-462ec4cad693 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:05.444239 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a16e7-6a6f-4603-90b1-0c9985465f05 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:05.448550 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9993dc80-91af-4739-9a69-0428aa3cd30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:05.449237 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993dc80-91af-4739-9a69-0428aa3cd30d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:05.449573 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993dc80-91af-4739-9a69-0428aa3cd30d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:05.449919 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993dc80-91af-4739-9a69-0428aa3cd30d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:05.456862 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9993dc80-91af-4739-9a69-0428aa3cd30d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:05.458355 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9993dc80-91af-4739-9a69-0428aa3cd30d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:05.469763 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:05.470131 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-9993dc80-91af-4739-9a69-0428aa3cd30d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 02 07:23:05.470131 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:05.470131 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:05.470131 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:05.470131 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:05.470131 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:05.470131 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:05.470131 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:05.470131 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:05.470131 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:05.470131 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:05.470131 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:05.470131 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:23:05.470131 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:23:05.470131 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:23:05.470131 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:23:05.471000 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:05.471000 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:05.471000 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:23:05.471000 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:05.471000 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:23:05.471000 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:05.471000 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:05.471000 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:05.471000 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:05.471000 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:05.471000 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:05.471000 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:05.471000 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:05.471000 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:05.471000 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:05.471000 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:05.471000 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:05.471000 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:05.471856 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:05.471856 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:05.471856 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:23:05.471856 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:23:05.471856 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:23:05.471856 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:23:05.471856 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:23:05.471856 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:23:05.471856 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Nov 02 07:23:05.471856 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:05.471856 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 227/464] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Nov 2 07:23:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:05.472478 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9993dc80-91af-4739-9a69-0428aa3cd30d None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:05.482696 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d950515-0ea5-4e6c-927a-92a6dab9466c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:05.483359 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d950515-0ea5-4e6c-927a-92a6dab9466c None admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:05.483633 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d950515-0ea5-4e6c-927a-92a6dab9466c None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:05.483903 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d950515-0ea5-4e6c-927a-92a6dab9466c None admin] PATH_INFO: `/v3/projects/2c3bf3e930dd407f8401c0487edc8c20/users/68d63a04c2d74c90b95a4f48c49ddb29/roles/4d61be0c9e7b454abd3b0a3330428290` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:05.499350 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d950515-0ea5-4e6c-927a-92a6dab9466c None admin] RBAC: Authorizing `identity:create_grant(project_id=2c3bf3e930dd407f8401c0487edc8c20, user_id=68d63a04c2d74c90b95a4f48c49ddb29, role_id=4d61be0c9e7b454abd3b0a3330428290)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:05.500808 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d950515-0ea5-4e6c-927a-92a6dab9466c None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:05.560353 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 238/465] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Nov 2 07:23:05 2022] PUT /identity/v3/projects/2c3bf3e930dd407f8401c0487edc8c20/users/68d63a04c2d74c90b95a4f48c49ddb29/roles/4d61be0c9e7b454abd3b0a3330428290 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:23:05.561158 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d950515-0ea5-4e6c-927a-92a6dab9466c None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:05.568456 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9993dc80-91af-4739-9a69-0428aa3cd30d None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:05.607082 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f939d-204a-4c79-b980-cbedb53da9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:05.607732 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f939d-204a-4c79-b980-cbedb53da9e8 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:05.608004 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f939d-204a-4c79-b980-cbedb53da9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:05.608296 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f939d-204a-4c79-b980-cbedb53da9e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:05.615759 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f939d-204a-4c79-b980-cbedb53da9e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:05.617263 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f939d-204a-4c79-b980-cbedb53da9e8 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:05.630255 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-097f939d-204a-4c79-b980-cbedb53da9e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:05.630255 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:05.630255 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:05.630255 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:05.630255 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:05.630255 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:05.630255 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:05.630255 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:05.630255 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:05.630255 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:05.630255 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:05.630255 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:05.630255 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:23:05.630255 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:23:05.630255 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:23:05.631180 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:23:05.631180 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:05.631180 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:05.631180 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:05.631180 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:05.631180 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:05.631180 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:05.631180 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:05.631180 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:05.631180 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:05.631180 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:05.631180 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:05.631180 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:05.631180 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:05.631180 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:05.631180 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:05.631180 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:05.632023 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:23:05.632023 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:23:05.632023 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:23:05.632023 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:23:05.632023 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:23:05.632023 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:23:05.632023 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:05.632023 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:05.632023 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 228/466] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Nov 2 07:23:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:05.633595 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f939d-204a-4c79-b980-cbedb53da9e8 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:05.640451 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:05.693990 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d950515-0ea5-4e6c-927a-92a6dab9466c None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:05.732999 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce449a-0c28-4a21-9eb3-72da33363e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:05.733536 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce449a-0c28-4a21-9eb3-72da33363e79 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:05.733814 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce449a-0c28-4a21-9eb3-72da33363e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:05.734083 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce449a-0c28-4a21-9eb3-72da33363e79 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:05.734714 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce449a-0c28-4a21-9eb3-72da33363e79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:05.735015 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce449a-0c28-4a21-9eb3-72da33363e79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:05.736412 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce449a-0c28-4a21-9eb3-72da33363e79 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:05.749565 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f939d-204a-4c79-b980-cbedb53da9e8 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:05.752282 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 239/467] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:05.753386 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce449a-0c28-4a21-9eb3-72da33363e79 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:05.788471 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0eb1c8-0b9a-4564-8ebf-846568523bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:05.789120 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0eb1c8-0b9a-4564-8ebf-846568523bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:05.789408 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0eb1c8-0b9a-4564-8ebf-846568523bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:05.789684 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0eb1c8-0b9a-4564-8ebf-846568523bd3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:05.797789 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:05.798319 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0eb1c8-0b9a-4564-8ebf-846568523bd3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:05.799803 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0eb1c8-0b9a-4564-8ebf-846568523bd3 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:05.811906 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-db0eb1c8-0b9a-4564-8ebf-846568523bd3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 07:23:05.811906 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:05.811906 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:05.811906 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:05.811906 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:05.811906 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:05.811906 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:05.811906 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:05.811906 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:05.811906 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:05.811906 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:05.811906 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:05.811906 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:23:05.811906 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:23:05.811906 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:23:05.811906 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:23:05.814881 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:05.814881 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:05.814881 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:23:05.814881 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:05.814881 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:23:05.814881 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:05.814881 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:05.814881 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:05.814881 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:05.814881 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:05.814881 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:05.814881 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:05.814881 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:05.814881 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:05.814881 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:05.814881 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:05.814881 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:05.814881 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:05.815767 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:05.815767 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:05.815767 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:23:05.815767 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:23:05.815767 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:23:05.815767 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:23:05.815767 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:23:05.815767 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:23:05.815767 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 07:23:05.815767 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:05.815767 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 229/468] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Nov 2 07:23:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:05.815767 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0eb1c8-0b9a-4564-8ebf-846568523bd3 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:05.872486 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce449a-0c28-4a21-9eb3-72da33363e79 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:05.884508 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:05.909105 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c783df9-9b3e-4fc8-8b64-8c779bf0f46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:05.909714 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c783df9-9b3e-4fc8-8b64-8c779bf0f46a None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:05.909991 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c783df9-9b3e-4fc8-8b64-8c779bf0f46a None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:05.910261 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c783df9-9b3e-4fc8-8b64-8c779bf0f46a None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:05.910977 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c783df9-9b3e-4fc8-8b64-8c779bf0f46a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:05.911283 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c783df9-9b3e-4fc8-8b64-8c779bf0f46a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:05.913248 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c783df9-9b3e-4fc8-8b64-8c779bf0f46a None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:05.930773 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0eb1c8-0b9a-4564-8ebf-846568523bd3 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:05.937114 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 240/469] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Nov 2 07:23:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:05.937114 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c783df9-9b3e-4fc8-8b64-8c779bf0f46a None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:05.969226 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d5195-245b-460f-9204-5121717b10bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:05.970626 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d5195-245b-460f-9204-5121717b10bd None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:05.971048 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d5195-245b-460f-9204-5121717b10bd None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:05.971460 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d5195-245b-460f-9204-5121717b10bd None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:05.972452 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d5195-245b-460f-9204-5121717b10bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:05.972899 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d5195-245b-460f-9204-5121717b10bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:05.975237 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d5195-245b-460f-9204-5121717b10bd None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:05.993021 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 230/470] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Nov 2 07:23:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:05.993021 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d5195-245b-460f-9204-5121717b10bd None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:06.045765 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:06.052493 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c783df9-9b3e-4fc8-8b64-8c779bf0f46a None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:06.089671 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7431b70-5bce-4413-88b3-1c65a80f91c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:06.090382 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7431b70-5bce-4413-88b3-1c65a80f91c5 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:06.090697 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7431b70-5bce-4413-88b3-1c65a80f91c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:06.090958 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7431b70-5bce-4413-88b3-1c65a80f91c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:06.098226 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7431b70-5bce-4413-88b3-1c65a80f91c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:06.099991 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7431b70-5bce-4413-88b3-1c65a80f91c5 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:06.101329 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d5195-245b-460f-9204-5121717b10bd None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:06.111792 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-d7431b70-5bce-4413-88b3-1c65a80f91c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:06.111792 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:06.111792 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:06.111792 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:06.111792 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:06.111792 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:06.111792 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:06.111792 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:06.111792 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:06.111792 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:06.111792 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:06.111792 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:06.111792 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:23:06.111792 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:23:06.111792 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:23:06.112652 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:23:06.112652 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:06.112652 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:06.112652 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:06.112652 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:06.112652 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:06.112652 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:06.112652 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:06.112652 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:06.112652 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:06.112652 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:06.112652 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:06.112652 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:06.112652 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:06.112652 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:06.112652 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:06.112652 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:06.113482 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:23:06.113482 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:23:06.113482 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:23:06.113482 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:23:06.113482 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:23:06.113482 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:23:06.113482 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:06.113482 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:06.113482 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 241/471] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Nov 2 07:23:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:06.114556 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7431b70-5bce-4413-88b3-1c65a80f91c5 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:06.130608 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:06.141955 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c1418-eeab-4000-b4cb-1629e48ad2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:06.142559 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c1418-eeab-4000-b4cb-1629e48ad2a2 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:06.142923 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c1418-eeab-4000-b4cb-1629e48ad2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:06.143172 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c1418-eeab-4000-b4cb-1629e48ad2a2 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:06.143888 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c1418-eeab-4000-b4cb-1629e48ad2a2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:06.144232 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c1418-eeab-4000-b4cb-1629e48ad2a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:06.146278 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c1418-eeab-4000-b4cb-1629e48ad2a2 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:06.167430 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 231/472] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Nov 2 07:23:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:06.167430 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c1418-eeab-4000-b4cb-1629e48ad2a2 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:06.223965 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7431b70-5bce-4413-88b3-1c65a80f91c5 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:06.260168 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b2eda-590e-4130-8cdf-1de264a03e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:06.260687 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b2eda-590e-4130-8cdf-1de264a03e03 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:06.260967 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b2eda-590e-4130-8cdf-1de264a03e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:06.261240 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b2eda-590e-4130-8cdf-1de264a03e03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:06.273167 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c1418-eeab-4000-b4cb-1629e48ad2a2 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:06.289076 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:06.310964 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdc3ee-b7bd-4d8c-bb92-1a430e5c0da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:06.312158 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdc3ee-b7bd-4d8c-bb92-1a430e5c0da6 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:06.312576 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdc3ee-b7bd-4d8c-bb92-1a430e5c0da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:06.312985 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdc3ee-b7bd-4d8c-bb92-1a430e5c0da6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:06.313886 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cdc3ee-b7bd-4d8c-bb92-1a430e5c0da6 None admin] RBAC: Adding query filter params (role.id=4d61be0c9e7b454abd3b0a3330428290, scope.project.id=2c3bf3e930dd407f8401c0487edc8c20, user.id=475f6e94957a4ae2b1248c8035231ebd) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:06.314355 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cdc3ee-b7bd-4d8c-bb92-1a430e5c0da6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:06.315916 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cdc3ee-b7bd-4d8c-bb92-1a430e5c0da6 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:06.321974 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 232/473] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Nov 2 07:23:06 2022] GET /identity/v3/role_assignments?user.id=475f6e94957a4ae2b1248c8035231ebd&scope.project.id=2c3bf3e930dd407f8401c0487edc8c20&role.id=4d61be0c9e7b454abd3b0a3330428290 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:06.329148 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdc3ee-b7bd-4d8c-bb92-1a430e5c0da6 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:06.336547 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b2eda-590e-4130-8cdf-1de264a03e03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:06.338747 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b2eda-590e-4130-8cdf-1de264a03e03 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:06.397058 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:06.463708 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 242/474] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Nov 2 07:23:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:23:06.465218 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b2eda-590e-4130-8cdf-1de264a03e03 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:06.480796 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdc3ee-b7bd-4d8c-bb92-1a430e5c0da6 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:06.527063 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cb95c-c857-4ff7-9cbd-58f73e6dbe7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:06.527851 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cb95c-c857-4ff7-9cbd-58f73e6dbe7d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:06.528561 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cb95c-c857-4ff7-9cbd-58f73e6dbe7d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:06.528837 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cb95c-c857-4ff7-9cbd-58f73e6dbe7d None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:06.530737 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682cb95c-c857-4ff7-9cbd-58f73e6dbe7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:06.531049 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682cb95c-c857-4ff7-9cbd-58f73e6dbe7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:06.532525 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682cb95c-c857-4ff7-9cbd-58f73e6dbe7d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:06.535511 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:06.546026 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 233/475] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Nov 2 07:23:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:06.546841 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cb95c-c857-4ff7-9cbd-58f73e6dbe7d None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:06.590658 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b2eda-590e-4130-8cdf-1de264a03e03 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:06.636674 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85819186-367b-46ff-a28a-fe15dc420e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:06.637761 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85819186-367b-46ff-a28a-fe15dc420e32 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:06.638256 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85819186-367b-46ff-a28a-fe15dc420e32 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:06.638718 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85819186-367b-46ff-a28a-fe15dc420e32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:06.674221 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cb95c-c857-4ff7-9cbd-58f73e6dbe7d None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:06.677327 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:06.720098 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bde49-ce4b-4737-8299-4faa91037078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:06.721134 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bde49-ce4b-4737-8299-4faa91037078 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:06.721610 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bde49-ce4b-4737-8299-4faa91037078 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:06.722077 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bde49-ce4b-4737-8299-4faa91037078 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:06.725297 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85819186-367b-46ff-a28a-fe15dc420e32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:06.726752 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85819186-367b-46ff-a28a-fe15dc420e32 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:06.734391 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75bde49-ce4b-4737-8299-4faa91037078 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:06.736236 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75bde49-ce4b-4737-8299-4faa91037078 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:06.752069 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-d75bde49-ce4b-4737-8299-4faa91037078 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:06.752069 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:06.752069 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:06.752069 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:06.752069 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:06.752069 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:06.752069 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:06.752069 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:06.752069 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:06.752069 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:06.752069 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:06.752069 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:06.752069 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:06.752069 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:06.752069 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:06.752069 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:06.752990 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:06.752990 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:06.752990 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:06.752990 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:06.752990 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:06.752990 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:06.752990 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:06.752990 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:06.752990 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:06.752990 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:06.752990 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:06.752990 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:06.752990 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:06.752990 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:06.752990 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:06.752990 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:06.752990 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:06.753819 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:06.753819 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:06.753819 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:06.760324 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 234/476] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:06.761411 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bde49-ce4b-4737-8299-4faa91037078 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:06.795977 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:06.868526 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 243/477] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Nov 2 07:23:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:23:06.869462 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85819186-367b-46ff-a28a-fe15dc420e32 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:06.875544 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bde49-ce4b-4737-8299-4faa91037078 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:06.911730 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4153a0f-ce2e-4ce8-95f4-a439ede212f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:06.912360 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4153a0f-ce2e-4ce8-95f4-a439ede212f5 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:06.912633 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4153a0f-ce2e-4ce8-95f4-a439ede212f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:06.912901 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4153a0f-ce2e-4ce8-95f4-a439ede212f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:06.913615 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4153a0f-ce2e-4ce8-95f4-a439ede212f5 None admin] RBAC: Adding query filter params (role.id=4d61be0c9e7b454abd3b0a3330428290, scope.project.id=2c3bf3e930dd407f8401c0487edc8c20, user.id=232210eabdfd4969a348d7333c50c438) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:06.913921 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4153a0f-ce2e-4ce8-95f4-a439ede212f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:06.915360 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4153a0f-ce2e-4ce8-95f4-a439ede212f5 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:06.928075 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 235/478] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Nov 2 07:23:06 2022] GET /identity/v3/role_assignments?user.id=232210eabdfd4969a348d7333c50c438&scope.project.id=2c3bf3e930dd407f8401c0487edc8c20&role.id=4d61be0c9e7b454abd3b0a3330428290 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:06.928075 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4153a0f-ce2e-4ce8-95f4-a439ede212f5 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:06.954384 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:07.040466 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85819186-367b-46ff-a28a-fe15dc420e32 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:07.041251 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4153a0f-ce2e-4ce8-95f4-a439ede212f5 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:07.078408 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d39631-b416-4ba2-a694-c125f2e24258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:07.079342 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d39631-b416-4ba2-a694-c125f2e24258 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:07.079816 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d39631-b416-4ba2-a694-c125f2e24258 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:07.080120 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144594c5-5b2b-4c70-b1d6-f322895e3dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:07.080565 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d39631-b416-4ba2-a694-c125f2e24258 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:07.080748 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144594c5-5b2b-4c70-b1d6-f322895e3dc0 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:07.081016 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144594c5-5b2b-4c70-b1d6-f322895e3dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:07.081284 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144594c5-5b2b-4c70-b1d6-f322895e3dc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:07.081967 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d39631-b416-4ba2-a694-c125f2e24258 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:07.082358 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d39631-b416-4ba2-a694-c125f2e24258 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:07.083797 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d39631-b416-4ba2-a694-c125f2e24258 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:07.093175 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144594c5-5b2b-4c70-b1d6-f322895e3dc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:07.094900 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144594c5-5b2b-4c70-b1d6-f322895e3dc0 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:07.097076 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 244/479] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:07.102349 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d39631-b416-4ba2-a694-c125f2e24258 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:07.112205 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-144594c5-5b2b-4c70-b1d6-f322895e3dc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:07.112205 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:07.112205 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:07.112205 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:07.112205 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:07.112205 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:07.112205 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:07.112205 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:07.112205 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:07.112205 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:07.112205 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:07.112205 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:07.112205 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:07.112205 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:07.112205 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:07.112205 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:07.113154 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:07.113154 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:07.113154 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:07.113154 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:07.113154 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:07.113154 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:07.113154 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:07.113154 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:07.113154 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:07.113154 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:07.113154 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:07.113154 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:07.113154 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:07.113154 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:07.113154 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:07.113154 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:07.113154 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:07.114061 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:07.114061 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:07.114061 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:07.119990 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 236/480] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:07.122698 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144594c5-5b2b-4c70-b1d6-f322895e3dc0 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:07.144512 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:07.199648 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:07.233233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144594c5-5b2b-4c70-b1d6-f322895e3dc0 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:07.275202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722773d-d670-4346-a5cb-21622bcc7bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:07.275810 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722773d-d670-4346-a5cb-21622bcc7bb4 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:07.276126 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722773d-d670-4346-a5cb-21622bcc7bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:07.276374 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722773d-d670-4346-a5cb-21622bcc7bb4 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:07.277002 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0722773d-d670-4346-a5cb-21622bcc7bb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:07.277297 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0722773d-d670-4346-a5cb-21622bcc7bb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:07.277697 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d39631-b416-4ba2-a694-c125f2e24258 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:07.278697 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0722773d-d670-4346-a5cb-21622bcc7bb4 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:07.294692 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 237/481] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:07.301594 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722773d-d670-4346-a5cb-21622bcc7bb4 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:07.319598 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a645787-9630-4605-97d8-fc5fe71d9fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:07.328148 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a645787-9630-4605-97d8-fc5fe71d9fdb None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:07.328993 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a645787-9630-4605-97d8-fc5fe71d9fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:07.328993 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a645787-9630-4605-97d8-fc5fe71d9fdb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:07.343353 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a645787-9630-4605-97d8-fc5fe71d9fdb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:07.345071 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a645787-9630-4605-97d8-fc5fe71d9fdb None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:07.362034 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-5a645787-9630-4605-97d8-fc5fe71d9fdb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:07.362034 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:07.362034 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:07.362034 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:07.362034 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:07.362034 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:07.362034 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:07.362034 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:07.362034 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:07.362034 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:07.362034 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:07.362034 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:07.362034 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:23:07.362034 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:23:07.362034 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:23:07.362932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:23:07.362932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:07.362932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:07.362932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:07.362932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:07.362932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:07.362932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:07.362932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:07.362932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:07.362932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:07.362932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:07.362932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:07.362932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:07.362932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:07.362932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:07.362932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:07.362932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:07.363839 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:23:07.363839 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:23:07.363839 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:23:07.363839 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:23:07.363839 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:23:07.363839 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:23:07.363839 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:07.363839 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:07.367671 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 245/482] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Nov 2 07:23:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:07.369527 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a645787-9630-4605-97d8-fc5fe71d9fdb None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:07.423738 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722773d-d670-4346-a5cb-21622bcc7bb4 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:07.477992 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:07.486716 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58195ad8-bdcc-4803-9b16-8dfe8eefcda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:07.487792 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58195ad8-bdcc-4803-9b16-8dfe8eefcda6 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:07.489442 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58195ad8-bdcc-4803-9b16-8dfe8eefcda6 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:07.490611 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58195ad8-bdcc-4803-9b16-8dfe8eefcda6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:07.503336 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58195ad8-bdcc-4803-9b16-8dfe8eefcda6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:07.505468 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58195ad8-bdcc-4803-9b16-8dfe8eefcda6 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:07.528433 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:07.528617 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-58195ad8-bdcc-4803-9b16-8dfe8eefcda6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:07.528617 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:07.528617 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:07.528617 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:07.528617 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:07.528617 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:07.528617 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:07.528617 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:07.528617 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:07.528617 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:07.528617 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:07.528617 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:07.528617 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:23:07.528617 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:23:07.528617 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:23:07.529400 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:23:07.529400 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:07.529400 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:07.529400 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:07.529400 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:07.529400 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:07.529400 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:07.529400 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:07.529400 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:07.529400 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:07.529400 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:07.529400 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:07.529400 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:07.529400 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:07.529400 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:07.529400 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:07.529400 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:07.530689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:23:07.530689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:23:07.530689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:23:07.530689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:23:07.530689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:23:07.530689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:23:07.530689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:07.530689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:07.531530 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 238/483] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Nov 2 07:23:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:23:07.539459 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58195ad8-bdcc-4803-9b16-8dfe8eefcda6 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:07.586159 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a645787-9630-4605-97d8-fc5fe71d9fdb None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:07.643899 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58195ad8-bdcc-4803-9b16-8dfe8eefcda6 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:07.680629 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5735f-fc70-4c37-b9bc-c5c66dd495dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:07.681233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5735f-fc70-4c37-b9bc-c5c66dd495dc None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:07.681512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5735f-fc70-4c37-b9bc-c5c66dd495dc None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:07.681783 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5735f-fc70-4c37-b9bc-c5c66dd495dc None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:07.682532 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde5735f-fc70-4c37-b9bc-c5c66dd495dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:07.682838 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde5735f-fc70-4c37-b9bc-c5c66dd495dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:07.684573 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde5735f-fc70-4c37-b9bc-c5c66dd495dc None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:07.697417 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 239/484] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Nov 2 07:23:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:07.703526 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5735f-fc70-4c37-b9bc-c5c66dd495dc None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:07.716434 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd6197-75d3-42a9-9362-1372e5c4b0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:07.717092 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd6197-75d3-42a9-9362-1372e5c4b0a3 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:07.717368 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd6197-75d3-42a9-9362-1372e5c4b0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:07.717692 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd6197-75d3-42a9-9362-1372e5c4b0a3 None admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:07.718438 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dd6197-75d3-42a9-9362-1372e5c4b0a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:07.718743 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dd6197-75d3-42a9-9362-1372e5c4b0a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:07.720205 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dd6197-75d3-42a9-9362-1372e5c4b0a3 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:07.751768 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 246/485] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Nov 2 07:23:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:07.756285 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd6197-75d3-42a9-9362-1372e5c4b0a3 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:07.812560 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:07.908641 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5735f-fc70-4c37-b9bc-c5c66dd495dc None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:07.958077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd6197-75d3-42a9-9362-1372e5c4b0a3 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:07.963110 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13bcb4a-c4d9-4fcd-9e24-2ade38da62e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:07.963912 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13bcb4a-c4d9-4fcd-9e24-2ade38da62e1 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:07.964357 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13bcb4a-c4d9-4fcd-9e24-2ade38da62e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:07.964766 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13bcb4a-c4d9-4fcd-9e24-2ade38da62e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:07.966663 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13bcb4a-c4d9-4fcd-9e24-2ade38da62e1 None admin] RBAC: Adding query filter params (role.id=4d61be0c9e7b454abd3b0a3330428290, scope.project.id=2c3bf3e930dd407f8401c0487edc8c20, user.id=6c09b7eff03645ab9b7252ea96543719) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:07.967134 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13bcb4a-c4d9-4fcd-9e24-2ade38da62e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:07.969138 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13bcb4a-c4d9-4fcd-9e24-2ade38da62e1 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:07.978162 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 240/486] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Nov 2 07:23:07 2022] GET /identity/v3/role_assignments?user.id=6c09b7eff03645ab9b7252ea96543719&scope.project.id=2c3bf3e930dd407f8401c0487edc8c20&role.id=4d61be0c9e7b454abd3b0a3330428290 => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:07.980316 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b111a2-e18f-464a-8a8d-f25d3f17bf95 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:07.980908 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b111a2-e18f-464a-8a8d-f25d3f17bf95 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:07.981573 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b111a2-e18f-464a-8a8d-f25d3f17bf95 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:07.988695 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 241/487] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:07.990695 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6bbcf-d690-4b6d-bd5c-70534b8c46bf None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:07.991120 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6bbcf-d690-4b6d-bd5c-70534b8c46bf None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:07.991530 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6bbcf-d690-4b6d-bd5c-70534b8c46bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:08.007049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915db7f-76b2-440d-b0db-144ade472601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:08.007837 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915db7f-76b2-440d-b0db-144ade472601 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:08.008261 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915db7f-76b2-440d-b0db-144ade472601 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:08.008628 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915db7f-76b2-440d-b0db-144ade472601 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:08.009491 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915db7f-76b2-440d-b0db-144ade472601 None admin] RBAC: Adding query filter params (role.id=4d61be0c9e7b454abd3b0a3330428290, scope.project.id=2c3bf3e930dd407f8401c0487edc8c20, user.id=c35fe87fc263440980ce70680748e5af) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:08.009904 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915db7f-76b2-440d-b0db-144ade472601 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:08.012633 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915db7f-76b2-440d-b0db-144ade472601 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:08.016694 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:08.019401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-37a6bbcf-d690-4b6d-bd5c-70534b8c46bf None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:08.020807 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-37a6bbcf-d690-4b6d-bd5c-70534b8c46bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:08.020921 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 247/488] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Nov 2 07:23:07 2022] GET /identity/v3/role_assignments?user.id=c35fe87fc263440980ce70680748e5af&scope.project.id=2c3bf3e930dd407f8401c0487edc8c20&role.id=4d61be0c9e7b454abd3b0a3330428290 => generated 608 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:23:08.104177 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 242/489] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:23:08.420091 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915db7f-76b2-440d-b0db-144ade472601 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:08.525718 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915db7f-76b2-440d-b0db-144ade472601 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:08.562875 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0da22f-1db3-4eb5-b582-66bfd0b2cbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:08.563866 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0da22f-1db3-4eb5-b582-66bfd0b2cbb4 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:08.564397 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0da22f-1db3-4eb5-b582-66bfd0b2cbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:08.564863 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0da22f-1db3-4eb5-b582-66bfd0b2cbb4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:08.576330 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0da22f-1db3-4eb5-b582-66bfd0b2cbb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:23:08.581461 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-9b0da22f-1db3-4eb5-b582-66bfd0b2cbb4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:23:08.581461 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:08.581461 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:08.581461 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:08.581461 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:08.581461 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:08.581461 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:08.581461 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:08.581461 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:08.581461 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:08.581461 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:08.581461 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:08.581461 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:23:08.581461 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:23:08.581461 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:23:08.581461 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:23:08.582328 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:23:08.582328 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:23:08.582328 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:23:08.582328 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:23:08.582328 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:08.582328 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:08.582328 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:08.582328 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:08.582328 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:08.582328 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:08.582328 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:08.582328 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:08.582328 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:08.582328 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:08.582328 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:08.582328 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:08.583103 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:08.583103 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:08.583103 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:08.583103 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:08.583103 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:23:08.583103 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:23:08.583103 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:23:08.583103 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:23:08.583103 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:23:08.583103 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:23:08.583103 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:23:08.583103 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:08.585722 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 248/490] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Nov 2 07:23:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:08.592441 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6bbcf-d690-4b6d-bd5c-70534b8c46bf None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:08.641439 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:08.712422 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6bbcf-d690-4b6d-bd5c-70534b8c46bf None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:08.754875 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79689421-98d7-468c-923a-fe3d1a14f723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:08.755864 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79689421-98d7-468c-923a-fe3d1a14f723 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:08.756386 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79689421-98d7-468c-923a-fe3d1a14f723 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:08.756854 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79689421-98d7-468c-923a-fe3d1a14f723 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:08.757718 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79689421-98d7-468c-923a-fe3d1a14f723 None admin] RBAC: Adding query filter params (name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:08.758228 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79689421-98d7-468c-923a-fe3d1a14f723 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:08.759842 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79689421-98d7-468c-923a-fe3d1a14f723 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:08.771777 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 243/491] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Nov 2 07:23:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:08.777711 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0da22f-1db3-4eb5-b582-66bfd0b2cbb4 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:08.788694 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafdf1fd-5409-474c-a9f3-ec56642331b4 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:08.791442 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafdf1fd-5409-474c-a9f3-ec56642331b4 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:08.792002 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafdf1fd-5409-474c-a9f3-ec56642331b4 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:08.796008 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 244/492] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:08.801103 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae4403-58d0-4308-a508-7df00bf14488 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:08.802065 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae4403-58d0-4308-a508-7df00bf14488 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:08.802608 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae4403-58d0-4308-a508-7df00bf14488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:08.830372 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-8fae4403-58d0-4308-a508-7df00bf14488 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:08.831890 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8fae4403-58d0-4308-a508-7df00bf14488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:08.897613 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:08.953736 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0da22f-1db3-4eb5-b582-66bfd0b2cbb4 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:08.990343 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2cc4f-b2c9-4063-b2bf-4aef281ed049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:08.990900 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2cc4f-b2c9-4063-b2bf-4aef281ed049 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:08.991177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2cc4f-b2c9-4063-b2bf-4aef281ed049 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:08.991447 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2cc4f-b2c9-4063-b2bf-4aef281ed049 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:09.003125 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2cc4f-b2c9-4063-b2bf-4aef281ed049 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:09.004857 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2cc4f-b2c9-4063-b2bf-4aef281ed049 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:09.021955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-55b2cc4f-b2c9-4063-b2bf-4aef281ed049 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:09.021955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:09.021955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:09.021955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:09.021955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:09.021955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:09.021955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:09.021955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:09.021955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:09.021955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:09.021955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:09.021955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:09.021955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:09.021955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:09.021955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:09.021955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:09.023077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:09.023077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:09.023077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:09.023077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:09.023077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:09.023077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:09.023077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:09.023077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:09.023077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:09.023077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:09.023077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:09.023077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:09.023077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:09.023077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:09.023077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:09.023077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:09.023077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:09.023922 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:09.023922 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:09.023922 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:09.023922 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 249/493] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:09.030281 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2cc4f-b2c9-4063-b2bf-4aef281ed049 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:09.043730 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 245/494] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:23:09.150780 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2cc4f-b2c9-4063-b2bf-4aef281ed049 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:09.166335 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:09.190919 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb33969-1e82-487a-a0f8-4f6517b3b3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:09.191527 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb33969-1e82-487a-a0f8-4f6517b3b3bb None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:09.191800 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb33969-1e82-487a-a0f8-4f6517b3b3bb None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:09.192084 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb33969-1e82-487a-a0f8-4f6517b3b3bb None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:09.192712 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb33969-1e82-487a-a0f8-4f6517b3b3bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:09.193020 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb33969-1e82-487a-a0f8-4f6517b3b3bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:09.194343 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb33969-1e82-487a-a0f8-4f6517b3b3bb None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:09.215742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 250/495] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:09.223136 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae4403-58d0-4308-a508-7df00bf14488 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:09.289391 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:09.368367 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae4403-58d0-4308-a508-7df00bf14488 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:09.409618 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5a59f-c0e1-47a6-adeb-39ef8e56212b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:09.410609 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5a59f-c0e1-47a6-adeb-39ef8e56212b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:09.411169 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5a59f-c0e1-47a6-adeb-39ef8e56212b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:09.411664 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5a59f-c0e1-47a6-adeb-39ef8e56212b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:09.419224 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb5a59f-c0e1-47a6-adeb-39ef8e56212b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:09.420913 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb5a59f-c0e1-47a6-adeb-39ef8e56212b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:09.432602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-ceb5a59f-c0e1-47a6-adeb-39ef8e56212b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 02 07:23:09.432602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:09.432602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:09.432602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:09.432602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:09.432602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:09.432602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:09.432602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:09.432602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:09.432602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:09.432602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:09.432602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:09.432602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:23:09.432602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:23:09.432602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:23:09.432602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:23:09.434128 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:09.434128 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:09.434128 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:23:09.434128 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:09.434128 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:23:09.434128 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:09.434128 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:09.434128 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:09.434128 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:09.434128 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:09.434128 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:09.434128 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:09.434128 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:09.434128 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:09.434128 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:09.434128 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:09.434128 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:09.434128 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:09.435274 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:09.435274 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:09.435274 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:23:09.435274 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:23:09.435274 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:23:09.435274 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:23:09.435274 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:23:09.435274 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:23:09.435274 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Nov 02 07:23:09.435274 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:09.437816 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 246/496] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Nov 2 07:23:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:09.449118 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb33969-1e82-487a-a0f8-4f6517b3b3bb None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:09.499467 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5a59f-c0e1-47a6-adeb-39ef8e56212b None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:09.636394 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb33969-1e82-487a-a0f8-4f6517b3b3bb None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:09.648447 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:09.655590 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5a59f-c0e1-47a6-adeb-39ef8e56212b None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:09.709097 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9f3b5-d8c5-42e1-8880-9cd3c522f763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:09.709736 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9f3b5-d8c5-42e1-8880-9cd3c522f763 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:09.710011 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9f3b5-d8c5-42e1-8880-9cd3c522f763 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:09.710281 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9f3b5-d8c5-42e1-8880-9cd3c522f763 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:09.719242 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f07fc-c19b-40fc-872a-61cf4c3ac4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:09.719849 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f07fc-c19b-40fc-872a-61cf4c3ac4fe None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:09.720146 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f07fc-c19b-40fc-872a-61cf4c3ac4fe None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:09.723016 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f07fc-c19b-40fc-872a-61cf4c3ac4fe None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:09.724666 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f07fc-c19b-40fc-872a-61cf4c3ac4fe None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:09.724978 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f07fc-c19b-40fc-872a-61cf4c3ac4fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:09.726434 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f07fc-c19b-40fc-872a-61cf4c3ac4fe None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:09.739679 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b9f3b5-d8c5-42e1-8880-9cd3c522f763 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:09.741161 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b9f3b5-d8c5-42e1-8880-9cd3c522f763 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:09.757080 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-c2b9f3b5-d8c5-42e1-8880-9cd3c522f763 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:09.757080 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:09.757080 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:09.757080 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:09.757080 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:09.757080 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:09.757080 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:09.757080 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:09.757080 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:09.757080 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:09.757080 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:09.757080 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:09.757080 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:09.757080 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:09.757080 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:09.757080 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:09.758035 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:09.758035 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:09.758035 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:09.758035 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:09.758035 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:09.758035 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:09.758035 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:09.758035 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:09.758035 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:09.758035 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:09.758035 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:09.758035 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:09.758035 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:09.758035 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:09.758035 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:09.758035 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:09.758035 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:09.759284 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:09.759284 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:09.759284 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:09.759284 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 247/497] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:09.761106 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 251/498] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Nov 2 07:23:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:09.767108 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9f3b5-d8c5-42e1-8880-9cd3c522f763 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:09.767334 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f07fc-c19b-40fc-872a-61cf4c3ac4fe None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:09.802378 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:09.874416 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9f3b5-d8c5-42e1-8880-9cd3c522f763 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:09.881112 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f07fc-c19b-40fc-872a-61cf4c3ac4fe None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:09.910458 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db7763-f311-450f-b59d-bdc9d63bd340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:09.911378 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db7763-f311-450f-b59d-bdc9d63bd340 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:09.911857 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db7763-f311-450f-b59d-bdc9d63bd340 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:09.912363 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db7763-f311-450f-b59d-bdc9d63bd340 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:09.913334 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db7763-f311-450f-b59d-bdc9d63bd340 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:09.913829 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db7763-f311-450f-b59d-bdc9d63bd340 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:09.915388 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db7763-f311-450f-b59d-bdc9d63bd340 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:09.918348 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b3be8c-c74a-4cd9-8879-b616b4cdb7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:09.918963 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3be8c-c74a-4cd9-8879-b616b4cdb7a1 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:09.919244 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3be8c-c74a-4cd9-8879-b616b4cdb7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:09.919517 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3be8c-c74a-4cd9-8879-b616b4cdb7a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:09.933357 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 248/499] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:09.935757 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576c92a-488d-4b0e-8ed4-af5dbf30214c None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:09.936366 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576c92a-488d-4b0e-8ed4-af5dbf30214c None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:09.936839 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576c92a-488d-4b0e-8ed4-af5dbf30214c None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:09.938643 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 249/500] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:09.939550 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576c92a-488d-4b0e-8ed4-af5dbf30214c None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:09.953005 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:10.009722 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b3be8c-c74a-4cd9-8879-b616b4cdb7a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:10.011170 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b3be8c-c74a-4cd9-8879-b616b4cdb7a1 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:10.044113 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:10.053439 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576c92a-488d-4b0e-8ed4-af5dbf30214c None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:10.094148 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071071b-a4ed-4db6-8a0f-524e369d6a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:10.094771 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071071b-a4ed-4db6-8a0f-524e369d6a9b None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:10.095512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071071b-a4ed-4db6-8a0f-524e369d6a9b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:10.095798 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071071b-a4ed-4db6-8a0f-524e369d6a9b None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:10.096495 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1071071b-a4ed-4db6-8a0f-524e369d6a9b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:10.098331 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1071071b-a4ed-4db6-8a0f-524e369d6a9b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:10.125083 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 252/501] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Nov 2 07:23:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:23:10.126778 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255e169-caa0-4c32-b626-c3a795905d9e None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:10.127200 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255e169-caa0-4c32-b626-c3a795905d9e None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:10.127612 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255e169-caa0-4c32-b626-c3a795905d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:10.147555 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-8255e169-caa0-4c32-b626-c3a795905d9e None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:10.149130 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-8255e169-caa0-4c32-b626-c3a795905d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:10.184375 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 250/502] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Nov 2 07:23:09 2022] POST /identity/v3/users => generated 254 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:23:10.186380 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071071b-a4ed-4db6-8a0f-524e369d6a9b None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:10.276223 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 253/503] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:23:10.314865 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:10.359003 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071071b-a4ed-4db6-8a0f-524e369d6a9b None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:10.407178 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4005d9-5fa7-4b44-8c1c-857c77bf5a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:10.408202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4005d9-5fa7-4b44-8c1c-857c77bf5a1f None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:10.408695 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4005d9-5fa7-4b44-8c1c-857c77bf5a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:10.409105 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4005d9-5fa7-4b44-8c1c-857c77bf5a1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:10.422155 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4005d9-5fa7-4b44-8c1c-857c77bf5a1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:10.424016 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4005d9-5fa7-4b44-8c1c-857c77bf5a1f None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:10.441305 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-ec4005d9-5fa7-4b44-8c1c-857c77bf5a1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:10.441305 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:10.441305 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:10.441305 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:10.441305 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:10.441305 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:10.441305 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:10.441305 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:10.441305 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:10.441305 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:10.441305 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:10.441305 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:10.441305 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:10.441305 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:10.441305 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:10.441305 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:10.442462 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:10.442462 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:10.442462 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:10.442462 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:10.442462 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:10.442462 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:10.442462 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:10.442462 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:10.442462 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:10.442462 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:10.442462 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:10.442462 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:10.442462 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:10.442462 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:10.442462 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:10.442462 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:10.442462 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:10.443538 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:10.443538 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:10.443538 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:10.445352 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 251/504] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:10.450656 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255e169-caa0-4c32-b626-c3a795905d9e None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:10.516153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:10.564635 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255e169-caa0-4c32-b626-c3a795905d9e None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:10.602720 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107271bc-a959-468f-9bf5-09da6108feaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:10.616361 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107271bc-a959-468f-9bf5-09da6108feaf None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:10.616361 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107271bc-a959-468f-9bf5-09da6108feaf None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:10.616361 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107271bc-a959-468f-9bf5-09da6108feaf None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:10.616361 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107271bc-a959-468f-9bf5-09da6108feaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:10.616361 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107271bc-a959-468f-9bf5-09da6108feaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:10.616361 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107271bc-a959-468f-9bf5-09da6108feaf None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:10.624775 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 254/505] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:10.631220 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4005d9-5fa7-4b44-8c1c-857c77bf5a1f None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:10.639838 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c9576-1a0c-4550-b0fb-e68426fb3797 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:10.639838 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c9576-1a0c-4550-b0fb-e68426fb3797 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:10.639838 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c9576-1a0c-4550-b0fb-e68426fb3797 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:10.639838 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 255/506] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:10.645462 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f2fc6-7bb6-4f79-bb4e-9beaf4c99786 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:10.645754 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f2fc6-7bb6-4f79-bb4e-9beaf4c99786 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:10.646005 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f2fc6-7bb6-4f79-bb4e-9beaf4c99786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:10.665410 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-f19f2fc6-7bb6-4f79-bb4e-9beaf4c99786 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:10.666709 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f19f2fc6-7bb6-4f79-bb4e-9beaf4c99786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:10.749326 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 256/507] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:23:10.750081 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f2fc6-7bb6-4f79-bb4e-9beaf4c99786 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:10.761378 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4005d9-5fa7-4b44-8c1c-857c77bf5a1f None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:10.785240 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:10.805573 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:10.807716 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60121908-444a-4015-83e3-590a92c67718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:10.808558 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60121908-444a-4015-83e3-590a92c67718 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:10.809456 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60121908-444a-4015-83e3-590a92c67718 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:10.809792 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60121908-444a-4015-83e3-590a92c67718 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:10.819553 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60121908-444a-4015-83e3-590a92c67718 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:10.821467 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60121908-444a-4015-83e3-590a92c67718 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:10.835826 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-60121908-444a-4015-83e3-590a92c67718 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:10.835826 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:10.835826 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:10.835826 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:10.835826 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:10.835826 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:10.835826 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:10.835826 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:10.835826 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:10.835826 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:10.835826 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:10.835826 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:10.835826 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:23:10.835826 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:23:10.835826 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:23:10.836796 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:23:10.836796 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:10.836796 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:10.836796 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:10.836796 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:10.836796 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:10.836796 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:10.836796 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:10.836796 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:10.836796 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:10.836796 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:10.836796 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:10.836796 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:10.836796 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:10.836796 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:10.836796 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:10.836796 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:10.838236 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:23:10.838236 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:23:10.838236 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:23:10.838236 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:23:10.838236 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:23:10.838236 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:23:10.838236 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:10.838236 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:10.838236 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 252/508] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Nov 2 07:23:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:10.838795 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02cc71-f8dd-4df2-abdd-6a2ad79dd9a4 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:10.841379 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02cc71-f8dd-4df2-abdd-6a2ad79dd9a4 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:10.841678 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02cc71-f8dd-4df2-abdd-6a2ad79dd9a4 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:10.844560 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 253/509] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:10.844560 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02cc71-f8dd-4df2-abdd-6a2ad79dd9a4 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:10.863251 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f2fc6-7bb6-4f79-bb4e-9beaf4c99786 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:10.904281 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a5e29-b19b-49c1-b6ad-3ff04c542755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:10.905370 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a5e29-b19b-49c1-b6ad-3ff04c542755 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:10.905846 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a5e29-b19b-49c1-b6ad-3ff04c542755 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:10.906312 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a5e29-b19b-49c1-b6ad-3ff04c542755 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:10.917373 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a5e29-b19b-49c1-b6ad-3ff04c542755 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:23:10.923153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-159a5e29-b19b-49c1-b6ad-3ff04c542755 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:23:10.923153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:10.923153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:10.923153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:10.923153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:10.923153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:10.923153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:10.923153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:10.923153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:10.923153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:10.923153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:10.923153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:10.923153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:23:10.923153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:23:10.923153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:23:10.923153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:23:10.924081 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:23:10.924081 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:23:10.924081 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:23:10.924081 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:23:10.924081 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:10.924081 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:10.924081 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:10.924081 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:10.924081 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:10.924081 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:10.924081 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:10.924081 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:10.924081 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:10.924081 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:10.924081 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:10.924081 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:10.924944 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:10.924944 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:10.924944 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:10.924944 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:10.924944 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:23:10.924944 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:23:10.924944 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:23:10.924944 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:23:10.924944 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:23:10.924944 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:23:10.924944 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:23:10.924944 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:10.927348 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 257/510] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Nov 2 07:23:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:10.928994 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa940ff0-03ec-4344-8271-ba5748cf6196 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:10.929472 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa940ff0-03ec-4344-8271-ba5748cf6196 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:10.929984 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa940ff0-03ec-4344-8271-ba5748cf6196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:10.949783 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-aa940ff0-03ec-4344-8271-ba5748cf6196 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:10.951233 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-aa940ff0-03ec-4344-8271-ba5748cf6196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:10.982744 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02cc71-f8dd-4df2-abdd-6a2ad79dd9a4 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:11.021857 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806b379-b839-46f0-be36-deed49497bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:11.022359 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806b379-b839-46f0-be36-deed49497bf0 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:11.022631 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806b379-b839-46f0-be36-deed49497bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:11.022898 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806b379-b839-46f0-be36-deed49497bf0 None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:11.023582 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806b379-b839-46f0-be36-deed49497bf0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:11.024195 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806b379-b839-46f0-be36-deed49497bf0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:11.025372 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806b379-b839-46f0-be36-deed49497bf0 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:11.038204 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 254/511] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Nov 2 07:23:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:11.039116 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806b379-b839-46f0-be36-deed49497bf0 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:11.040880 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 258/512] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:23:11.045021 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa940ff0-03ec-4344-8271-ba5748cf6196 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:11.083301 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:11.096679 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:11.147130 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806b379-b839-46f0-be36-deed49497bf0 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:11.170170 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa940ff0-03ec-4344-8271-ba5748cf6196 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:11.185539 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39e9e6-c42a-4f4e-9d20-e48f833da092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:11.186453 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39e9e6-c42a-4f4e-9d20-e48f833da092 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:11.186896 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39e9e6-c42a-4f4e-9d20-e48f833da092 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:11.187410 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39e9e6-c42a-4f4e-9d20-e48f833da092 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:11.188265 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be39e9e6-c42a-4f4e-9d20-e48f833da092 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:11.188736 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be39e9e6-c42a-4f4e-9d20-e48f833da092 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:11.190365 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be39e9e6-c42a-4f4e-9d20-e48f833da092 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:11.200989 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 255/513] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Nov 2 07:23:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:11.202127 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39e9e6-c42a-4f4e-9d20-e48f833da092 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:11.213947 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7707d0-bf89-4955-9e2e-5c51f106a0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:11.214651 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7707d0-bf89-4955-9e2e-5c51f106a0a1 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:11.215509 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7707d0-bf89-4955-9e2e-5c51f106a0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:11.215826 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7707d0-bf89-4955-9e2e-5c51f106a0a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:11.216911 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7707d0-bf89-4955-9e2e-5c51f106a0a1 None admin] RBAC: Adding query filter params (role.id=4d61be0c9e7b454abd3b0a3330428290, scope.project.id=2c3bf3e930dd407f8401c0487edc8c20, user.id=68d63a04c2d74c90b95a4f48c49ddb29) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:11.217290 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7707d0-bf89-4955-9e2e-5c51f106a0a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:11.218965 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7707d0-bf89-4955-9e2e-5c51f106a0a1 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:11.227397 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 259/514] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Nov 2 07:23:11 2022] GET /identity/v3/role_assignments?user.id=68d63a04c2d74c90b95a4f48c49ddb29&scope.project.id=2c3bf3e930dd407f8401c0487edc8c20&role.id=4d61be0c9e7b454abd3b0a3330428290 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:11.228307 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7707d0-bf89-4955-9e2e-5c51f106a0a1 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:11.314508 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:11.318233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39e9e6-c42a-4f4e-9d20-e48f833da092 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:11.363662 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992462a2-1212-4158-9114-3ec8b74b16ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:11.364488 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992462a2-1212-4158-9114-3ec8b74b16ea None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:11.364906 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992462a2-1212-4158-9114-3ec8b74b16ea None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:11.365252 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992462a2-1212-4158-9114-3ec8b74b16ea None admin] PATH_INFO: `/v3/services/network` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:11.365908 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992462a2-1212-4158-9114-3ec8b74b16ea None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:11.367611 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992462a2-1212-4158-9114-3ec8b74b16ea None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:11.371336 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7707d0-bf89-4955-9e2e-5c51f106a0a1 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:11.375293 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:11.383096 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-992462a2-1212-4158-9114-3ec8b74b16ea None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 07:23:11.383096 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:11.383096 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:11.383096 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:11.383096 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:11.383096 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:11.383096 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:11.383096 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:11.383096 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 07:23:11.383096 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:11.383096 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:11.383096 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:11.383096 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:11.383096 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:11.383096 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:11.383096 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:11.383096 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:11.389356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:11.389356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:11.389356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:11.389356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:11.389356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:11.389356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:11.389356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:11.389356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:11.389356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:11.389356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:11.389356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:11.389356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:11.389356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:11.389356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:11.389356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:11.389356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:11.390200 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:11.390200 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:11.390200 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:11.390200 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:11.390200 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:11.390200 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:11.390200 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:11.390200 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:11.390200 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:11.390200 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:11.390200 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:11.390200 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:11.390200 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 07:23:11.390200 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:11.390200 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 256/515] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Nov 2 07:23:11 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:11.390979 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992462a2-1212-4158-9114-3ec8b74b16ea None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:11.423904 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f768b-8050-43f0-ae3a-04ab17974453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:11.424749 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f768b-8050-43f0-ae3a-04ab17974453 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:11.425143 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f768b-8050-43f0-ae3a-04ab17974453 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:11.425558 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f768b-8050-43f0-ae3a-04ab17974453 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:11.440598 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f768b-8050-43f0-ae3a-04ab17974453 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:11.442907 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f768b-8050-43f0-ae3a-04ab17974453 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:11.461753 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-667f768b-8050-43f0-ae3a-04ab17974453 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:11.461753 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:11.461753 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:11.461753 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:11.461753 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:11.461753 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:11.461753 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:11.461753 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:11.461753 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:11.461753 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:11.461753 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:11.461753 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:11.461753 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:11.461753 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:11.461753 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:11.461753 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:11.463373 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:11.463373 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:11.463373 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:11.463373 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:11.463373 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:11.463373 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:11.463373 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:11.463373 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:11.463373 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:11.463373 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:11.463373 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:11.463373 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:11.463373 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:11.463373 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:11.463373 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:11.463373 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:11.463373 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:11.464477 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:11.464477 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:11.464477 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:11.464477 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 260/516] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:11.464477 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f768b-8050-43f0-ae3a-04ab17974453 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:11.545965 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992462a2-1212-4158-9114-3ec8b74b16ea None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:11.591571 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f768b-8050-43f0-ae3a-04ab17974453 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:11.592987 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406af748-b99d-4ea9-871c-22766859be72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:11.593955 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406af748-b99d-4ea9-871c-22766859be72 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:11.595217 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406af748-b99d-4ea9-871c-22766859be72 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:11.595565 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406af748-b99d-4ea9-871c-22766859be72 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:11.596276 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406af748-b99d-4ea9-871c-22766859be72 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:11.597726 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406af748-b99d-4ea9-871c-22766859be72 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:11.611075 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-406af748-b99d-4ea9-871c-22766859be72 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 07:23:11.611075 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:11.611075 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:11.611075 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:11.611075 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:11.611075 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:11.611075 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:11.611075 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:11.611075 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 07:23:11.611075 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:11.611075 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:11.611075 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:11.611075 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:11.611075 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:11.611075 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:11.611075 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:11.611075 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:11.612283 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:11.612283 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:11.612283 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:11.612283 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:11.612283 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:11.612283 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:11.612283 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:11.612283 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:11.612283 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:11.612283 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:11.612283 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:11.612283 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:11.612283 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:11.612283 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:11.612283 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:11.612283 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:11.613291 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:11.613291 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:11.613291 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:11.613291 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:11.613291 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:11.613291 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:11.613291 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:11.613291 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:11.613291 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:11.613291 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:11.613291 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:11.613291 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:11.613291 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 07:23:11.613291 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:11.614444 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 257/517] 10.222.0.16 () {56 vars in 1129 bytes} [Wed Nov 2 07:23:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:11.618523 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406af748-b99d-4ea9-871c-22766859be72 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:11.631125 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e1da1a-608d-4b3c-b42e-c39181baeca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:11.631732 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1da1a-608d-4b3c-b42e-c39181baeca9 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:11.632008 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1da1a-608d-4b3c-b42e-c39181baeca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:11.632310 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1da1a-608d-4b3c-b42e-c39181baeca9 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:11.632927 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e1da1a-608d-4b3c-b42e-c39181baeca9 None admin] RBAC: Adding query filter params (name=network) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:11.633224 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e1da1a-608d-4b3c-b42e-c39181baeca9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:11.634575 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e1da1a-608d-4b3c-b42e-c39181baeca9 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:11.640008 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 261/518] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Nov 2 07:23:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:11.640986 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e1da1a-608d-4b3c-b42e-c39181baeca9 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:11.655667 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:11.665366 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:11.744465 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406af748-b99d-4ea9-871c-22766859be72 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:11.757355 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e1da1a-608d-4b3c-b42e-c39181baeca9 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:11.780180 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d39e3-b846-45db-aece-728ed0e717c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:11.780849 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d39e3-b846-45db-aece-728ed0e717c3 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:11.781133 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d39e3-b846-45db-aece-728ed0e717c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:11.781414 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d39e3-b846-45db-aece-728ed0e717c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:11.782052 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d39e3-b846-45db-aece-728ed0e717c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:11.782355 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d39e3-b846-45db-aece-728ed0e717c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:11.783730 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d39e3-b846-45db-aece-728ed0e717c3 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:11.798743 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 258/519] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:11.800406 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d39e3-b846-45db-aece-728ed0e717c3 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:11.807171 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47b022-67b9-4801-8a7a-a11afaab725f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:11.807883 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47b022-67b9-4801-8a7a-a11afaab725f None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:11.808266 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47b022-67b9-4801-8a7a-a11afaab725f None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:11.808673 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47b022-67b9-4801-8a7a-a11afaab725f None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:11.809377 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b47b022-67b9-4801-8a7a-a11afaab725f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:11.809744 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b47b022-67b9-4801-8a7a-a11afaab725f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:11.811297 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b47b022-67b9-4801-8a7a-a11afaab725f None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:11.816470 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 262/520] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Nov 2 07:23:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:11.817430 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47b022-67b9-4801-8a7a-a11afaab725f None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:11.915647 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:11.931203 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:11.932710 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47b022-67b9-4801-8a7a-a11afaab725f None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:11.961187 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d39e3-b846-45db-aece-728ed0e717c3 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:11.972141 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f1757-fe16-4155-abca-c1edb9e42882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:11.973063 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f1757-fe16-4155-abca-c1edb9e42882 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:11.973562 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f1757-fe16-4155-abca-c1edb9e42882 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:11.974027 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f1757-fe16-4155-abca-c1edb9e42882 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:11.982032 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5f1757-fe16-4155-abca-c1edb9e42882 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:11.983718 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5f1757-fe16-4155-abca-c1edb9e42882 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:11.995600 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-fd5f1757-fe16-4155-abca-c1edb9e42882 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:23:11.995600 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:11.995600 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:11.995600 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:11.995600 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:11.995600 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:11.995600 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:11.995600 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:11.995600 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:11.995600 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:11.995600 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:11.995600 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:11.995600 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:23:11.995600 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:23:11.995600 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:23:11.995600 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:23:11.996829 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:11.996829 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:11.996829 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:23:11.996829 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:11.996829 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:23:11.996829 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:11.996829 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:11.996829 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:11.996829 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:11.996829 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:11.996829 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:11.996829 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:11.996829 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:11.996829 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:11.996829 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:11.996829 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:11.996829 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:11.996829 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:11.997758 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:11.997758 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:11.997758 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:23:11.997758 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:23:11.997758 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:23:11.997758 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:23:11.997758 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:23:11.997758 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:23:11.997758 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:23:11.997758 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:12.004843 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 263/521] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Nov 2 07:23:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:12.005861 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f1757-fe16-4155-abca-c1edb9e42882 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:12.006807 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f6152-6eb5-448e-abcb-39be3da1e5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:12.007412 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f6152-6eb5-448e-abcb-39be3da1e5bf None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:12.008096 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f6152-6eb5-448e-abcb-39be3da1e5bf None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:12.008369 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f6152-6eb5-448e-abcb-39be3da1e5bf None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:12.009035 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f6152-6eb5-448e-abcb-39be3da1e5bf None admin] RBAC: Adding query filter params (type=network) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:12.009385 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f6152-6eb5-448e-abcb-39be3da1e5bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:12.012793 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f6152-6eb5-448e-abcb-39be3da1e5bf None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:12.024146 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 259/522] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Nov 2 07:23:11 2022] GET /identity/v3/services?type=network => generated 124 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:12.025413 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f6152-6eb5-448e-abcb-39be3da1e5bf None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:12.200892 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f1757-fe16-4155-abca-c1edb9e42882 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:12.230181 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f6152-6eb5-448e-abcb-39be3da1e5bf None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:12.238972 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe87f85-103a-4efb-bb2e-a0eaee86474c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:12.239589 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe87f85-103a-4efb-bb2e-a0eaee86474c None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:12.239864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe87f85-103a-4efb-bb2e-a0eaee86474c None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:12.240165 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe87f85-103a-4efb-bb2e-a0eaee86474c None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:12.240797 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe87f85-103a-4efb-bb2e-a0eaee86474c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:12.241096 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe87f85-103a-4efb-bb2e-a0eaee86474c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:12.242513 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe87f85-103a-4efb-bb2e-a0eaee86474c None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:12.250091 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 264/523] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Nov 2 07:23:12 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:12.269467 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61643727-9012-4d0c-b43e-13279898c127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:12.270097 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61643727-9012-4d0c-b43e-13279898c127 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:12.270373 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61643727-9012-4d0c-b43e-13279898c127 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:12.270642 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61643727-9012-4d0c-b43e-13279898c127 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:12.271388 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61643727-9012-4d0c-b43e-13279898c127 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:12.271689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61643727-9012-4d0c-b43e-13279898c127 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:12.273373 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61643727-9012-4d0c-b43e-13279898c127 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:12.295142 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 260/524] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Nov 2 07:23:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:12.301147 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe87f85-103a-4efb-bb2e-a0eaee86474c None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:12.315750 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:12.441789 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe87f85-103a-4efb-bb2e-a0eaee86474c None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:12.488115 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642cda7-8b62-49b9-9fca-9f49d8aeac7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:12.488700 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642cda7-8b62-49b9-9fca-9f49d8aeac7d None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:12.488983 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642cda7-8b62-49b9-9fca-9f49d8aeac7d None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:12.489219 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642cda7-8b62-49b9-9fca-9f49d8aeac7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:12.503190 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642cda7-8b62-49b9-9fca-9f49d8aeac7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:12.504945 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642cda7-8b62-49b9-9fca-9f49d8aeac7d None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:12.524581 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-2642cda7-8b62-49b9-9fca-9f49d8aeac7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:12.524581 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:12.524581 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:12.524581 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:12.524581 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:12.524581 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:12.524581 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:12.524581 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:12.524581 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:12.524581 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:12.524581 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:12.524581 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:12.524581 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:12.524581 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:12.524581 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:12.524581 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:12.525566 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:12.525566 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:12.525566 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:12.525566 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:12.525566 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:12.525566 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:12.525566 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:12.525566 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:12.525566 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:12.525566 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:12.525566 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:12.525566 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:12.525566 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:12.525566 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:12.525566 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:12.525566 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:12.525566 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:12.526451 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:12.526451 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:12.526451 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:12.532162 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 265/525] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:12.534664 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61643727-9012-4d0c-b43e-13279898c127 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:12.557005 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:12.686231 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61643727-9012-4d0c-b43e-13279898c127 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:12.733589 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf0cf9-22b5-4958-8bc9-f56e5b903851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:12.734556 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf0cf9-22b5-4958-8bc9-f56e5b903851 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:12.735081 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf0cf9-22b5-4958-8bc9-f56e5b903851 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:12.735543 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf0cf9-22b5-4958-8bc9-f56e5b903851 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:12.736435 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf0cf9-22b5-4958-8bc9-f56e5b903851 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:12.736944 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf0cf9-22b5-4958-8bc9-f56e5b903851 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:12.738542 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf0cf9-22b5-4958-8bc9-f56e5b903851 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:12.755256 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 261/526] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:12.760996 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642cda7-8b62-49b9-9fca-9f49d8aeac7d None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:12.837180 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:12.894424 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642cda7-8b62-49b9-9fca-9f49d8aeac7d None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:12.942657 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d169c32-b5ba-4d24-9e92-c279322cfc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:12.943386 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d169c32-b5ba-4d24-9e92-c279322cfc44 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:12.943562 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d169c32-b5ba-4d24-9e92-c279322cfc44 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:12.943826 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d169c32-b5ba-4d24-9e92-c279322cfc44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:12.956851 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d169c32-b5ba-4d24-9e92-c279322cfc44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:12.958299 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d169c32-b5ba-4d24-9e92-c279322cfc44 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:12.963981 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd0142-0968-466c-b594-f652ac406445 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:12.965409 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd0142-0968-466c-b594-f652ac406445 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:12.965906 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd0142-0968-466c-b594-f652ac406445 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:12.967866 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 262/527] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:12.973465 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c23774-004e-4752-929d-fa9b3b7bbd9c None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:12.973995 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c23774-004e-4752-929d-fa9b3b7bbd9c None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:12.974487 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c23774-004e-4752-929d-fa9b3b7bbd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:12.977515 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-0d169c32-b5ba-4d24-9e92-c279322cfc44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:12.977515 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:12.977515 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:12.977515 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:12.977515 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:12.977515 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:12.977515 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:12.977515 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:12.977515 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:12.977515 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:12.977515 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:12.977515 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:12.977515 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:23:12.977515 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:23:12.977515 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:23:12.978390 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:23:12.978390 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:12.978390 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:12.978390 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:12.978390 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:12.978390 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:12.978390 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:12.978390 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:12.978390 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:12.978390 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:12.978390 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:12.978390 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:12.978390 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:12.978390 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:12.978390 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:12.978390 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:12.978390 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:12.979386 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:23:12.979386 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:23:12.979386 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:23:12.979386 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:23:12.979386 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:23:12.979386 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:23:12.979386 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:12.979386 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:12.979386 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 266/528] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Nov 2 07:23:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:12.984696 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d169c32-b5ba-4d24-9e92-c279322cfc44 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:12.999055 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-e1c23774-004e-4752-929d-fa9b3b7bbd9c None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:13.001052 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e1c23774-004e-4752-929d-fa9b3b7bbd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:13.076416 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:13.083383 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 263/529] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:23:13.147337 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d169c32-b5ba-4d24-9e92-c279322cfc44 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:13.169556 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:13.184482 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45fba1-b8a8-4cf9-b687-b4139f65f59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:13.185162 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45fba1-b8a8-4cf9-b687-b4139f65f59f None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:13.185438 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45fba1-b8a8-4cf9-b687-b4139f65f59f None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:13.185708 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45fba1-b8a8-4cf9-b687-b4139f65f59f None admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:13.186391 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45fba1-b8a8-4cf9-b687-b4139f65f59f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:13.186690 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45fba1-b8a8-4cf9-b687-b4139f65f59f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:13.188127 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45fba1-b8a8-4cf9-b687-b4139f65f59f None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:13.200640 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 267/530] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Nov 2 07:23:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:23:13.206639 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c23774-004e-4752-929d-fa9b3b7bbd9c None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:13.325531 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c23774-004e-4752-929d-fa9b3b7bbd9c None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:13.369466 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33fa5a-06d3-442c-8447-851b89745594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:13.370217 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33fa5a-06d3-442c-8447-851b89745594 None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:13.370496 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33fa5a-06d3-442c-8447-851b89745594 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:13.370766 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33fa5a-06d3-442c-8447-851b89745594 None admin] PATH_INFO: `/v3/projects/2c3bf3e930dd407f8401c0487edc8c20/users/232210eabdfd4969a348d7333c50c438/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:13.373311 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d33fa5a-06d3-442c-8447-851b89745594 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c3bf3e930dd407f8401c0487edc8c20, user_id=232210eabdfd4969a348d7333c50c438, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:13.374795 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d33fa5a-06d3-442c-8447-851b89745594 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:13.430185 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45fba1-b8a8-4cf9-b687-b4139f65f59f None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:13.466767 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 264/531] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Nov 2 07:23:13 2022] PUT /identity/v3/projects/2c3bf3e930dd407f8401c0487edc8c20/users/232210eabdfd4969a348d7333c50c438/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:23:13.550434 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45fba1-b8a8-4cf9-b687-b4139f65f59f None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:13.595529 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaac39f-ccd9-47a7-ba88-5fee69ab8ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:13.596222 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaac39f-ccd9-47a7-ba88-5fee69ab8ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:13.596503 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaac39f-ccd9-47a7-ba88-5fee69ab8ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:13.596775 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaac39f-ccd9-47a7-ba88-5fee69ab8ad4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:13.615419 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaac39f-ccd9-47a7-ba88-5fee69ab8ad4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:23:13.620729 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-3eaac39f-ccd9-47a7-ba88-5fee69ab8ad4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:23:13.620729 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:13.620729 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:13.620729 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:13.620729 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:13.620729 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:13.620729 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:13.620729 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:13.620729 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:13.620729 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:13.620729 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:13.620729 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:13.620729 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:23:13.620729 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:23:13.620729 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:23:13.620729 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:23:13.621791 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:23:13.621791 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:23:13.621791 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:23:13.621791 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:23:13.621791 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:13.621791 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:13.621791 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:13.621791 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:13.621791 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:13.621791 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:13.621791 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:13.621791 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:13.621791 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:13.621791 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:13.621791 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:13.621791 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:13.622608 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:13.622608 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:13.622608 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:13.622608 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:13.622608 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:23:13.622608 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:23:13.622608 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:23:13.622608 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:23:13.622608 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:23:13.622608 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:23:13.622608 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:23:13.622608 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:13.625014 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 268/532] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Nov 2 07:23:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:13.631394 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33fa5a-06d3-442c-8447-851b89745594 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:13.735482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:13.788852 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33fa5a-06d3-442c-8447-851b89745594 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:13.839389 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ccfb4-b1fc-4251-91f5-c939f7e1ec38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:13.840588 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ccfb4-b1fc-4251-91f5-c939f7e1ec38 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:13.840865 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ccfb4-b1fc-4251-91f5-c939f7e1ec38 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:13.841134 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ccfb4-b1fc-4251-91f5-c939f7e1ec38 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:13.841804 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ccfb4-b1fc-4251-91f5-c939f7e1ec38 None admin] RBAC: Adding query filter params (name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:13.842099 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ccfb4-b1fc-4251-91f5-c939f7e1ec38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:13.843528 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ccfb4-b1fc-4251-91f5-c939f7e1ec38 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:13.860142 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 265/533] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Nov 2 07:23:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:13.865241 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaac39f-ccd9-47a7-ba88-5fee69ab8ad4 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:13.946575 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:14.014478 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b5b5f-a9bb-4f43-9da7-dd7c16fab4da None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:14.015027 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b5b5f-a9bb-4f43-9da7-dd7c16fab4da None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:14.015027 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b5b5f-a9bb-4f43-9da7-dd7c16fab4da None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:14.016507 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 266/534] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:14.026413 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068927a-d8b5-49d1-8ebd-be4a545753df None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:14.026888 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068927a-d8b5-49d1-8ebd-be4a545753df None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:14.027351 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068927a-d8b5-49d1-8ebd-be4a545753df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:14.051065 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaac39f-ccd9-47a7-ba88-5fee69ab8ad4 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:14.063109 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-e068927a-d8b5-49d1-8ebd-be4a545753df None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:14.064564 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e068927a-d8b5-49d1-8ebd-be4a545753df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:14.129977 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73629fa9-b3c2-4d1a-9324-d9257f969526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:14.130530 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73629fa9-b3c2-4d1a-9324-d9257f969526 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:14.130803 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73629fa9-b3c2-4d1a-9324-d9257f969526 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:14.131073 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73629fa9-b3c2-4d1a-9324-d9257f969526 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:14.140829 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 267/535] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:23:14.151756 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73629fa9-b3c2-4d1a-9324-d9257f969526 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:14.154265 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73629fa9-b3c2-4d1a-9324-d9257f969526 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:14.175770 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-73629fa9-b3c2-4d1a-9324-d9257f969526 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:14.175770 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:14.175770 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:14.175770 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:14.175770 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:14.175770 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:14.175770 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:14.175770 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:14.175770 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:14.175770 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:14.175770 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:14.175770 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:14.175770 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:14.175770 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:14.175770 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:14.175770 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:14.176974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:14.176974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:14.176974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:14.176974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:14.176974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:14.176974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:14.176974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:14.176974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:14.176974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:14.176974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:14.176974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:14.176974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:14.176974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:14.176974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:14.176974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:14.176974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:14.176974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:14.177922 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:14.177922 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:14.177922 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:14.177922 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 269/536] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:14.182835 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068927a-d8b5-49d1-8ebd-be4a545753df None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:14.256006 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:14.318781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068927a-d8b5-49d1-8ebd-be4a545753df None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:14.358915 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ef645-6b8e-4508-87f7-2ba7ef998751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:14.359522 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ef645-6b8e-4508-87f7-2ba7ef998751 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:14.359800 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ef645-6b8e-4508-87f7-2ba7ef998751 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:14.360088 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ef645-6b8e-4508-87f7-2ba7ef998751 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:14.360851 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3ef645-6b8e-4508-87f7-2ba7ef998751 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:14.361154 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3ef645-6b8e-4508-87f7-2ba7ef998751 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:14.362519 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3ef645-6b8e-4508-87f7-2ba7ef998751 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:14.381497 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 268/537] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:14.386616 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73629fa9-b3c2-4d1a-9324-d9257f969526 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:14.494289 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ef645-6b8e-4508-87f7-2ba7ef998751 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:14.560539 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:14.579742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73629fa9-b3c2-4d1a-9324-d9257f969526 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:14.643520 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ef645-6b8e-4508-87f7-2ba7ef998751 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:14.645140 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e74b9d-634e-4599-8b73-2ca86c8e0211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:14.646120 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e74b9d-634e-4599-8b73-2ca86c8e0211 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:14.646457 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e74b9d-634e-4599-8b73-2ca86c8e0211 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:14.646797 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e74b9d-634e-4599-8b73-2ca86c8e0211 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:14.655869 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e74b9d-634e-4599-8b73-2ca86c8e0211 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:14.657542 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e74b9d-634e-4599-8b73-2ca86c8e0211 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:14.659687 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:14.672104 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-b4e74b9d-634e-4599-8b73-2ca86c8e0211 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 07:23:14.672104 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:14.672104 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:14.672104 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:14.672104 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:14.672104 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:14.672104 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:14.672104 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:14.672104 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:14.672104 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:14.672104 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:14.672104 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:14.672104 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:23:14.672104 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:23:14.672104 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:23:14.672104 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:23:14.674680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:14.674680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:14.674680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:23:14.674680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:14.674680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:23:14.674680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:14.674680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:14.674680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:14.674680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:14.674680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:14.674680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:14.674680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:14.674680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:14.674680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:14.674680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:14.674680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:14.674680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:14.674680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:14.675810 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:14.675810 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:14.675810 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:23:14.675810 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:23:14.675810 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:23:14.675810 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:23:14.675810 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:23:14.675810 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:23:14.675810 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 07:23:14.675810 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:14.677063 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 270/538] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Nov 2 07:23:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:14.678478 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fa11c-cc1c-4e04-89dc-a553cb83d881 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:14.678880 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fa11c-cc1c-4e04-89dc-a553cb83d881 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:14.679270 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fa11c-cc1c-4e04-89dc-a553cb83d881 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:14.680923 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 271/539] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:14.682034 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fa11c-cc1c-4e04-89dc-a553cb83d881 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:14.695098 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607820c0-65ab-48eb-8c17-1ce0bd1fa836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:14.695818 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607820c0-65ab-48eb-8c17-1ce0bd1fa836 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:14.696220 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607820c0-65ab-48eb-8c17-1ce0bd1fa836 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:14.696556 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607820c0-65ab-48eb-8c17-1ce0bd1fa836 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:14.715606 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607820c0-65ab-48eb-8c17-1ce0bd1fa836 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:23:14.722819 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-607820c0-65ab-48eb-8c17-1ce0bd1fa836 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:23:14.722819 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:14.722819 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:14.722819 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:14.722819 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:14.722819 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:14.722819 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:14.722819 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:14.722819 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:14.722819 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:14.722819 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:14.722819 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:14.722819 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:23:14.722819 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:23:14.722819 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:23:14.722819 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:23:14.723891 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:23:14.723891 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:23:14.723891 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:23:14.723891 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:23:14.723891 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:14.723891 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:14.723891 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:14.723891 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:14.723891 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:14.723891 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:14.723891 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:14.723891 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:14.723891 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:14.723891 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:14.723891 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:14.723891 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:14.724918 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:14.724918 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:14.724918 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:14.724918 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:14.724918 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:23:14.724918 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:23:14.724918 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:23:14.724918 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:23:14.724918 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:23:14.724918 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:23:14.724918 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:23:14.724918 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:14.728013 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 269/540] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Nov 2 07:23:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:23:14.729618 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21308fd-0d51-4df0-8ed0-e4a7ce8ca785 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:14.730042 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21308fd-0d51-4df0-8ed0-e4a7ce8ca785 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:14.730608 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21308fd-0d51-4df0-8ed0-e4a7ce8ca785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:14.753796 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-b21308fd-0d51-4df0-8ed0-e4a7ce8ca785 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:14.755861 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b21308fd-0d51-4df0-8ed0-e4a7ce8ca785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:14.814658 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fa11c-cc1c-4e04-89dc-a553cb83d881 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:14.854217 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1eca8-8c58-402b-9345-6d3e2b409377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:14.855202 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1eca8-8c58-402b-9345-6d3e2b409377 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:14.856186 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1eca8-8c58-402b-9345-6d3e2b409377 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:14.856587 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1eca8-8c58-402b-9345-6d3e2b409377 None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:14.857443 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1eca8-8c58-402b-9345-6d3e2b409377 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:14.857588 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 270/541] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:23:14.858013 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1eca8-8c58-402b-9345-6d3e2b409377 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:14.858622 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21308fd-0d51-4df0-8ed0-e4a7ce8ca785 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:14.859834 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1eca8-8c58-402b-9345-6d3e2b409377 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:14.883579 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 272/542] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Nov 2 07:23:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:14.889911 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1eca8-8c58-402b-9345-6d3e2b409377 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:14.903751 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:14.977353 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21308fd-0d51-4df0-8ed0-e4a7ce8ca785 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:14.979017 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:15.012749 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1eca8-8c58-402b-9345-6d3e2b409377 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:15.014634 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227bae1-0eb3-41c6-8590-10508d41ed90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:15.015379 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227bae1-0eb3-41c6-8590-10508d41ed90 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:15.015798 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227bae1-0eb3-41c6-8590-10508d41ed90 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:15.016918 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227bae1-0eb3-41c6-8590-10508d41ed90 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:15.016918 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b227bae1-0eb3-41c6-8590-10508d41ed90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:15.017375 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b227bae1-0eb3-41c6-8590-10508d41ed90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:15.018838 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b227bae1-0eb3-41c6-8590-10508d41ed90 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:15.028098 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 271/543] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Nov 2 07:23:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:15.029470 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff01fb-9ea8-4614-90ec-7eaa0a5306ae None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:15.034131 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff01fb-9ea8-4614-90ec-7eaa0a5306ae None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:15.034553 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff01fb-9ea8-4614-90ec-7eaa0a5306ae None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:15.036193 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 272/544] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:15.037151 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff01fb-9ea8-4614-90ec-7eaa0a5306ae None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:15.055175 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2041e-0fdb-4c6b-9dcc-3b9abd6b3206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:15.056040 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2041e-0fdb-4c6b-9dcc-3b9abd6b3206 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:15.056479 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2041e-0fdb-4c6b-9dcc-3b9abd6b3206 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:15.056893 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2041e-0fdb-4c6b-9dcc-3b9abd6b3206 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:15.070766 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2041e-0fdb-4c6b-9dcc-3b9abd6b3206 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:15.072474 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2041e-0fdb-4c6b-9dcc-3b9abd6b3206 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:15.091033 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-2ad2041e-0fdb-4c6b-9dcc-3b9abd6b3206 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:15.091033 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:15.091033 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:15.091033 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:15.091033 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:15.091033 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:15.091033 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:15.091033 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:15.091033 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:15.091033 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:15.091033 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:15.091033 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:15.091033 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:15.091033 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:15.091033 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:15.091033 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:15.092193 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:15.092193 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:15.092193 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:15.092193 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:15.092193 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:15.092193 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:15.092193 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:15.092193 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:15.092193 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:15.092193 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:15.092193 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:15.092193 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:15.092193 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:15.092193 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:15.092193 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:15.092193 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:15.092193 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:15.093238 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:15.093238 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:15.093238 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:15.095346 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 273/545] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:15.097299 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edf318-aff9-44c4-bac0-3fef9820b584 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:15.097742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edf318-aff9-44c4-bac0-3fef9820b584 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:15.098159 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edf318-aff9-44c4-bac0-3fef9820b584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:15.119945 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-19edf318-aff9-44c4-bac0-3fef9820b584 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:15.122177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-19edf318-aff9-44c4-bac0-3fef9820b584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:15.150650 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff01fb-9ea8-4614-90ec-7eaa0a5306ae None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:15.189489 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93580e-d038-45c4-9136-d27e5b11839a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:15.190183 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93580e-d038-45c4-9136-d27e5b11839a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:15.190663 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93580e-d038-45c4-9136-d27e5b11839a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:15.191005 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93580e-d038-45c4-9136-d27e5b11839a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:15.191906 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:15.203295 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 274/546] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:23:15.204393 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19edf318-aff9-44c4-bac0-3fef9820b584 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:15.204500 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a93580e-d038-45c4-9136-d27e5b11839a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:15.208321 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a93580e-d038-45c4-9136-d27e5b11839a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:15.225206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-9a93580e-d038-45c4-9136-d27e5b11839a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:15.225206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:15.225206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:15.225206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:15.225206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:15.225206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:15.225206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:15.225206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:15.225206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:15.225206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:15.225206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:15.225206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:15.225206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:15.225206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:15.225206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:15.225206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:15.226304 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:15.226304 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:15.226304 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:15.226304 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:15.226304 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:15.226304 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:15.226304 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:15.226304 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:15.226304 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:15.226304 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:15.226304 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:15.226304 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:15.226304 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:15.226304 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:15.226304 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:15.226304 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:15.226304 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:15.227378 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:15.227378 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:15.227378 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:15.227378 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 273/547] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:15.232471 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93580e-d038-45c4-9136-d27e5b11839a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:15.257090 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:15.319668 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19edf318-aff9-44c4-bac0-3fef9820b584 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:15.359816 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93580e-d038-45c4-9136-d27e5b11839a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:15.374534 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdfc21c-f152-4a15-a30e-d9ef12cec64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:15.375602 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfc21c-f152-4a15-a30e-d9ef12cec64a None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:15.376178 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfc21c-f152-4a15-a30e-d9ef12cec64a None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:15.376458 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfc21c-f152-4a15-a30e-d9ef12cec64a None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:15.377092 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdfc21c-f152-4a15-a30e-d9ef12cec64a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:15.377655 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdfc21c-f152-4a15-a30e-d9ef12cec64a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:15.379403 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdfc21c-f152-4a15-a30e-d9ef12cec64a None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:15.392523 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 275/548] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:15.393443 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdfc21c-f152-4a15-a30e-d9ef12cec64a None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:15.401906 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc729b-d47c-44ab-8fca-175e6f081497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:15.403052 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc729b-d47c-44ab-8fca-175e6f081497 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:15.403382 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc729b-d47c-44ab-8fca-175e6f081497 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:15.403677 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc729b-d47c-44ab-8fca-175e6f081497 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:15.404836 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc729b-d47c-44ab-8fca-175e6f081497 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:15.405139 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc729b-d47c-44ab-8fca-175e6f081497 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:15.406969 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc729b-d47c-44ab-8fca-175e6f081497 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:15.428151 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 274/549] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:15.428991 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc729b-d47c-44ab-8fca-175e6f081497 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:15.454396 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:15.505894 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdfc21c-f152-4a15-a30e-d9ef12cec64a None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:15.532742 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:15.541070 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad43c0-2c98-446a-af2d-c591046e2b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:15.541685 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad43c0-2c98-446a-af2d-c591046e2b58 None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:15.543688 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad43c0-2c98-446a-af2d-c591046e2b58 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:15.543688 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad43c0-2c98-446a-af2d-c591046e2b58 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:15.543688 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad43c0-2c98-446a-af2d-c591046e2b58 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:15.545144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad43c0-2c98-446a-af2d-c591046e2b58 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:15.556803 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc729b-d47c-44ab-8fca-175e6f081497 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:15.590791 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a984f-89c9-4f25-baea-7a977fa1ad89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:15.591473 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a984f-89c9-4f25-baea-7a977fa1ad89 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:15.591755 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a984f-89c9-4f25-baea-7a977fa1ad89 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:15.592023 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a984f-89c9-4f25-baea-7a977fa1ad89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:15.598811 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17a984f-89c9-4f25-baea-7a977fa1ad89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:15.600276 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17a984f-89c9-4f25-baea-7a977fa1ad89 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:15.611950 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-e17a984f-89c9-4f25-baea-7a977fa1ad89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:15.611950 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:15.611950 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:15.611950 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:15.611950 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:15.611950 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:15.611950 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:15.611950 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:15.611950 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:15.611950 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:15.611950 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:15.611950 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:15.611950 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:23:15.611950 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:23:15.611950 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:23:15.612973 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:23:15.612973 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:15.612973 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:15.612973 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:15.612973 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:15.612973 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:15.612973 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:15.612973 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:15.612973 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:15.612973 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:15.612973 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:15.612973 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:15.612973 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:15.612973 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:15.612973 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:15.612973 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:15.612973 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:15.613861 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:23:15.613861 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:23:15.613861 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:23:15.613861 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:23:15.613861 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:23:15.613861 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:23:15.613861 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:15.613861 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:15.613861 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 275/550] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Nov 2 07:23:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:15.613861 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a984f-89c9-4f25-baea-7a977fa1ad89 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:15.629290 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 276/551] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Nov 2 07:23:15 2022] POST /identity/v3/services => generated 240 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:23:15.630434 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad43c0-2c98-446a-af2d-c591046e2b58 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:15.742398 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a984f-89c9-4f25-baea-7a977fa1ad89 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:15.784244 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:15.789709 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c86843-8b36-4646-b965-29b95ddd186d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:15.795948 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c86843-8b36-4646-b965-29b95ddd186d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:15.795948 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c86843-8b36-4646-b965-29b95ddd186d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:15.796262 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad43c0-2c98-446a-af2d-c591046e2b58 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:15.796427 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c86843-8b36-4646-b965-29b95ddd186d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:15.802569 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c86843-8b36-4646-b965-29b95ddd186d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:15.804688 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c86843-8b36-4646-b965-29b95ddd186d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:15.810245 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:15.818785 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-35c86843-8b36-4646-b965-29b95ddd186d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 02 07:23:15.818785 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:15.818785 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:15.818785 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:15.818785 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:15.818785 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:15.818785 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:15.818785 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:15.818785 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:15.818785 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:15.818785 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:15.818785 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:15.818785 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:23:15.818785 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:23:15.818785 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:23:15.818785 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:23:15.819825 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:15.819825 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:15.819825 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:23:15.819825 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:15.819825 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:23:15.819825 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:15.819825 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:15.819825 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:15.819825 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:15.819825 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:15.819825 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:15.819825 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:15.819825 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:15.819825 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:15.819825 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:15.819825 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:15.819825 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:15.819825 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:15.820828 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:15.820828 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:15.820828 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:23:15.820828 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:23:15.820828 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:23:15.820828 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:23:15.820828 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:23:15.820828 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:23:15.820828 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Nov 02 07:23:15.820828 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:15.822910 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 276/552] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Nov 2 07:23:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:15.823831 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c86843-8b36-4646-b965-29b95ddd186d None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:15.848029 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f3fcf-199b-45a4-a6da-9508b30e4f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:15.848673 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f3fcf-199b-45a4-a6da-9508b30e4f3a None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:15.848946 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f3fcf-199b-45a4-a6da-9508b30e4f3a None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:15.849215 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f3fcf-199b-45a4-a6da-9508b30e4f3a None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:15.849862 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f3fcf-199b-45a4-a6da-9508b30e4f3a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:15.851338 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f3fcf-199b-45a4-a6da-9508b30e4f3a None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:15.922226 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 277/553] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Nov 2 07:23:15 2022] POST /identity/v3/services => generated 251 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:23:15.928096 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f3fcf-199b-45a4-a6da-9508b30e4f3a None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:16.017120 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c86843-8b36-4646-b965-29b95ddd186d None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:16.093500 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0a655-b339-42b6-8a00-9d11cb68294f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:16.094145 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0a655-b339-42b6-8a00-9d11cb68294f None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:16.094422 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0a655-b339-42b6-8a00-9d11cb68294f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:16.094835 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0a655-b339-42b6-8a00-9d11cb68294f None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:16.095532 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f0a655-b339-42b6-8a00-9d11cb68294f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:16.095834 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f0a655-b339-42b6-8a00-9d11cb68294f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:16.097358 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f0a655-b339-42b6-8a00-9d11cb68294f None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:16.115750 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 277/554] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Nov 2 07:23:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:16.120513 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e2320-df9b-430d-ace0-4c8791002cec None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:16.120513 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e2320-df9b-430d-ace0-4c8791002cec None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:16.120513 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e2320-df9b-430d-ace0-4c8791002cec None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:16.120513 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 278/555] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:16.124460 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e2320-df9b-430d-ace0-4c8791002cec None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:16.131733 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f3fcf-199b-45a4-a6da-9508b30e4f3a None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:16.172976 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85831f10-c5c2-45e9-8973-be7b76090082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:16.173958 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85831f10-c5c2-45e9-8973-be7b76090082 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:16.174430 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85831f10-c5c2-45e9-8973-be7b76090082 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:16.174891 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85831f10-c5c2-45e9-8973-be7b76090082 None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:16.175818 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85831f10-c5c2-45e9-8973-be7b76090082 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:16.176375 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85831f10-c5c2-45e9-8973-be7b76090082 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:16.178536 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85831f10-c5c2-45e9-8973-be7b76090082 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:16.189676 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:16.204090 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 278/556] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Nov 2 07:23:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:16.205577 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477bfdad-b6f9-4b19-b0cb-d8dc7c79587f None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:16.205856 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477bfdad-b6f9-4b19-b0cb-d8dc7c79587f None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:16.208299 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477bfdad-b6f9-4b19-b0cb-d8dc7c79587f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:16.227051 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-477bfdad-b6f9-4b19-b0cb-d8dc7c79587f None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:16.228292 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-477bfdad-b6f9-4b19-b0cb-d8dc7c79587f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:16.258565 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:16.264184 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e2320-df9b-430d-ace0-4c8791002cec None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:16.304769 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c61160-569b-46f6-8013-85f24031cedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:16.305355 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c61160-569b-46f6-8013-85f24031cedc None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:16.305633 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c61160-569b-46f6-8013-85f24031cedc None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:16.305904 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c61160-569b-46f6-8013-85f24031cedc None admin] PATH_INFO: `/v3/projects/2c3bf3e930dd407f8401c0487edc8c20/users/0c65f5001a224e0b92e94dc6df9f8f43/roles/4d61be0c9e7b454abd3b0a3330428290` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:16.310579 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 279/557] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:16.316122 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477bfdad-b6f9-4b19-b0cb-d8dc7c79587f None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:16.332737 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c61160-569b-46f6-8013-85f24031cedc None admin] RBAC: Authorizing `identity:create_grant(project_id=2c3bf3e930dd407f8401c0487edc8c20, user_id=0c65f5001a224e0b92e94dc6df9f8f43, role_id=4d61be0c9e7b454abd3b0a3330428290)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:16.334240 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c61160-569b-46f6-8013-85f24031cedc None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:16.425260 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477bfdad-b6f9-4b19-b0cb-d8dc7c79587f None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:16.430160 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 279/558] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Nov 2 07:23:16 2022] PUT /identity/v3/projects/2c3bf3e930dd407f8401c0487edc8c20/users/0c65f5001a224e0b92e94dc6df9f8f43/roles/4d61be0c9e7b454abd3b0a3330428290 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:23:16.463687 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88db6c9-fd7e-407a-b024-0a9c5a11d139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:16.464355 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88db6c9-fd7e-407a-b024-0a9c5a11d139 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:16.464634 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88db6c9-fd7e-407a-b024-0a9c5a11d139 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:16.464984 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88db6c9-fd7e-407a-b024-0a9c5a11d139 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:16.476428 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88db6c9-fd7e-407a-b024-0a9c5a11d139 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:16.477912 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88db6c9-fd7e-407a-b024-0a9c5a11d139 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:16.496536 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-d88db6c9-fd7e-407a-b024-0a9c5a11d139 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:16.496536 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:16.496536 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:16.496536 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:16.496536 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:16.496536 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:16.496536 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:16.496536 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:16.496536 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:16.496536 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:16.496536 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:16.496536 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:16.496536 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:16.496536 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:16.496536 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:16.496536 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:16.497522 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:16.497522 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:16.497522 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:16.497522 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:16.497522 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:16.497522 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:16.497522 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:16.497522 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:16.497522 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:16.497522 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:16.497522 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:16.497522 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:16.497522 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:16.497522 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:16.497522 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:16.497522 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:16.497522 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:16.499056 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:16.499056 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:16.499056 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:16.499056 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 280/559] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:16.506605 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c61160-569b-46f6-8013-85f24031cedc None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:16.619788 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88db6c9-fd7e-407a-b024-0a9c5a11d139 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:16.650261 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:16.676469 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:16.680110 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c61160-569b-46f6-8013-85f24031cedc None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:16.749184 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7370f-40e0-4e75-b16a-22e8fe224e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:16.750428 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7370f-40e0-4e75-b16a-22e8fe224e8e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:16.750712 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7370f-40e0-4e75-b16a-22e8fe224e8e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:16.751140 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7370f-40e0-4e75-b16a-22e8fe224e8e None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:16.751925 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c7370f-40e0-4e75-b16a-22e8fe224e8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:16.752282 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c7370f-40e0-4e75-b16a-22e8fe224e8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:16.755183 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c7370f-40e0-4e75-b16a-22e8fe224e8e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:16.770689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 280/560] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:16.775844 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7370f-40e0-4e75-b16a-22e8fe224e8e None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:16.799675 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88db6c9-fd7e-407a-b024-0a9c5a11d139 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:16.866021 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935e16b-47e6-4d68-94e3-11c57557bba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:16.867894 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935e16b-47e6-4d68-94e3-11c57557bba0 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:16.868198 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935e16b-47e6-4d68-94e3-11c57557bba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:16.868469 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935e16b-47e6-4d68-94e3-11c57557bba0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:16.891779 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6935e16b-47e6-4d68-94e3-11c57557bba0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:23:16.903077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-6935e16b-47e6-4d68-94e3-11c57557bba0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:23:16.903077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:16.903077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:16.903077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:16.903077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:16.903077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:16.903077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:16.903077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:16.903077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:16.903077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:16.903077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:16.903077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:16.903077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:23:16.903077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:23:16.903077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:23:16.903077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:23:16.904115 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:23:16.904115 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:23:16.904115 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:23:16.904115 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:23:16.904115 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:16.904115 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:16.904115 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:16.904115 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:16.904115 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:16.904115 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:16.904115 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:16.904115 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:16.904115 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:16.904115 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:16.904115 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:16.904115 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:16.904948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:16.904948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:16.904948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:16.904948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:16.904948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:23:16.904948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:23:16.904948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:23:16.904948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:23:16.904948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:23:16.904948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:23:16.904948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:23:16.904948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:16.906835 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 281/561] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Nov 2 07:23:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:16.916730 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935e16b-47e6-4d68-94e3-11c57557bba0 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:16.988338 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7370f-40e0-4e75-b16a-22e8fe224e8e None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:17.028690 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cb7b6-5478-4939-aac2-fca6483c1bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:17.029544 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cb7b6-5478-4939-aac2-fca6483c1bac None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:17.029822 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cb7b6-5478-4939-aac2-fca6483c1bac None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:17.030091 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cb7b6-5478-4939-aac2-fca6483c1bac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:17.038125 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13cb7b6-5478-4939-aac2-fca6483c1bac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:17.039688 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13cb7b6-5478-4939-aac2-fca6483c1bac None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:17.057723 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-c13cb7b6-5478-4939-aac2-fca6483c1bac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:17.057723 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:17.057723 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:17.057723 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:17.057723 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:17.057723 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:17.057723 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:17.057723 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:17.057723 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:17.057723 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:17.057723 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:17.057723 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:17.057723 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:23:17.057723 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:23:17.057723 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:23:17.058689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:23:17.058689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:17.058689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:17.058689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:17.058689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:17.058689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:17.058689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:17.058689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:17.058689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:17.058689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:17.058689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:17.058689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:17.058689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:17.058689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:17.058689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:17.058689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:17.058689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:17.059574 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:23:17.059574 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:23:17.059574 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:23:17.059574 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:23:17.059574 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:23:17.059574 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:23:17.059574 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:17.059574 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:17.064115 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 281/562] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Nov 2 07:23:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:17.070423 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cb7b6-5478-4939-aac2-fca6483c1bac None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:17.103025 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:17.116554 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:17.144119 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935e16b-47e6-4d68-94e3-11c57557bba0 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:17.214022 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afd039-cbe3-4d86-a85e-273d3796c4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:17.214635 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afd039-cbe3-4d86-a85e-273d3796c4fc None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:17.214989 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afd039-cbe3-4d86-a85e-273d3796c4fc None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:17.215471 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afd039-cbe3-4d86-a85e-273d3796c4fc None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:17.216241 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9afd039-cbe3-4d86-a85e-273d3796c4fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:17.216544 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9afd039-cbe3-4d86-a85e-273d3796c4fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:17.217908 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9afd039-cbe3-4d86-a85e-273d3796c4fc None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:17.236920 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 282/563] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Nov 2 07:23:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:17.239056 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cb7b6-5478-4939-aac2-fca6483c1bac None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:17.243023 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afd039-cbe3-4d86-a85e-273d3796c4fc None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:17.306832 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71981b-099c-464a-b921-6a4a2001aa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:17.307443 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71981b-099c-464a-b921-6a4a2001aa09 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:17.307727 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71981b-099c-464a-b921-6a4a2001aa09 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:17.308000 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71981b-099c-464a-b921-6a4a2001aa09 None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:17.308799 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d71981b-099c-464a-b921-6a4a2001aa09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:17.309102 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d71981b-099c-464a-b921-6a4a2001aa09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:17.311669 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d71981b-099c-464a-b921-6a4a2001aa09 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:17.337076 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 282/564] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Nov 2 07:23:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:17.343659 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71981b-099c-464a-b921-6a4a2001aa09 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:17.427548 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afd039-cbe3-4d86-a85e-273d3796c4fc None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:17.461044 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:17.469796 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b02a5-a15a-43dc-abe7-0ae5a932edd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:17.470428 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b02a5-a15a-43dc-abe7-0ae5a932edd0 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:17.474193 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b02a5-a15a-43dc-abe7-0ae5a932edd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:17.474193 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b02a5-a15a-43dc-abe7-0ae5a932edd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:17.476491 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:17.492918 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b02a5-a15a-43dc-abe7-0ae5a932edd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:17.494358 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b02a5-a15a-43dc-abe7-0ae5a932edd0 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:17.502653 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71981b-099c-464a-b921-6a4a2001aa09 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:17.524089 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-712b02a5-a15a-43dc-abe7-0ae5a932edd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:17.524089 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:17.524089 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:17.524089 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:17.524089 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:17.524089 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:17.524089 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:17.524089 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:17.524089 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:17.524089 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:17.524089 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:17.524089 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:17.524089 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:17.524089 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:17.524089 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:17.524089 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:17.525064 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:17.525064 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:17.525064 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:17.525064 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:17.525064 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:17.525064 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:17.525064 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:17.525064 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:17.525064 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:17.525064 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:17.525064 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:17.525064 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:17.525064 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:17.525064 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:17.525064 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:17.525064 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:17.525064 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:17.525935 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:17.525935 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:17.525935 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:17.525935 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 283/565] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:17.533298 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b02a5-a15a-43dc-abe7-0ae5a932edd0 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:17.568935 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0fbf3d-3b38-4a13-88b0-bdb65e76f7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:17.569595 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fbf3d-3b38-4a13-88b0-bdb65e76f7fe None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:17.572087 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fbf3d-3b38-4a13-88b0-bdb65e76f7fe None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:17.572366 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fbf3d-3b38-4a13-88b0-bdb65e76f7fe None admin] PATH_INFO: `/v3/projects/2c3bf3e930dd407f8401c0487edc8c20/users/68d63a04c2d74c90b95a4f48c49ddb29/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:17.577389 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0fbf3d-3b38-4a13-88b0-bdb65e76f7fe None admin] RBAC: Authorizing `identity:create_grant(project_id=2c3bf3e930dd407f8401c0487edc8c20, user_id=68d63a04c2d74c90b95a4f48c49ddb29, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:17.578830 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0fbf3d-3b38-4a13-88b0-bdb65e76f7fe None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:17.666593 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b02a5-a15a-43dc-abe7-0ae5a932edd0 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:17.677013 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 283/566] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Nov 2 07:23:17 2022] PUT /identity/v3/projects/2c3bf3e930dd407f8401c0487edc8c20/users/68d63a04c2d74c90b95a4f48c49ddb29/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:23:17.713319 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7a465-6cff-44b8-abfd-71ed0041c273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:17.713862 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7a465-6cff-44b8-abfd-71ed0041c273 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:17.714141 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7a465-6cff-44b8-abfd-71ed0041c273 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:17.714411 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7a465-6cff-44b8-abfd-71ed0041c273 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:17.715080 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed7a465-6cff-44b8-abfd-71ed0041c273 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:17.715379 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed7a465-6cff-44b8-abfd-71ed0041c273 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:17.716773 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed7a465-6cff-44b8-abfd-71ed0041c273 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:17.733080 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 284/567] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:17.739011 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0fbf3d-3b38-4a13-88b0-bdb65e76f7fe None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:17.958437 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0fbf3d-3b38-4a13-88b0-bdb65e76f7fe None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:18.000942 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9435ffc1-5b5a-4891-a6ec-4b8004b31017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:18.001502 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435ffc1-5b5a-4891-a6ec-4b8004b31017 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:18.001777 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435ffc1-5b5a-4891-a6ec-4b8004b31017 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:18.002047 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435ffc1-5b5a-4891-a6ec-4b8004b31017 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:18.010155 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9435ffc1-5b5a-4891-a6ec-4b8004b31017 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:18.011605 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9435ffc1-5b5a-4891-a6ec-4b8004b31017 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:18.014026 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:18.024349 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-9435ffc1-5b5a-4891-a6ec-4b8004b31017 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:23:18.024349 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:18.024349 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:18.024349 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:18.024349 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:18.024349 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:18.024349 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:18.024349 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:18.024349 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:18.024349 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:18.024349 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:18.024349 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:18.024349 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:23:18.024349 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:23:18.024349 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:23:18.024349 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:23:18.030559 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:18.030559 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:18.030559 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:23:18.030559 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:18.030559 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:23:18.030559 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:18.030559 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:18.030559 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:18.030559 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:18.030559 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:18.030559 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:18.030559 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:18.030559 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:18.030559 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:18.030559 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:18.030559 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:18.030559 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:18.030559 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:18.031732 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:18.031732 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:18.031732 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:23:18.031732 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:23:18.031732 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:23:18.031732 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:23:18.031732 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:23:18.031732 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:23:18.031732 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:23:18.031732 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:18.031732 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 284/568] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Nov 2 07:23:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:18.034867 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7a465-6cff-44b8-abfd-71ed0041c273 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:18.108108 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:18.170752 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f91739-30bc-42fc-b91a-8ce38145ee34 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:18.171382 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f91739-30bc-42fc-b91a-8ce38145ee34 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:18.171880 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f91739-30bc-42fc-b91a-8ce38145ee34 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:18.173495 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 285/569] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:23:18.178905 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33ea56-7e72-4f0d-abe0-7c25c48e4da6 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:18.179185 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33ea56-7e72-4f0d-abe0-7c25c48e4da6 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:18.179452 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33ea56-7e72-4f0d-abe0-7c25c48e4da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:18.189731 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7a465-6cff-44b8-abfd-71ed0041c273 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:18.209622 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-ba33ea56-7e72-4f0d-abe0-7c25c48e4da6 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:18.210813 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ba33ea56-7e72-4f0d-abe0-7c25c48e4da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:18.252214 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc1c82-5e4b-4552-a2f9-e6abdd68e154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:18.252756 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc1c82-5e4b-4552-a2f9-e6abdd68e154 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:18.253027 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc1c82-5e4b-4552-a2f9-e6abdd68e154 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:18.253291 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc1c82-5e4b-4552-a2f9-e6abdd68e154 None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:18.254026 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cc1c82-5e4b-4552-a2f9-e6abdd68e154 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:18.254323 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cc1c82-5e4b-4552-a2f9-e6abdd68e154 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:18.256074 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cc1c82-5e4b-4552-a2f9-e6abdd68e154 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:18.288099 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 285/570] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Nov 2 07:23:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:23:18.289457 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc1c82-5e4b-4552-a2f9-e6abdd68e154 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:18.354083 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 286/571] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:18.434570 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb49ba-1a61-485b-9287-483d8c4d1c4a None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:18.434923 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb49ba-1a61-485b-9287-483d8c4d1c4a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:18.435127 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb49ba-1a61-485b-9287-483d8c4d1c4a None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:18.436845 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 287/572] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:23:18.439211 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc1c82-5e4b-4552-a2f9-e6abdd68e154 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:18.442283 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:18.450870 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657d1d9-983a-4f84-87e4-1adbd7a5bb78 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:18.451137 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657d1d9-983a-4f84-87e4-1adbd7a5bb78 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:18.451407 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657d1d9-983a-4f84-87e4-1adbd7a5bb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:18.482185 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-d657d1d9-983a-4f84-87e4-1adbd7a5bb78 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:18.483365 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d657d1d9-983a-4f84-87e4-1adbd7a5bb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:18.508795 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8908e-2219-429f-bb1d-c7cf2fbed313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:18.509335 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8908e-2219-429f-bb1d-c7cf2fbed313 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:18.509607 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8908e-2219-429f-bb1d-c7cf2fbed313 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:18.509875 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8908e-2219-429f-bb1d-c7cf2fbed313 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:18.599258 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c8908e-2219-429f-bb1d-c7cf2fbed313 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:18.602974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c8908e-2219-429f-bb1d-c7cf2fbed313 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:18.624480 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 288/573] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:23:18.632999 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657d1d9-983a-4f84-87e4-1adbd7a5bb78 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:18.722064 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 286/574] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Nov 2 07:23:18 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 07:23:18.729245 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8908e-2219-429f-bb1d-c7cf2fbed313 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:18.744411 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:18.763835 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:18.846328 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657d1d9-983a-4f84-87e4-1adbd7a5bb78 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:18.906513 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50977cf0-fae7-494a-8f78-e63a66654faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:18.907152 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50977cf0-fae7-494a-8f78-e63a66654faf None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:18.907507 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50977cf0-fae7-494a-8f78-e63a66654faf None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:18.907789 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50977cf0-fae7-494a-8f78-e63a66654faf None admin] PATH_INFO: `/v3/services/network` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:18.908399 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50977cf0-fae7-494a-8f78-e63a66654faf None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:18.910097 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50977cf0-fae7-494a-8f78-e63a66654faf None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:18.921483 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-50977cf0-fae7-494a-8f78-e63a66654faf None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 07:23:18.921483 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:18.921483 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:18.921483 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:18.921483 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:18.921483 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:18.921483 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:18.921483 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:18.921483 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 07:23:18.921483 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:18.921483 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:18.921483 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:18.921483 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:18.921483 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:18.921483 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:18.921483 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:18.921483 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:18.922528 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:18.922528 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:18.922528 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:18.922528 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:18.922528 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:18.922528 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:18.922528 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:18.922528 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:18.922528 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:18.922528 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:18.922528 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:18.922528 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:18.922528 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:18.922528 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:18.922528 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:18.922528 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:18.923401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:18.923401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:18.923401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:18.923401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:18.923401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:18.923401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:18.923401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:18.923401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:18.923401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:18.923401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:18.923401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:18.923401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:18.923401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 07:23:18.923401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:18.923401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 289/575] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Nov 2 07:23:18 2022] GET /identity/v3/services/network => generated 88 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:18.928121 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8908e-2219-429f-bb1d-c7cf2fbed313 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:18.928599 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50977cf0-fae7-494a-8f78-e63a66654faf None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:18.988412 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463cee9-dc6a-4d04-b2a6-7912a92e74fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:18.989057 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463cee9-dc6a-4d04-b2a6-7912a92e74fc None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:18.989330 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463cee9-dc6a-4d04-b2a6-7912a92e74fc None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:18.989600 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463cee9-dc6a-4d04-b2a6-7912a92e74fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:19.001584 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a463cee9-dc6a-4d04-b2a6-7912a92e74fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:19.003384 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a463cee9-dc6a-4d04-b2a6-7912a92e74fc None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:19.023225 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-a463cee9-dc6a-4d04-b2a6-7912a92e74fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:19.023225 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:19.023225 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:19.023225 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:19.023225 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:19.023225 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:19.023225 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:19.023225 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:19.023225 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:19.023225 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:19.023225 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:19.023225 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:19.023225 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:19.023225 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:19.023225 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:19.023225 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:19.025233 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:19.025233 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:19.025233 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:19.025233 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:19.025233 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:19.025233 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:19.025233 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:19.025233 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:19.025233 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:19.025233 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:19.025233 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:19.025233 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:19.025233 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:19.025233 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:19.025233 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:19.025233 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:19.025233 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:19.026435 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:19.026435 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:19.026435 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:19.031195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 287/576] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:23:19.032762 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463cee9-dc6a-4d04-b2a6-7912a92e74fc None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:19.065940 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50977cf0-fae7-494a-8f78-e63a66654faf None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:19.090435 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:19.103398 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:19.106433 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037eff34-c49f-4e24-a255-d27d28eecb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:19.107224 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037eff34-c49f-4e24-a255-d27d28eecb28 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:19.107652 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037eff34-c49f-4e24-a255-d27d28eecb28 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:19.108096 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037eff34-c49f-4e24-a255-d27d28eecb28 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:19.110712 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037eff34-c49f-4e24-a255-d27d28eecb28 None admin] RBAC: Adding query filter params (name=network) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:19.110712 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037eff34-c49f-4e24-a255-d27d28eecb28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:19.110712 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037eff34-c49f-4e24-a255-d27d28eecb28 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:19.120308 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 290/577] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Nov 2 07:23:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:19.122613 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037eff34-c49f-4e24-a255-d27d28eecb28 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:19.151684 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463cee9-dc6a-4d04-b2a6-7912a92e74fc None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:19.191279 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab547687-273f-4eb4-8d12-aa93769348c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:19.191997 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab547687-273f-4eb4-8d12-aa93769348c0 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:19.192310 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab547687-273f-4eb4-8d12-aa93769348c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:19.192591 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab547687-273f-4eb4-8d12-aa93769348c0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:19.193172 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab547687-273f-4eb4-8d12-aa93769348c0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:19.194532 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab547687-273f-4eb4-8d12-aa93769348c0 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:19.208195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-ab547687-273f-4eb4-8d12-aa93769348c0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 07:23:19.208195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:19.208195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:19.208195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:19.208195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:19.208195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:19.208195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:19.208195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:19.208195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 07:23:19.208195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:19.208195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:19.208195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:19.208195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:19.208195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:19.208195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:19.208195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:19.208195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:19.209392 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:19.209392 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:19.209392 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:19.209392 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:19.209392 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:19.209392 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:19.209392 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:19.209392 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:19.209392 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:19.209392 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:19.209392 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:19.209392 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:19.209392 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:19.209392 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:19.209392 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:19.209392 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:19.210313 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:19.210313 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:19.210313 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:19.210313 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:19.210313 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:19.210313 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:19.210313 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:19.210313 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:19.210313 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:19.210313 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:19.210313 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:19.210313 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:19.210313 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 07:23:19.210313 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:19.210313 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 288/578] 10.222.0.16 () {56 vars in 1129 bytes} [Wed Nov 2 07:23:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:19.211328 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab547687-273f-4eb4-8d12-aa93769348c0 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:19.233289 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037eff34-c49f-4e24-a255-d27d28eecb28 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:19.268793 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a901f84-66e8-400f-9681-e98fd4dc4aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:19.269395 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a901f84-66e8-400f-9681-e98fd4dc4aa9 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:19.269669 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a901f84-66e8-400f-9681-e98fd4dc4aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:19.269941 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a901f84-66e8-400f-9681-e98fd4dc4aa9 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:19.270566 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a901f84-66e8-400f-9681-e98fd4dc4aa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:19.270860 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a901f84-66e8-400f-9681-e98fd4dc4aa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:19.272236 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a901f84-66e8-400f-9681-e98fd4dc4aa9 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:19.284558 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 291/579] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:19.290129 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945caea-22e7-4d22-be3f-843a455564d8 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:19.290411 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945caea-22e7-4d22-be3f-843a455564d8 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:19.290679 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945caea-22e7-4d22-be3f-843a455564d8 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:19.296192 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 292/580] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:19.296192 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945caea-22e7-4d22-be3f-843a455564d8 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:19.326123 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab547687-273f-4eb4-8d12-aa93769348c0 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:19.347774 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:19.348377 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:19.364651 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacbbe57-c584-48a5-967d-ff2ea4a2b743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:19.365307 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacbbe57-c584-48a5-967d-ff2ea4a2b743 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:19.365536 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacbbe57-c584-48a5-967d-ff2ea4a2b743 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:19.365809 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacbbe57-c584-48a5-967d-ff2ea4a2b743 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:19.366429 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacbbe57-c584-48a5-967d-ff2ea4a2b743 None admin] RBAC: Adding query filter params (type=network) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:19.366734 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacbbe57-c584-48a5-967d-ff2ea4a2b743 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:19.368129 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacbbe57-c584-48a5-967d-ff2ea4a2b743 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:19.378903 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 289/581] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Nov 2 07:23:19 2022] GET /identity/v3/services?type=network => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:19.378903 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacbbe57-c584-48a5-967d-ff2ea4a2b743 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:19.405334 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945caea-22e7-4d22-be3f-843a455564d8 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:19.439693 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be57dfa-f237-4289-a754-8577bc59504b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:19.440312 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be57dfa-f237-4289-a754-8577bc59504b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:19.440586 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be57dfa-f237-4289-a754-8577bc59504b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:19.440854 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be57dfa-f237-4289-a754-8577bc59504b None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:19.441457 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be57dfa-f237-4289-a754-8577bc59504b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:19.441758 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be57dfa-f237-4289-a754-8577bc59504b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:19.443115 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be57dfa-f237-4289-a754-8577bc59504b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:19.447624 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 293/582] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Nov 2 07:23:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:19.448762 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae24c6-a033-4e7f-aa45-eadee33ffafb None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:19.449038 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae24c6-a033-4e7f-aa45-eadee33ffafb None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:19.449858 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae24c6-a033-4e7f-aa45-eadee33ffafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:19.470778 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-beae24c6-a033-4e7f-aa45-eadee33ffafb None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:19.472338 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-beae24c6-a033-4e7f-aa45-eadee33ffafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:19.488957 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacbbe57-c584-48a5-967d-ff2ea4a2b743 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:19.523898 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06f7d9-9cac-4571-9a75-fff9ca534c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:19.524545 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06f7d9-9cac-4571-9a75-fff9ca534c36 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:19.524821 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06f7d9-9cac-4571-9a75-fff9ca534c36 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:19.525110 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06f7d9-9cac-4571-9a75-fff9ca534c36 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:19.532379 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06f7d9-9cac-4571-9a75-fff9ca534c36 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:19.533530 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06f7d9-9cac-4571-9a75-fff9ca534c36 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:19.545938 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-ff06f7d9-9cac-4571-9a75-fff9ca534c36 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:19.545938 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:19.545938 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:19.545938 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:19.545938 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:19.545938 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:19.545938 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:19.545938 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:19.545938 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:19.545938 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:19.545938 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:19.545938 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:19.545938 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:23:19.545938 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:23:19.545938 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:23:19.546873 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:23:19.546873 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:19.546873 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:19.546873 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:19.546873 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:19.546873 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:19.546873 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:19.546873 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:19.546873 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:19.546873 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:19.546873 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:19.546873 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:19.546873 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:19.546873 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:19.546873 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:19.546873 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:19.546873 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:19.555859 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:23:19.555859 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:23:19.555859 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:23:19.555859 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:23:19.555859 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:23:19.555859 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:23:19.555859 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:19.555859 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:19.556355 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 294/583] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:19.556355 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae24c6-a033-4e7f-aa45-eadee33ffafb None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:19.556493 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 290/584] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Nov 2 07:23:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:19.556493 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06f7d9-9cac-4571-9a75-fff9ca534c36 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:19.598060 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:19.611992 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:19.665267 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06f7d9-9cac-4571-9a75-fff9ca534c36 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:19.687188 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae24c6-a033-4e7f-aa45-eadee33ffafb None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:19.701495 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaaf973-9d55-4912-98c3-6be8e5c01c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:19.702106 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaaf973-9d55-4912-98c3-6be8e5c01c27 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:19.702385 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaaf973-9d55-4912-98c3-6be8e5c01c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:19.702656 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaaf973-9d55-4912-98c3-6be8e5c01c27 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:19.703277 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaaf973-9d55-4912-98c3-6be8e5c01c27 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:19.703578 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaaf973-9d55-4912-98c3-6be8e5c01c27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:19.704955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaaf973-9d55-4912-98c3-6be8e5c01c27 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:19.715713 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 291/585] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Nov 2 07:23:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:19.716642 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaaf973-9d55-4912-98c3-6be8e5c01c27 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:19.724531 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689474f-9c8b-43a1-93c7-8845502a0c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:19.725193 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689474f-9c8b-43a1-93c7-8845502a0c4f None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:19.725467 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689474f-9c8b-43a1-93c7-8845502a0c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:19.725789 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689474f-9c8b-43a1-93c7-8845502a0c4f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:19.726585 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8689474f-9c8b-43a1-93c7-8845502a0c4f None admin] RBAC: Adding query filter params (interface=public, service_id=4dc6316f1b5b4f259efc660f24d30b88, region_id=RegionOne) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:19.726894 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8689474f-9c8b-43a1-93c7-8845502a0c4f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:19.728377 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8689474f-9c8b-43a1-93c7-8845502a0c4f None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:19.737428 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 295/586] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Nov 2 07:23:19 2022] GET /identity/v3/endpoints?service_id=4dc6316f1b5b4f259efc660f24d30b88&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:19.738360 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689474f-9c8b-43a1-93c7-8845502a0c4f None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:19.822442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaaf973-9d55-4912-98c3-6be8e5c01c27 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:19.831664 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:19.850150 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689474f-9c8b-43a1-93c7-8845502a0c4f None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:19.852788 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:19.858983 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb212cd1-2692-44b4-8298-0f0799317c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:19.859624 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb212cd1-2692-44b4-8298-0f0799317c09 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:19.859902 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb212cd1-2692-44b4-8298-0f0799317c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:19.860205 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb212cd1-2692-44b4-8298-0f0799317c09 None admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:19.860883 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb212cd1-2692-44b4-8298-0f0799317c09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:19.861182 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb212cd1-2692-44b4-8298-0f0799317c09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:19.862634 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb212cd1-2692-44b4-8298-0f0799317c09 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:19.874687 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 292/587] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Nov 2 07:23:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:19.875509 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb212cd1-2692-44b4-8298-0f0799317c09 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:19.898145 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444fecb-79e8-4104-9500-926144b17002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:19.899116 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444fecb-79e8-4104-9500-926144b17002 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:19.899600 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444fecb-79e8-4104-9500-926144b17002 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:19.900121 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444fecb-79e8-4104-9500-926144b17002 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:19.901069 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9444fecb-79e8-4104-9500-926144b17002 None admin] RBAC: Adding query filter params (interface=public, service_id=6b8f3d0234cb470e8950362f9de9f9a6, region_id=RegionOne) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:19.901383 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9444fecb-79e8-4104-9500-926144b17002 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:19.903281 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9444fecb-79e8-4104-9500-926144b17002 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:19.912993 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 296/588] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Nov 2 07:23:19 2022] GET /identity/v3/endpoints?service_id=6b8f3d0234cb470e8950362f9de9f9a6&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:19.914209 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444fecb-79e8-4104-9500-926144b17002 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:19.992532 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb212cd1-2692-44b4-8298-0f0799317c09 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:20.017420 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444fecb-79e8-4104-9500-926144b17002 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:20.031424 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7286d2-f3f5-45ac-8380-693b9087e646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:20.032917 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7286d2-f3f5-45ac-8380-693b9087e646 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:20.033349 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7286d2-f3f5-45ac-8380-693b9087e646 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:20.033691 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7286d2-f3f5-45ac-8380-693b9087e646 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:20.034386 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7286d2-f3f5-45ac-8380-693b9087e646 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:20.035816 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7286d2-f3f5-45ac-8380-693b9087e646 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:20.052083 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 293/589] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Nov 2 07:23:19 2022] GET /identity/v3/services => generated 772 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:20.052083 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7286d2-f3f5-45ac-8380-693b9087e646 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:20.067757 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec69308-757a-48c7-b587-feffbfe4051c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:20.068565 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec69308-757a-48c7-b587-feffbfe4051c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:20.068915 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec69308-757a-48c7-b587-feffbfe4051c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:20.069258 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec69308-757a-48c7-b587-feffbfe4051c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:20.081864 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec69308-757a-48c7-b587-feffbfe4051c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:23:20.086853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-9ec69308-757a-48c7-b587-feffbfe4051c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:23:20.086853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:20.086853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:20.086853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:20.086853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:20.086853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:20.086853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:20.086853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:20.086853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:20.086853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:20.086853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:20.086853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:20.086853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:23:20.086853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:23:20.086853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:23:20.086853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:23:20.087987 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:23:20.087987 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:23:20.087987 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:23:20.087987 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:23:20.087987 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:20.087987 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:20.087987 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:20.087987 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:20.087987 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:20.087987 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:20.087987 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:20.087987 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:20.087987 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:20.087987 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:20.087987 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:20.087987 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:20.089027 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:20.089027 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:20.089027 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:20.089027 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:20.089027 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:23:20.089027 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:23:20.089027 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:23:20.089027 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:23:20.089027 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:23:20.089027 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:23:20.089027 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:23:20.089027 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:20.094097 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 297/590] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Nov 2 07:23:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:20.094097 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec69308-757a-48c7-b587-feffbfe4051c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:20.096525 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:20.129257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:20.188749 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7286d2-f3f5-45ac-8380-693b9087e646 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:20.227401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25cecd9-4b4c-415d-b7e8-3d5bdec2c81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:20.228140 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cecd9-4b4c-415d-b7e8-3d5bdec2c81a None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:20.228488 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cecd9-4b4c-415d-b7e8-3d5bdec2c81a None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:20.228822 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cecd9-4b4c-415d-b7e8-3d5bdec2c81a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:20.229737 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25cecd9-4b4c-415d-b7e8-3d5bdec2c81a None admin] RBAC: Adding query filter params (role.id=9252c356af254127896f3626d925a88a, scope.project.id=2c3bf3e930dd407f8401c0487edc8c20, user.id=232210eabdfd4969a348d7333c50c438) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:20.229909 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25cecd9-4b4c-415d-b7e8-3d5bdec2c81a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:20.232391 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25cecd9-4b4c-415d-b7e8-3d5bdec2c81a None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:20.240885 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 294/591] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Nov 2 07:23:20 2022] GET /identity/v3/role_assignments?user.id=232210eabdfd4969a348d7333c50c438&scope.project.id=2c3bf3e930dd407f8401c0487edc8c20&role.id=9252c356af254127896f3626d925a88a => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:20.242106 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25cecd9-4b4c-415d-b7e8-3d5bdec2c81a None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:20.242269 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec69308-757a-48c7-b587-feffbfe4051c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:20.288799 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27f9a8-ac89-4d94-bec7-9c2bed42cc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:20.289422 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27f9a8-ac89-4d94-bec7-9c2bed42cc55 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:20.289701 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27f9a8-ac89-4d94-bec7-9c2bed42cc55 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:20.289976 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27f9a8-ac89-4d94-bec7-9c2bed42cc55 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:20.290583 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa27f9a8-ac89-4d94-bec7-9c2bed42cc55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:20.291967 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa27f9a8-ac89-4d94-bec7-9c2bed42cc55 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:20.304390 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 298/592] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Nov 2 07:23:20 2022] GET /identity/v3/services => generated 772 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:20.305699 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ff072-a961-40bb-837d-fa619380f495 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:20.306011 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ff072-a961-40bb-837d-fa619380f495 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:20.306700 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ff072-a961-40bb-837d-fa619380f495 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:20.308086 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 299/593] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:20.315034 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd0bff-1a16-448d-b58a-0d9f92546116 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:20.315364 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd0bff-1a16-448d-b58a-0d9f92546116 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:20.315571 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd0bff-1a16-448d-b58a-0d9f92546116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:20.339364 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-bbdd0bff-1a16-448d-b58a-0d9f92546116 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:20.342540 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-bbdd0bff-1a16-448d-b58a-0d9f92546116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:20.375464 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:20.385038 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25cecd9-4b4c-415d-b7e8-3d5bdec2c81a None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:20.434882 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22704ee1-6d3d-47f7-8c8c-2ce24ef82035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:20.435757 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22704ee1-6d3d-47f7-8c8c-2ce24ef82035 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:20.436230 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22704ee1-6d3d-47f7-8c8c-2ce24ef82035 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:20.436706 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22704ee1-6d3d-47f7-8c8c-2ce24ef82035 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:20.437578 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22704ee1-6d3d-47f7-8c8c-2ce24ef82035 None admin] RBAC: Adding query filter params (name=service) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:20.438151 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22704ee1-6d3d-47f7-8c8c-2ce24ef82035 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:20.439760 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22704ee1-6d3d-47f7-8c8c-2ce24ef82035 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:20.444697 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 300/594] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:23:20.452858 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 295/595] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Nov 2 07:23:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:20.458216 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd0bff-1a16-448d-b58a-0d9f92546116 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:20.489903 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:20.579672 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd0bff-1a16-448d-b58a-0d9f92546116 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:20.614636 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdd67f-edda-4b6f-b260-e93164aa935b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:20.615193 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdd67f-edda-4b6f-b260-e93164aa935b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:20.615506 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdd67f-edda-4b6f-b260-e93164aa935b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:20.615780 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdd67f-edda-4b6f-b260-e93164aa935b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:20.626963 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcdd67f-edda-4b6f-b260-e93164aa935b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:20.628438 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcdd67f-edda-4b6f-b260-e93164aa935b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:20.643531 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-dbcdd67f-edda-4b6f-b260-e93164aa935b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:20.643531 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:20.643531 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:20.643531 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:20.643531 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:20.643531 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:20.643531 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:20.643531 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:20.643531 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:20.643531 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:20.643531 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:20.643531 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:20.643531 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:20.643531 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:20.643531 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:20.643531 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:20.644512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:20.644512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:20.644512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:20.644512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:20.644512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:20.644512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:20.644512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:20.644512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:20.644512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:20.644512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:20.644512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:20.644512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:20.644512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:20.644512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:20.644512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:20.644512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:20.644512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:20.645403 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:20.645403 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:20.645403 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:20.645403 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 301/596] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:23:20.650313 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22704ee1-6d3d-47f7-8c8c-2ce24ef82035 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:20.737125 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdd67f-edda-4b6f-b260-e93164aa935b None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:20.775794 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22704ee1-6d3d-47f7-8c8c-2ce24ef82035 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:20.841000 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b70de4-8bc2-44d0-810a-f316fc84dfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:20.842093 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b70de4-8bc2-44d0-810a-f316fc84dfe7 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:20.842093 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b70de4-8bc2-44d0-810a-f316fc84dfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:20.842309 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b70de4-8bc2-44d0-810a-f316fc84dfe7 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:20.848075 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b70de4-8bc2-44d0-810a-f316fc84dfe7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:20.848075 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b70de4-8bc2-44d0-810a-f316fc84dfe7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:20.848075 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b70de4-8bc2-44d0-810a-f316fc84dfe7 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:20.866715 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:20.876287 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 296/597] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:23:20.882332 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b70de4-8bc2-44d0-810a-f316fc84dfe7 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:20.907008 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdd67f-edda-4b6f-b260-e93164aa935b None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:20.936448 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:20.990029 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1baf4b0-6c02-4b49-8c72-cb3a8b8a501d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:20.990678 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1baf4b0-6c02-4b49-8c72-cb3a8b8a501d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:20.990951 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1baf4b0-6c02-4b49-8c72-cb3a8b8a501d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:20.991217 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1baf4b0-6c02-4b49-8c72-cb3a8b8a501d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:21.013619 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b70de4-8bc2-44d0-810a-f316fc84dfe7 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:21.019098 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1baf4b0-6c02-4b49-8c72-cb3a8b8a501d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:23:21.033065 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-f1baf4b0-6c02-4b49-8c72-cb3a8b8a501d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:23:21.033065 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:21.033065 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:21.033065 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:21.033065 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:21.033065 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:21.033065 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:21.033065 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:21.033065 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:21.033065 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:21.033065 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:21.033065 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:21.033065 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:23:21.033065 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:23:21.033065 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:23:21.033065 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:23:21.034120 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:23:21.034120 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:23:21.034120 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:23:21.034120 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:23:21.034120 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:21.034120 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:21.034120 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:21.034120 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:21.034120 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:21.034120 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:21.034120 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:21.034120 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:21.034120 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:21.034120 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:21.034120 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:21.034120 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:21.035033 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:21.035033 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:21.035033 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:21.035033 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:21.035033 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:23:21.035033 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:23:21.035033 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:23:21.035033 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:23:21.035033 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:23:21.035033 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:23:21.035033 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:23:21.035033 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:21.035033 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 302/598] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Nov 2 07:23:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:23:21.042220 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1baf4b0-6c02-4b49-8c72-cb3a8b8a501d None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:21.051813 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082dde0-8f82-4a71-92b9-a937fab4eff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:21.052507 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082dde0-8f82-4a71-92b9-a937fab4eff9 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:21.052785 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082dde0-8f82-4a71-92b9-a937fab4eff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:21.053057 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082dde0-8f82-4a71-92b9-a937fab4eff9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:21.062060 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082dde0-8f82-4a71-92b9-a937fab4eff9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:21.068073 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082dde0-8f82-4a71-92b9-a937fab4eff9 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:21.078177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-3082dde0-8f82-4a71-92b9-a937fab4eff9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 07:23:21.078177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:21.078177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:21.078177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:21.078177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:21.078177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:21.078177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:21.078177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:21.078177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:21.078177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:21.078177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:21.078177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:21.078177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:23:21.078177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:23:21.078177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:23:21.078177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:23:21.079208 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:21.079208 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:21.079208 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:23:21.079208 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:21.079208 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:23:21.079208 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:21.079208 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:21.079208 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:21.079208 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:21.079208 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:21.079208 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:21.079208 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:21.079208 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:21.079208 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:21.079208 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:21.079208 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:21.079208 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:21.079208 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:21.080192 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:21.080192 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:21.080192 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:23:21.080192 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:23:21.080192 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:23:21.080192 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:23:21.080192 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:23:21.080192 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:23:21.080192 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 07:23:21.080192 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:21.080192 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 297/599] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Nov 2 07:23:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:21.085165 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082dde0-8f82-4a71-92b9-a937fab4eff9 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:21.228385 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1baf4b0-6c02-4b49-8c72-cb3a8b8a501d None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:21.250479 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:21.283953 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce1948-a3d3-406d-8204-c76818b8c3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:21.284651 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce1948-a3d3-406d-8204-c76818b8c3d5 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:21.284930 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce1948-a3d3-406d-8204-c76818b8c3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:21.285203 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce1948-a3d3-406d-8204-c76818b8c3d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:21.285866 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce1948-a3d3-406d-8204-c76818b8c3d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:21.286199 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce1948-a3d3-406d-8204-c76818b8c3d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:21.287749 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce1948-a3d3-406d-8204-c76818b8c3d5 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:21.289435 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:21.290913 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082dde0-8f82-4a71-92b9-a937fab4eff9 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:21.306284 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 303/600] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Nov 2 07:23:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:23:21.313031 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce1948-a3d3-406d-8204-c76818b8c3d5 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:21.353141 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4841da-3a67-4af5-a63b-9853a94c7010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:21.353756 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4841da-3a67-4af5-a63b-9853a94c7010 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:21.354035 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4841da-3a67-4af5-a63b-9853a94c7010 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:21.354521 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4841da-3a67-4af5-a63b-9853a94c7010 None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:21.356575 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4841da-3a67-4af5-a63b-9853a94c7010 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:21.356889 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4841da-3a67-4af5-a63b-9853a94c7010 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:21.358314 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4841da-3a67-4af5-a63b-9853a94c7010 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:21.394911 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 298/601] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Nov 2 07:23:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:21.400796 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4841da-3a67-4af5-a63b-9853a94c7010 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:21.520224 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce1948-a3d3-406d-8204-c76818b8c3d5 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:21.559889 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4841da-3a67-4af5-a63b-9853a94c7010 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:21.598721 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a6a4b-fc74-4a94-bdcd-e767e864d080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:21.599330 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a6a4b-fc74-4a94-bdcd-e767e864d080 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:21.599603 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a6a4b-fc74-4a94-bdcd-e767e864d080 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:21.599868 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a6a4b-fc74-4a94-bdcd-e767e864d080 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:21.600393 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48cf738-e6e8-4d5b-bc61-c332d65581bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:21.601319 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48cf738-e6e8-4d5b-bc61-c332d65581bd None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:21.601791 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48cf738-e6e8-4d5b-bc61-c332d65581bd None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:21.602257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48cf738-e6e8-4d5b-bc61-c332d65581bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:21.604437 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:21.621060 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48cf738-e6e8-4d5b-bc61-c332d65581bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:21.623038 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48cf738-e6e8-4d5b-bc61-c332d65581bd None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:21.638286 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-a48cf738-e6e8-4d5b-bc61-c332d65581bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:21.638286 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:21.638286 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:21.638286 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:21.638286 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:21.638286 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:21.638286 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:21.638286 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:21.638286 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:21.638286 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:21.638286 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:21.638286 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:21.638286 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:21.638286 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:21.638286 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:21.638286 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:21.639253 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:21.639253 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:21.639253 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:21.639253 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:21.639253 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:21.639253 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:21.639253 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:21.639253 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:21.639253 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:21.639253 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:21.639253 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:21.639253 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:21.639253 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:21.639253 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:21.639253 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:21.639253 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:21.639253 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:21.640180 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:21.640180 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:21.640180 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:21.640180 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 304/602] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:21.644769 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48cf738-e6e8-4d5b-bc61-c332d65581bd None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:21.735254 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:21.742299 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a6a4b-fc74-4a94-bdcd-e767e864d080 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:21.743730 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a6a4b-fc74-4a94-bdcd-e767e864d080 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:21.817095 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48cf738-e6e8-4d5b-bc61-c332d65581bd None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:21.879993 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f96c6-b0dc-485f-9c13-8f5bf394ff80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:21.880652 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f96c6-b0dc-485f-9c13-8f5bf394ff80 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:21.880926 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f96c6-b0dc-485f-9c13-8f5bf394ff80 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:21.881192 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f96c6-b0dc-485f-9c13-8f5bf394ff80 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:21.881824 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f96c6-b0dc-485f-9c13-8f5bf394ff80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:21.882118 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f96c6-b0dc-485f-9c13-8f5bf394ff80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:21.883597 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f96c6-b0dc-485f-9c13-8f5bf394ff80 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:21.901825 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 305/603] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:23:21.906921 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f96c6-b0dc-485f-9c13-8f5bf394ff80 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:21.930896 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 299/604] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Nov 2 07:23:21 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 07:23:21.937130 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a6a4b-fc74-4a94-bdcd-e767e864d080 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:22.006202 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:22.079384 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f96c6-b0dc-485f-9c13-8f5bf394ff80 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:22.094897 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:22.124446 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a6a4b-fc74-4a94-bdcd-e767e864d080 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:22.135233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7e7bc-4f49-40bd-85e3-287039aefc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:22.135864 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7e7bc-4f49-40bd-85e3-287039aefc99 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:22.136169 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7e7bc-4f49-40bd-85e3-287039aefc99 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:22.136437 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7e7bc-4f49-40bd-85e3-287039aefc99 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:22.143745 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c7e7bc-4f49-40bd-85e3-287039aefc99 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:22.145236 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c7e7bc-4f49-40bd-85e3-287039aefc99 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:22.164023 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-37c7e7bc-4f49-40bd-85e3-287039aefc99 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 02 07:23:22.164023 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:22.164023 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:22.164023 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:22.164023 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:22.164023 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:22.164023 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:22.164023 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:22.164023 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:22.164023 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:22.164023 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:22.164023 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:22.164023 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:23:22.164023 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:23:22.164023 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:23:22.164023 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:23:22.165016 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:22.165016 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:22.165016 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:23:22.165016 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:22.165016 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:23:22.165016 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:22.165016 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:22.165016 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:22.165016 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:22.165016 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:22.165016 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:22.165016 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:22.165016 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:22.165016 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:22.165016 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:22.165016 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:22.165016 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:22.165016 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:22.165956 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:22.165956 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:22.165956 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:23:22.165956 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:23:22.165956 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:23:22.165956 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:23:22.165956 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:23:22.165956 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:23:22.165956 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Nov 02 07:23:22.165956 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:22.165956 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 306/605] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Nov 2 07:23:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:22.170776 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7e7bc-4f49-40bd-85e3-287039aefc99 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:22.182337 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe1d1a-4b5f-458c-bb56-0d4c28bfdb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:22.182971 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe1d1a-4b5f-458c-bb56-0d4c28bfdb82 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:22.183247 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe1d1a-4b5f-458c-bb56-0d4c28bfdb82 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:22.183512 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe1d1a-4b5f-458c-bb56-0d4c28bfdb82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:22.204346 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe1d1a-4b5f-458c-bb56-0d4c28bfdb82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:22.205781 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe1d1a-4b5f-458c-bb56-0d4c28bfdb82 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:22.228614 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-0cbe1d1a-4b5f-458c-bb56-0d4c28bfdb82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:22.228614 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:22.228614 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:22.228614 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:22.228614 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:22.228614 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:22.228614 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:22.228614 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:22.228614 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:22.228614 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:22.228614 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:22.228614 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:22.228614 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:22.228614 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:22.228614 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:22.228614 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:22.229626 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:22.229626 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:22.229626 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:22.229626 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:22.229626 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:22.229626 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:22.229626 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:22.229626 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:22.229626 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:22.229626 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:22.229626 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:22.229626 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:22.229626 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:22.229626 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:22.229626 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:22.229626 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:22.229626 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:22.230593 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:22.230593 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:22.230593 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:22.230593 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 300/606] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:22.237341 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe1d1a-4b5f-458c-bb56-0d4c28bfdb82 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:22.359863 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7e7bc-4f49-40bd-85e3-287039aefc99 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:22.397873 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:22.412485 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe1d1a-4b5f-458c-bb56-0d4c28bfdb82 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:22.428777 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaacd78-a5d3-47c7-abcc-cbc843ac538c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:22.429406 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaacd78-a5d3-47c7-abcc-cbc843ac538c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:22.429680 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaacd78-a5d3-47c7-abcc-cbc843ac538c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:22.429948 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaacd78-a5d3-47c7-abcc-cbc843ac538c None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:22.430678 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaacd78-a5d3-47c7-abcc-cbc843ac538c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:22.430974 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaacd78-a5d3-47c7-abcc-cbc843ac538c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:22.432439 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaacd78-a5d3-47c7-abcc-cbc843ac538c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:22.447556 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0c689-9d61-4fea-9868-ed2d38ccf6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:22.448198 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0c689-9d61-4fea-9868-ed2d38ccf6a5 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:22.448483 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0c689-9d61-4fea-9868-ed2d38ccf6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:22.448760 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0c689-9d61-4fea-9868-ed2d38ccf6a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:22.449934 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0c689-9d61-4fea-9868-ed2d38ccf6a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:22.450317 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0c689-9d61-4fea-9868-ed2d38ccf6a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:22.451598 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0c689-9d61-4fea-9868-ed2d38ccf6a5 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:22.464194 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 301/607] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:22.470309 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 307/608] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Nov 2 07:23:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:22.470884 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0c689-9d61-4fea-9868-ed2d38ccf6a5 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:22.475647 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaacd78-a5d3-47c7-abcc-cbc843ac538c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:22.520445 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:22.642174 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaacd78-a5d3-47c7-abcc-cbc843ac538c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:22.651997 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0c689-9d61-4fea-9868-ed2d38ccf6a5 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:22.688825 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c1953-5445-424f-8a1f-fa064807f2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:22.689528 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c1953-5445-424f-8a1f-fa064807f2c5 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:22.689898 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c1953-5445-424f-8a1f-fa064807f2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:22.690177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c1953-5445-424f-8a1f-fa064807f2c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:22.697093 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c1953-5445-424f-8a1f-fa064807f2c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:22.698623 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c1953-5445-424f-8a1f-fa064807f2c5 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:22.705309 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa084ea6-d80e-43a1-ac22-ac382e7ce673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:22.705924 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa084ea6-d80e-43a1-ac22-ac382e7ce673 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:22.706197 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa084ea6-d80e-43a1-ac22-ac382e7ce673 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:22.706461 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa084ea6-d80e-43a1-ac22-ac382e7ce673 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:22.710228 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-041c1953-5445-424f-8a1f-fa064807f2c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:22.710228 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:22.710228 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:22.710228 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:22.710228 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:22.710228 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:22.710228 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:22.710228 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:22.710228 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:22.710228 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:22.710228 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:22.710228 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:22.710228 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:23:22.710228 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:23:22.710228 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:23:22.711104 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:23:22.711104 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:22.711104 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:22.711104 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:22.711104 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:22.711104 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:22.711104 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:22.711104 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:22.711104 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:22.711104 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:22.711104 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:22.711104 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:22.711104 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:22.711104 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:22.711104 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:22.711104 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:22.711104 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:22.711977 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:23:22.711977 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:23:22.711977 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:23:22.711977 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:23:22.711977 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:23:22.711977 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:23:22.711977 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:22.711977 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:22.711977 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 302/609] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Nov 2 07:23:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:22.717973 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c1953-5445-424f-8a1f-fa064807f2c5 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:22.761387 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:22.799778 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa084ea6-d80e-43a1-ac22-ac382e7ce673 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:22.801308 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa084ea6-d80e-43a1-ac22-ac382e7ce673 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:22.825641 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c1953-5445-424f-8a1f-fa064807f2c5 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:22.856496 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:22.863594 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb915c8-4eca-4559-9ded-144041b7d15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:22.864231 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb915c8-4eca-4559-9ded-144041b7d15a None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:22.864506 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb915c8-4eca-4559-9ded-144041b7d15a None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:22.864778 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb915c8-4eca-4559-9ded-144041b7d15a None admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:22.865462 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb915c8-4eca-4559-9ded-144041b7d15a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:22.865759 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb915c8-4eca-4559-9ded-144041b7d15a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:22.867350 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb915c8-4eca-4559-9ded-144041b7d15a None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:22.885792 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 303/610] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Nov 2 07:23:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:22.887384 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef2e84-fcf6-4233-a3b1-67b767d6e2b3 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:22.887667 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef2e84-fcf6-4233-a3b1-67b767d6e2b3 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:22.887941 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef2e84-fcf6-4233-a3b1-67b767d6e2b3 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:22.890026 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 304/611] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:22.890979 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef2e84-fcf6-4233-a3b1-67b767d6e2b3 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:22.935776 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 308/612] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Nov 2 07:23:22 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Nov 02 07:23:22.937969 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eaa07f-9dbf-49e7-8dba-0b5f4369f4fe None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:22.938255 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eaa07f-9dbf-49e7-8dba-0b5f4369f4fe None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:22.938529 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eaa07f-9dbf-49e7-8dba-0b5f4369f4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:22.960838 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-65eaa07f-9dbf-49e7-8dba-0b5f4369f4fe None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:22.962168 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-65eaa07f-9dbf-49e7-8dba-0b5f4369f4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:22.970868 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:23.006694 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef2e84-fcf6-4233-a3b1-67b767d6e2b3 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:23.038126 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 309/613] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:23.039066 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eaa07f-9dbf-49e7-8dba-0b5f4369f4fe None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:23.041704 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50f7ce-6417-4a59-b12a-cccf831dab30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:23.042309 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50f7ce-6417-4a59-b12a-cccf831dab30 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:23.042582 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50f7ce-6417-4a59-b12a-cccf831dab30 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:23.042850 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50f7ce-6417-4a59-b12a-cccf831dab30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:23.044116 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b50f7ce-6417-4a59-b12a-cccf831dab30 None admin] RBAC: Adding query filter params (role.id=4d61be0c9e7b454abd3b0a3330428290, scope.project.id=2c3bf3e930dd407f8401c0487edc8c20, user.id=0c65f5001a224e0b92e94dc6df9f8f43) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:23.044423 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b50f7ce-6417-4a59-b12a-cccf831dab30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:23.045839 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b50f7ce-6417-4a59-b12a-cccf831dab30 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:23.051724 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 305/614] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Nov 2 07:23:22 2022] GET /identity/v3/role_assignments?user.id=0c65f5001a224e0b92e94dc6df9f8f43&scope.project.id=2c3bf3e930dd407f8401c0487edc8c20&role.id=4d61be0c9e7b454abd3b0a3330428290 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:23.053229 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1de5a9-09a5-428f-a578-f9b4cbdaf88b None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:23.053618 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1de5a9-09a5-428f-a578-f9b4cbdaf88b None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:23.053935 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1de5a9-09a5-428f-a578-f9b4cbdaf88b None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:23.055444 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 306/615] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:23.057247 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ca440-0bf4-4361-a871-d43b64056b05 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:23.057868 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ca440-0bf4-4361-a871-d43b64056b05 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:23.058334 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ca440-0bf4-4361-a871-d43b64056b05 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:23.061442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 307/616] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:23.062930 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0353d71-56a0-4b97-9ca5-044a3de69a90 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:23.063422 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0353d71-56a0-4b97-9ca5-044a3de69a90 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:23.063974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0353d71-56a0-4b97-9ca5-044a3de69a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:23.092300 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-f0353d71-56a0-4b97-9ca5-044a3de69a90 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:23.093568 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f0353d71-56a0-4b97-9ca5-044a3de69a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:23.120397 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:23.176475 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eaa07f-9dbf-49e7-8dba-0b5f4369f4fe None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:23.192275 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 308/617] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:23.194040 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b65a3-24dd-4944-8904-266f72beb796 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:23.194561 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b65a3-24dd-4944-8904-266f72beb796 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:23.195059 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b65a3-24dd-4944-8904-266f72beb796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:23.234202 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-796b65a3-24dd-4944-8904-266f72beb796 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:23.237159 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-796b65a3-24dd-4944-8904-266f72beb796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:23.246492 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff824be4-e28d-463b-a0b5-d4b3b7ba15ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:23.247135 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff824be4-e28d-463b-a0b5-d4b3b7ba15ff None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:23.247409 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff824be4-e28d-463b-a0b5-d4b3b7ba15ff None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:23.247677 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff824be4-e28d-463b-a0b5-d4b3b7ba15ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:23.262556 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff824be4-e28d-463b-a0b5-d4b3b7ba15ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:23.264351 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff824be4-e28d-463b-a0b5-d4b3b7ba15ff None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:23.284870 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-ff824be4-e28d-463b-a0b5-d4b3b7ba15ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:23.284870 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:23.284870 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:23.284870 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:23.284870 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:23.284870 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:23.284870 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:23.284870 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:23.284870 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:23.284870 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:23.284870 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:23.284870 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:23.284870 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:23.284870 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:23.284870 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:23.284870 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:23.285844 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:23.285844 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:23.285844 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:23.285844 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:23.285844 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:23.285844 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:23.285844 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:23.285844 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:23.285844 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:23.285844 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:23.285844 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:23.285844 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:23.285844 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:23.285844 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:23.285844 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:23.285844 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:23.285844 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:23.286718 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:23.286718 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:23.286718 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:23.286718 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 310/618] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:23.292507 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff824be4-e28d-463b-a0b5-d4b3b7ba15ff None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:23.320241 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:23.333087 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 309/619] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:23.336623 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b65a3-24dd-4944-8904-266f72beb796 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:23.418972 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff824be4-e28d-463b-a0b5-d4b3b7ba15ff None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:23.435069 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:23.461396 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310a120-1896-453e-91fd-b9e160debf8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:23.461928 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310a120-1896-453e-91fd-b9e160debf8d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:23.462201 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310a120-1896-453e-91fd-b9e160debf8d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:23.462469 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310a120-1896-453e-91fd-b9e160debf8d None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:23.463101 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310a120-1896-453e-91fd-b9e160debf8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:23.463395 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310a120-1896-453e-91fd-b9e160debf8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:23.465407 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310a120-1896-453e-91fd-b9e160debf8d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:23.480241 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 311/620] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:23.486418 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310a120-1896-453e-91fd-b9e160debf8d None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:23.494219 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b65a3-24dd-4944-8904-266f72beb796 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:23.540039 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a175d9-ec32-4bee-9f6b-1ae05ebe0784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:23.541091 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a175d9-ec32-4bee-9f6b-1ae05ebe0784 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:23.541593 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a175d9-ec32-4bee-9f6b-1ae05ebe0784 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:23.542062 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a175d9-ec32-4bee-9f6b-1ae05ebe0784 None admin] PATH_INFO: `/v3/services/network` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:23.542850 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a175d9-ec32-4bee-9f6b-1ae05ebe0784 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:23.544628 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a175d9-ec32-4bee-9f6b-1ae05ebe0784 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:23.559921 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-85a175d9-ec32-4bee-9f6b-1ae05ebe0784 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 07:23:23.559921 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:23.559921 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:23.559921 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:23.559921 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:23.559921 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:23.559921 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:23.559921 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:23.559921 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 07:23:23.559921 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:23.559921 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:23.559921 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:23.559921 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:23.559921 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:23.559921 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:23.559921 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:23.559921 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:23.561153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:23.561153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:23.561153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:23.561153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:23.561153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:23.561153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:23.561153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:23.561153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:23.561153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:23.561153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:23.561153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:23.561153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:23.561153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:23.561153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:23.561153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:23.561153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:23.562495 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:23.562495 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:23.562495 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:23.562495 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:23.562495 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:23.562495 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:23.562495 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:23.562495 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:23.562495 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:23.562495 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:23.562495 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:23.562495 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:23.562495 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 07:23:23.562495 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:23.565840 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 310/621] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Nov 2 07:23:23 2022] GET /identity/v3/services/network => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:23.567003 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a175d9-ec32-4bee-9f6b-1ae05ebe0784 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:23.620624 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310a120-1896-453e-91fd-b9e160debf8d None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:23.644800 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:23.659763 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2f4c6-eeee-4fbf-9c41-97dd7268e4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:23.662196 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2f4c6-eeee-4fbf-9c41-97dd7268e4c4 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:23.662196 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2f4c6-eeee-4fbf-9c41-97dd7268e4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:23.662196 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2f4c6-eeee-4fbf-9c41-97dd7268e4c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:23.670176 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2f4c6-eeee-4fbf-9c41-97dd7268e4c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:23.671617 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2f4c6-eeee-4fbf-9c41-97dd7268e4c4 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:23.684342 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-38e2f4c6-eeee-4fbf-9c41-97dd7268e4c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:23.684342 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:23.684342 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:23.684342 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:23.684342 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:23.684342 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:23.684342 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:23.684342 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:23.684342 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:23.684342 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:23.684342 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:23.684342 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:23.684342 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:23:23.684342 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:23:23.684342 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:23:23.685257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:23:23.685257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:23.685257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:23.685257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:23.685257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:23.685257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:23.685257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:23.685257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:23.685257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:23.685257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:23.685257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:23.685257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:23.685257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:23.685257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:23.685257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:23.685257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:23.685257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:23.686145 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:23:23.686145 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:23:23.686145 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:23:23.686145 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:23:23.686145 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:23:23.686145 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:23:23.686145 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:23.686145 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:23.686145 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 312/622] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Nov 2 07:23:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:23.686623 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2f4c6-eeee-4fbf-9c41-97dd7268e4c4 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:23.699811 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a175d9-ec32-4bee-9f6b-1ae05ebe0784 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:23.719003 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:23.735721 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4a3b7-deba-4ae0-a80a-5c60f45c848e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:23.736384 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4a3b7-deba-4ae0-a80a-5c60f45c848e None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:23.736656 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4a3b7-deba-4ae0-a80a-5c60f45c848e None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:23.736926 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4a3b7-deba-4ae0-a80a-5c60f45c848e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:23.737505 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab4a3b7-deba-4ae0-a80a-5c60f45c848e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:23.738853 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab4a3b7-deba-4ae0-a80a-5c60f45c848e None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:23.748550 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-cab4a3b7-deba-4ae0-a80a-5c60f45c848e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 07:23:23.748550 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:23.748550 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:23.748550 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:23.748550 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:23.748550 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:23.748550 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:23.748550 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:23.748550 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 07:23:23.748550 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:23.748550 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:23.748550 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:23.748550 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:23.748550 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:23.748550 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:23.748550 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:23.749484 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:23.749484 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:23.749484 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:23.749484 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:23.749484 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:23.749484 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:23.749484 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:23.749484 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:23.749484 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:23.749484 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:23.749484 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:23.749484 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:23.749484 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:23.749484 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:23.749484 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:23.749484 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:23.749484 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:23.750416 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:23.750416 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:23.750416 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:23.750416 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:23.750416 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:23.750416 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:23.750416 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:23.750416 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:23.750416 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:23.750416 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:23.750416 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:23.750416 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:23.750416 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 07:23:23.750416 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:23.750416 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 311/623] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Nov 2 07:23:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:23.751221 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4a3b7-deba-4ae0-a80a-5c60f45c848e None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:23.801964 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2f4c6-eeee-4fbf-9c41-97dd7268e4c4 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:23.838377 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3829007-4f1b-437a-9f40-d77abddd66ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:23.839087 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3829007-4f1b-437a-9f40-d77abddd66ad None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:23.839366 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3829007-4f1b-437a-9f40-d77abddd66ad None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:23.839635 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3829007-4f1b-437a-9f40-d77abddd66ad None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:23.840729 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3829007-4f1b-437a-9f40-d77abddd66ad None admin] RBAC: Adding query filter params (name=network) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:23.841035 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3829007-4f1b-437a-9f40-d77abddd66ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:23.842392 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3829007-4f1b-437a-9f40-d77abddd66ad None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:23.847458 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 313/624] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Nov 2 07:23:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:23.848330 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3829007-4f1b-437a-9f40-d77abddd66ad None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:23.862114 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4a3b7-deba-4ae0-a80a-5c60f45c848e None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:23.883290 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:23.897922 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac556c-5183-432d-ad4f-97dac5372e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:23.898554 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac556c-5183-432d-ad4f-97dac5372e5a None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:23.898837 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac556c-5183-432d-ad4f-97dac5372e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:23.899111 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac556c-5183-432d-ad4f-97dac5372e5a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:23.899686 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac556c-5183-432d-ad4f-97dac5372e5a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:23.901069 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac556c-5183-432d-ad4f-97dac5372e5a None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:23.911036 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-cdac556c-5183-432d-ad4f-97dac5372e5a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 07:23:23.911036 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:23.911036 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:23.911036 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:23.911036 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:23.911036 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:23.911036 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:23.911036 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:23.911036 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 07:23:23.911036 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:23.911036 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:23.911036 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:23.911036 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:23.911036 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:23.911036 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:23.911036 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:23.911036 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:23.912307 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:23.912307 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:23.912307 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:23.912307 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:23.912307 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:23.912307 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:23.912307 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:23.912307 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:23.912307 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:23.912307 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:23.912307 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:23.912307 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:23.912307 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:23.912307 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:23.912307 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:23.912307 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:23.913425 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:23.913425 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:23.913425 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:23.913425 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:23.913425 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:23.913425 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:23.913425 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:23.913425 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:23.913425 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:23.913425 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:23.913425 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:23.913425 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:23.913425 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 07:23:23.913425 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:23.913425 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 312/625] 10.222.0.16 () {56 vars in 1129 bytes} [Wed Nov 2 07:23:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:23.914476 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac556c-5183-432d-ad4f-97dac5372e5a None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:23.962160 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:23.973039 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3829007-4f1b-437a-9f40-d77abddd66ad None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:24.010759 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f13f4e-b19b-47d3-b1e1-da74ffa84717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:24.011353 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f13f4e-b19b-47d3-b1e1-da74ffa84717 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:24.011633 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f13f4e-b19b-47d3-b1e1-da74ffa84717 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:24.012037 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f13f4e-b19b-47d3-b1e1-da74ffa84717 None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:24.012905 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f13f4e-b19b-47d3-b1e1-da74ffa84717 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:24.013207 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f13f4e-b19b-47d3-b1e1-da74ffa84717 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:24.014614 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f13f4e-b19b-47d3-b1e1-da74ffa84717 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:24.024334 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac556c-5183-432d-ad4f-97dac5372e5a None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:24.027189 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 314/626] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Nov 2 07:23:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:24.028294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f13f4e-b19b-47d3-b1e1-da74ffa84717 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:24.066837 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e28e0-c40d-4c36-95c0-d13a632e7f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:24.067437 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e28e0-c40d-4c36-95c0-d13a632e7f80 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:24.067709 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e28e0-c40d-4c36-95c0-d13a632e7f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:24.067974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e28e0-c40d-4c36-95c0-d13a632e7f80 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:24.068615 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e28e0-c40d-4c36-95c0-d13a632e7f80 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:24.068908 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e28e0-c40d-4c36-95c0-d13a632e7f80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:24.070243 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e28e0-c40d-4c36-95c0-d13a632e7f80 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:24.074861 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 313/627] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Nov 2 07:23:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:24.076896 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e28e0-c40d-4c36-95c0-d13a632e7f80 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:24.133181 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:24.135104 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f13f4e-b19b-47d3-b1e1-da74ffa84717 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:24.169577 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be049c-4381-40b6-864c-fa30bb82f4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:24.170344 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be049c-4381-40b6-864c-fa30bb82f4e9 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:24.170710 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be049c-4381-40b6-864c-fa30bb82f4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:24.171078 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be049c-4381-40b6-864c-fa30bb82f4e9 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:24.171836 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be049c-4381-40b6-864c-fa30bb82f4e9 None admin] RBAC: Adding query filter params (type=network) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:24.172252 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be049c-4381-40b6-864c-fa30bb82f4e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:24.173729 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be049c-4381-40b6-864c-fa30bb82f4e9 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:24.183198 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 315/628] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Nov 2 07:23:24 2022] GET /identity/v3/services?type=network => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:24.183198 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be049c-4381-40b6-864c-fa30bb82f4e9 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:24.196374 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e28e0-c40d-4c36-95c0-d13a632e7f80 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:24.202859 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:24.241109 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af481c-0d0f-404b-a213-e184da4a326f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:24.241611 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af481c-0d0f-404b-a213-e184da4a326f None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:24.241886 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af481c-0d0f-404b-a213-e184da4a326f None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:24.242149 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af481c-0d0f-404b-a213-e184da4a326f None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:24.242797 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af481c-0d0f-404b-a213-e184da4a326f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:24.243098 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af481c-0d0f-404b-a213-e184da4a326f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:24.244472 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af481c-0d0f-404b-a213-e184da4a326f None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:24.249662 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 314/629] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Nov 2 07:23:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:24.255211 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af481c-0d0f-404b-a213-e184da4a326f None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:24.290873 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be049c-4381-40b6-864c-fa30bb82f4e9 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:24.329150 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a9f11-c3f0-40fb-98c3-2ec2f970f3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:24.329751 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a9f11-c3f0-40fb-98c3-2ec2f970f3ba None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:24.330026 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a9f11-c3f0-40fb-98c3-2ec2f970f3ba None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:24.330291 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a9f11-c3f0-40fb-98c3-2ec2f970f3ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:24.331001 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a9f11-c3f0-40fb-98c3-2ec2f970f3ba None admin] RBAC: Adding query filter params (role.id=9252c356af254127896f3626d925a88a, scope.project.id=2c3bf3e930dd407f8401c0487edc8c20, user.id=68d63a04c2d74c90b95a4f48c49ddb29) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:24.331301 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a9f11-c3f0-40fb-98c3-2ec2f970f3ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:24.332942 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a9f11-c3f0-40fb-98c3-2ec2f970f3ba None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:24.348099 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 316/630] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Nov 2 07:23:24 2022] GET /identity/v3/role_assignments?user.id=68d63a04c2d74c90b95a4f48c49ddb29&scope.project.id=2c3bf3e930dd407f8401c0487edc8c20&role.id=9252c356af254127896f3626d925a88a => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:24.348099 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a9f11-c3f0-40fb-98c3-2ec2f970f3ba None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:24.384381 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af481c-0d0f-404b-a213-e184da4a326f None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:24.404716 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:24.447225 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f98552-2d3d-4455-ab6a-216afb194b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:24.448618 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f98552-2d3d-4455-ab6a-216afb194b66 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:24.449054 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f98552-2d3d-4455-ab6a-216afb194b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:24.450489 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f98552-2d3d-4455-ab6a-216afb194b66 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:24.452044 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f98552-2d3d-4455-ab6a-216afb194b66 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:24.452565 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f98552-2d3d-4455-ab6a-216afb194b66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:24.455121 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f98552-2d3d-4455-ab6a-216afb194b66 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:24.466667 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 315/631] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Nov 2 07:23:24 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:24.468317 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f98552-2d3d-4455-ab6a-216afb194b66 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:24.494494 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:24.563578 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a9f11-c3f0-40fb-98c3-2ec2f970f3ba None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:24.635379 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e29e9-8868-483c-814c-63cebed3c571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:24.636020 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e29e9-8868-483c-814c-63cebed3c571 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:24.636504 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e29e9-8868-483c-814c-63cebed3c571 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:24.636709 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e29e9-8868-483c-814c-63cebed3c571 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:24.637377 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e29e9-8868-483c-814c-63cebed3c571 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:24.638868 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e29e9-8868-483c-814c-63cebed3c571 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:24.641695 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f98552-2d3d-4455-ab6a-216afb194b66 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:24.695006 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22dc3d8-afda-430c-bfec-526dceffffc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:24.695617 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22dc3d8-afda-430c-bfec-526dceffffc2 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:24.695899 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22dc3d8-afda-430c-bfec-526dceffffc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:24.696246 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22dc3d8-afda-430c-bfec-526dceffffc2 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:24.698666 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22dc3d8-afda-430c-bfec-526dceffffc2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:24.699445 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22dc3d8-afda-430c-bfec-526dceffffc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:24.701055 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22dc3d8-afda-430c-bfec-526dceffffc2 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:24.706637 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 316/632] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Nov 2 07:23:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:24.713019 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22dc3d8-afda-430c-bfec-526dceffffc2 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:24.719341 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 317/633] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:23:24 2022] POST /identity/v3/endpoints => generated 337 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:23:24.782518 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:24.871834 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22dc3d8-afda-430c-bfec-526dceffffc2 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:24.954811 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bed7e-d33e-4ee7-aa53-e3337d8c058e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:24.956335 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bed7e-d33e-4ee7-aa53-e3337d8c058e None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:24.957002 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bed7e-d33e-4ee7-aa53-e3337d8c058e None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:24.957691 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bed7e-d33e-4ee7-aa53-e3337d8c058e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:24.959125 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3bed7e-d33e-4ee7-aa53-e3337d8c058e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:24.961457 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3bed7e-d33e-4ee7-aa53-e3337d8c058e None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:25.032323 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 317/634] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:23:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:23:25.680920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59939c2f-adcc-4f08-8c82-95433063afd9 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:25.681459 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59939c2f-adcc-4f08-8c82-95433063afd9 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:25.681459 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59939c2f-adcc-4f08-8c82-95433063afd9 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:25.682922 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 318/635] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:25.691620 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7e65c-0ab0-4b52-80fe-5c383ee2a424 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:25.691620 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7e65c-0ab0-4b52-80fe-5c383ee2a424 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:25.691620 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7e65c-0ab0-4b52-80fe-5c383ee2a424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:25.707656 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-03c7e65c-0ab0-4b52-80fe-5c383ee2a424 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:25.709130 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-03c7e65c-0ab0-4b52-80fe-5c383ee2a424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:25.783722 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 318/636] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:25 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:26.057734 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59939c2f-adcc-4f08-8c82-95433063afd9 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:26.165572 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59939c2f-adcc-4f08-8c82-95433063afd9 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:26.201059 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a38495-476f-4010-be17-a8dc12fca509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:26.202002 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a38495-476f-4010-be17-a8dc12fca509 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:26.202485 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a38495-476f-4010-be17-a8dc12fca509 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:26.202969 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a38495-476f-4010-be17-a8dc12fca509 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:26.205880 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:26.214011 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a38495-476f-4010-be17-a8dc12fca509 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:23:26.218894 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-16a38495-476f-4010-be17-a8dc12fca509 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 07:23:26.218894 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:26.218894 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:26.218894 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:26.218894 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:26.218894 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:26.218894 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:26.218894 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:26.218894 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:26.218894 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:26.218894 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:26.218894 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:26.218894 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:23:26.218894 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:23:26.218894 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:23:26.218894 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:23:26.228371 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:23:26.228371 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:23:26.228371 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:23:26.228371 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:23:26.228371 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:26.228371 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:26.228371 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:26.228371 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:26.228371 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:26.228371 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:26.228371 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:26.228371 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:26.228371 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:26.228371 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:26.228371 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:26.228371 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:26.229214 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:26.229214 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:26.229214 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:26.229214 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:26.229214 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:23:26.229214 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:23:26.229214 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:23:26.229214 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:23:26.229214 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:23:26.229214 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:23:26.229214 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 07:23:26.229214 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:26.229214 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 319/637] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Nov 2 07:23:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:26.229897 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7e65c-0ab0-4b52-80fe-5c383ee2a424 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:26.247982 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:26.332570 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7e65c-0ab0-4b52-80fe-5c383ee2a424 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:26.367831 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba41f1-fe1a-4080-b1d9-5432c8accadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:26.368468 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba41f1-fe1a-4080-b1d9-5432c8accadd None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:26.368743 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba41f1-fe1a-4080-b1d9-5432c8accadd None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:26.369010 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba41f1-fe1a-4080-b1d9-5432c8accadd None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:26.369663 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba41f1-fe1a-4080-b1d9-5432c8accadd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:26.369960 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba41f1-fe1a-4080-b1d9-5432c8accadd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:26.371667 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba41f1-fe1a-4080-b1d9-5432c8accadd None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:26.381135 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 319/638] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Nov 2 07:23:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:26.386723 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a38495-476f-4010-be17-a8dc12fca509 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:26.499953 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a38495-476f-4010-be17-a8dc12fca509 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:26.536248 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c810e9-ccde-4016-80f2-dd6274a9cf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:26.536877 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c810e9-ccde-4016-80f2-dd6274a9cf69 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:26.537150 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c810e9-ccde-4016-80f2-dd6274a9cf69 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:26.537414 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c810e9-ccde-4016-80f2-dd6274a9cf69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:26.548274 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c810e9-ccde-4016-80f2-dd6274a9cf69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:26.549776 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c810e9-ccde-4016-80f2-dd6274a9cf69 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:26.565781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-77c810e9-ccde-4016-80f2-dd6274a9cf69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:26.565781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:26.565781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:26.565781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:26.565781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:26.565781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:26.565781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:26.565781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:26.565781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:26.565781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:26.565781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:26.565781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:26.565781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:26.565781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:26.565781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:26.565781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:26.566761 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:26.566761 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:26.566761 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:26.566761 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:26.566761 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:26.566761 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:26.566761 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:26.566761 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:26.566761 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:26.566761 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:26.566761 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:26.566761 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:26.566761 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:26.566761 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:26.566761 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:26.566761 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:26.566761 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:26.568092 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:26.568092 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:26.568092 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:26.568092 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 320/639] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:26.572989 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba41f1-fe1a-4080-b1d9-5432c8accadd None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:26.659585 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:26.679854 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba41f1-fe1a-4080-b1d9-5432c8accadd None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:26.715554 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042845cc-2081-49ee-98c6-f034fe53791a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:26.716583 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042845cc-2081-49ee-98c6-f034fe53791a None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:26.717099 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042845cc-2081-49ee-98c6-f034fe53791a None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:26.717572 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042845cc-2081-49ee-98c6-f034fe53791a None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:26.718452 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042845cc-2081-49ee-98c6-f034fe53791a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:26.718971 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042845cc-2081-49ee-98c6-f034fe53791a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:26.720660 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042845cc-2081-49ee-98c6-f034fe53791a None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:26.734935 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 320/640] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:26.740962 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c810e9-ccde-4016-80f2-dd6274a9cf69 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:26.798156 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:26.852332 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5db0d-f1b9-420f-9ffd-fdff6604e42e None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:26.852670 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5db0d-f1b9-420f-9ffd-fdff6604e42e None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:26.852899 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5db0d-f1b9-420f-9ffd-fdff6604e42e None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:26.854476 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 321/641] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:23:26.856801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c810e9-ccde-4016-80f2-dd6274a9cf69 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:26.861374 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4f7ac-b388-489a-b5b8-8ab91c2557f1 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:26.861661 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4f7ac-b388-489a-b5b8-8ab91c2557f1 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:26.861941 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4f7ac-b388-489a-b5b8-8ab91c2557f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:26.881434 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-3fe4f7ac-b388-489a-b5b8-8ab91c2557f1 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:26.882639 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-3fe4f7ac-b388-489a-b5b8-8ab91c2557f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:26.895519 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51bfca4-b192-4e63-b7bf-c83286ab185e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:26.896468 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51bfca4-b192-4e63-b7bf-c83286ab185e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:26.896922 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51bfca4-b192-4e63-b7bf-c83286ab185e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:26.897390 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51bfca4-b192-4e63-b7bf-c83286ab185e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:26.906252 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51bfca4-b192-4e63-b7bf-c83286ab185e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:26.907736 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51bfca4-b192-4e63-b7bf-c83286ab185e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:26.919787 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-d51bfca4-b192-4e63-b7bf-c83286ab185e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 07:23:26.919787 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:26.919787 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:26.919787 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:26.919787 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:26.919787 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:26.919787 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:26.919787 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:26.919787 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:26.919787 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:26.919787 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:26.919787 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:26.919787 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:23:26.919787 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:23:26.919787 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:23:26.919787 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:23:26.921014 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:26.921014 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:26.921014 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:23:26.921014 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:26.921014 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:23:26.921014 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:26.921014 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:26.921014 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:26.921014 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:26.921014 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:26.921014 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:26.921014 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:26.921014 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:26.921014 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:26.921014 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:26.921014 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:26.921014 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:26.921014 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:26.922157 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:26.922157 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:26.922157 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:23:26.922157 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:23:26.922157 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:23:26.922157 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:23:26.922157 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:23:26.922157 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:23:26.922157 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 07:23:26.922157 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:26.925768 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 321/642] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Nov 2 07:23:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:26.926910 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82eda81-10f1-461b-92e4-a4418282ac6e None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:26.927190 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82eda81-10f1-461b-92e4-a4418282ac6e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:26.927466 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82eda81-10f1-461b-92e4-a4418282ac6e None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:26.932762 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 322/643] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:26.932762 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82eda81-10f1-461b-92e4-a4418282ac6e None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:26.967582 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 322/644] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:26 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:26.968926 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9888464-7221-4426-893a-840b6e9020c6 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:26.969217 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9888464-7221-4426-893a-840b6e9020c6 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:26.969553 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9888464-7221-4426-893a-840b6e9020c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:26.989447 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-c9888464-7221-4426-893a-840b6e9020c6 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:26.990755 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c9888464-7221-4426-893a-840b6e9020c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:27.058162 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82eda81-10f1-461b-92e4-a4418282ac6e None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:27.065143 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:27.069977 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 323/645] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:26 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:27.077620 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:27.098991 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651af360-9ac5-4158-a301-a9ae6629d9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:27.099863 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651af360-9ac5-4158-a301-a9ae6629d9ae None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:27.100340 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651af360-9ac5-4158-a301-a9ae6629d9ae None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:27.100786 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651af360-9ac5-4158-a301-a9ae6629d9ae None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:27.102433 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651af360-9ac5-4158-a301-a9ae6629d9ae None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:27.102912 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651af360-9ac5-4158-a301-a9ae6629d9ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:27.104527 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651af360-9ac5-4158-a301-a9ae6629d9ae None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:27.123983 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 323/646] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Nov 2 07:23:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:27.130189 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9888464-7221-4426-893a-840b6e9020c6 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:27.238305 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9888464-7221-4426-893a-840b6e9020c6 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:27.273472 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f511d-c177-4031-b413-3179a90913a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:27.274105 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f511d-c177-4031-b413-3179a90913a1 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:27.274263 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651af360-9ac5-4158-a301-a9ae6629d9ae None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:27.274365 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f511d-c177-4031-b413-3179a90913a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:27.274683 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f511d-c177-4031-b413-3179a90913a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:27.289262 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8f511d-c177-4031-b413-3179a90913a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:27.290717 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8f511d-c177-4031-b413-3179a90913a1 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:27.307528 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-2f8f511d-c177-4031-b413-3179a90913a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:27.307528 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:27.307528 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:27.307528 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:27.307528 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:27.307528 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:27.307528 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:27.307528 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:27.307528 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:27.307528 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:27.307528 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:27.307528 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:27.307528 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:27.307528 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:27.307528 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:27.307528 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:27.309177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:27.309177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:27.309177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:27.309177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:27.309177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:27.309177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:27.309177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:27.309177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:27.309177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:27.309177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:27.309177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:27.309177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:27.309177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:27.309177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:27.309177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:27.309177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:27.309177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:27.310282 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:27.310282 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:27.310282 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:27.310282 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 324/647] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:27.316025 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f511d-c177-4031-b413-3179a90913a1 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:27.376395 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:27.390517 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651af360-9ac5-4158-a301-a9ae6629d9ae None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:27.425929 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546ec4f-a1e8-44a8-a803-31dd89df4d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:27.426540 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546ec4f-a1e8-44a8-a803-31dd89df4d8f None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:27.426817 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546ec4f-a1e8-44a8-a803-31dd89df4d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:27.427093 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546ec4f-a1e8-44a8-a803-31dd89df4d8f None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:27.427730 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3546ec4f-a1e8-44a8-a803-31dd89df4d8f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:27.429124 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3546ec4f-a1e8-44a8-a803-31dd89df4d8f None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:27.429318 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f511d-c177-4031-b413-3179a90913a1 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:27.467591 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ad927-acae-4e77-8cd8-3cd4d4158315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:27.468313 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ad927-acae-4e77-8cd8-3cd4d4158315 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:27.468522 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ad927-acae-4e77-8cd8-3cd4d4158315 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:27.468797 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ad927-acae-4e77-8cd8-3cd4d4158315 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:27.469445 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030ad927-acae-4e77-8cd8-3cd4d4158315 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:27.469748 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030ad927-acae-4e77-8cd8-3cd4d4158315 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:27.471147 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030ad927-acae-4e77-8cd8-3cd4d4158315 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:27.485622 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 325/648] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:23:27.486441 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ad927-acae-4e77-8cd8-3cd4d4158315 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:27.509700 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 324/649] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Nov 2 07:23:27 2022] POST /identity/v3/services => generated 269 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:23:27.510585 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546ec4f-a1e8-44a8-a803-31dd89df4d8f None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:27.547342 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:27.619549 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ad927-acae-4e77-8cd8-3cd4d4158315 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:27.633748 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:27.643495 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546ec4f-a1e8-44a8-a803-31dd89df4d8f None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:27.658597 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73fc57-90e6-423e-a932-270007999b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:27.659394 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73fc57-90e6-423e-a932-270007999b5a None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:27.659586 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73fc57-90e6-423e-a932-270007999b5a None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:27.659864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73fc57-90e6-423e-a932-270007999b5a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:27.660493 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73fc57-90e6-423e-a932-270007999b5a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:27.661983 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73fc57-90e6-423e-a932-270007999b5a None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:27.673179 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-7c73fc57-90e6-423e-a932-270007999b5a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:23:27.673179 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:27.673179 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:27.673179 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:27.673179 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:27.673179 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:27.673179 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:27.673179 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:27.673179 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:23:27.673179 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:27.673179 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:27.673179 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:27.673179 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:27.673179 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:27.673179 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:27.673179 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:27.673179 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:27.674257 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:27.674257 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:27.674257 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:27.674257 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:27.674257 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:27.674257 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:27.674257 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:27.674257 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:27.674257 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:27.674257 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:27.674257 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:27.674257 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:27.674257 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:27.674257 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:27.674257 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:27.674257 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:27.675103 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:27.675103 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:27.675103 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:27.675103 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:27.675103 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:27.675103 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:27.675103 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:27.675103 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:27.675103 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:27.675103 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:27.675103 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:27.675103 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:27.675103 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:23:27.675103 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:27.675103 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 326/650] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Nov 2 07:23:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:27.675923 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a2a69-9544-4c47-a598-df346e09704d None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:27.676390 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a2a69-9544-4c47-a598-df346e09704d None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:27.676390 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a2a69-9544-4c47-a598-df346e09704d None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:27.677881 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 327/651] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:27.683180 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a2a69-9544-4c47-a598-df346e09704d None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:27.694707 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f41acb-e506-4715-8541-bc118d227a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:27.695342 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f41acb-e506-4715-8541-bc118d227a5d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:27.695613 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f41acb-e506-4715-8541-bc118d227a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:27.695885 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f41acb-e506-4715-8541-bc118d227a5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:27.703474 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f41acb-e506-4715-8541-bc118d227a5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:27.704973 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f41acb-e506-4715-8541-bc118d227a5d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:27.716570 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-48f41acb-e506-4715-8541-bc118d227a5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:27.716570 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:27.716570 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:27.716570 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:27.716570 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:27.716570 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:27.716570 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:27.716570 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:27.716570 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:27.716570 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:27.716570 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:27.716570 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:27.716570 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:23:27.716570 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:23:27.716570 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:23:27.717640 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:23:27.717640 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:27.717640 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:27.717640 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:27.717640 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:27.717640 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:27.717640 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:27.717640 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:27.717640 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:27.717640 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:27.717640 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:27.717640 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:27.717640 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:27.717640 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:27.717640 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:27.717640 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:27.717640 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:27.718517 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:23:27.718517 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:23:27.718517 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:23:27.718517 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:23:27.718517 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:23:27.718517 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:23:27.718517 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:27.718517 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:27.718517 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 325/652] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Nov 2 07:23:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:27.718987 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d990d-f22a-4940-b6ba-222f6c4495e4 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:27.719160 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d990d-f22a-4940-b6ba-222f6c4495e4 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:27.719493 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d990d-f22a-4940-b6ba-222f6c4495e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:27.739949 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-488d990d-f22a-4940-b6ba-222f6c4495e4 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:27.741188 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-488d990d-f22a-4940-b6ba-222f6c4495e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:27.804114 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a2a69-9544-4c47-a598-df346e09704d None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:27.819999 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 326/653] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:27 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:27.821106 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d990d-f22a-4940-b6ba-222f6c4495e4 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:27.838210 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:27.854832 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc836a15-eba6-460f-9c6a-edb80b7ac1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:27.855680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc836a15-eba6-460f-9c6a-edb80b7ac1f3 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:27.856093 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc836a15-eba6-460f-9c6a-edb80b7ac1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:27.856465 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc836a15-eba6-460f-9c6a-edb80b7ac1f3 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:27.857224 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc836a15-eba6-460f-9c6a-edb80b7ac1f3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:27.857613 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc836a15-eba6-460f-9c6a-edb80b7ac1f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:27.859282 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc836a15-eba6-460f-9c6a-edb80b7ac1f3 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:27.869834 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 328/654] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Nov 2 07:23:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:27.872431 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc836a15-eba6-460f-9c6a-edb80b7ac1f3 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:27.920018 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:27.948740 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d990d-f22a-4940-b6ba-222f6c4495e4 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:27.993204 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc836a15-eba6-460f-9c6a-edb80b7ac1f3 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:27.994698 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad9ed6-490b-492d-8170-e7010d72804d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:27.995424 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad9ed6-490b-492d-8170-e7010d72804d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:27.995698 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad9ed6-490b-492d-8170-e7010d72804d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:27.996923 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad9ed6-490b-492d-8170-e7010d72804d None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:27.998528 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad9ed6-490b-492d-8170-e7010d72804d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:27.998832 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad9ed6-490b-492d-8170-e7010d72804d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:28.000304 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad9ed6-490b-492d-8170-e7010d72804d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:28.016701 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 327/655] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Nov 2 07:23:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:28.022189 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad9ed6-490b-492d-8170-e7010d72804d None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:28.039042 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bd19c-7d6e-4aef-82e7-c35ba462f1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:28.039930 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bd19c-7d6e-4aef-82e7-c35ba462f1f0 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:28.040442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bd19c-7d6e-4aef-82e7-c35ba462f1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:28.040881 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bd19c-7d6e-4aef-82e7-c35ba462f1f0 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:28.041948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631bd19c-7d6e-4aef-82e7-c35ba462f1f0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:28.042821 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631bd19c-7d6e-4aef-82e7-c35ba462f1f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:28.044667 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631bd19c-7d6e-4aef-82e7-c35ba462f1f0 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:28.056505 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 329/656] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Nov 2 07:23:27 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:28.106766 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:28.110703 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bd19c-7d6e-4aef-82e7-c35ba462f1f0 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:28.139911 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad9ed6-490b-492d-8170-e7010d72804d None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:28.179051 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4bae9-9b60-4df1-9e8f-4f0a8fe51379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:28.179790 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4bae9-9b60-4df1-9e8f-4f0a8fe51379 None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:28.180090 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4bae9-9b60-4df1-9e8f-4f0a8fe51379 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:28.180371 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4bae9-9b60-4df1-9e8f-4f0a8fe51379 None admin] PATH_INFO: `/v3/projects/2c3bf3e930dd407f8401c0487edc8c20/users/0c65f5001a224e0b92e94dc6df9f8f43/roles/5b5508e17b84483d879dd20ce1aa4723` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:28.182601 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4bae9-9b60-4df1-9e8f-4f0a8fe51379 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c3bf3e930dd407f8401c0487edc8c20, user_id=0c65f5001a224e0b92e94dc6df9f8f43, role_id=5b5508e17b84483d879dd20ce1aa4723)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:28.184749 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4bae9-9b60-4df1-9e8f-4f0a8fe51379 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:28.237627 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bd19c-7d6e-4aef-82e7-c35ba462f1f0 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:28.240580 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:28.260735 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 328/657] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Nov 2 07:23:28 2022] PUT /identity/v3/projects/2c3bf3e930dd407f8401c0487edc8c20/users/0c65f5001a224e0b92e94dc6df9f8f43/roles/5b5508e17b84483d879dd20ce1aa4723 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:23:28.287999 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f83ccc-e36c-483c-9fb4-4062a1d3d514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:28.287999 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f83ccc-e36c-483c-9fb4-4062a1d3d514 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:28.287999 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f83ccc-e36c-483c-9fb4-4062a1d3d514 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:28.288427 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f83ccc-e36c-483c-9fb4-4062a1d3d514 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:28.288792 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f83ccc-e36c-483c-9fb4-4062a1d3d514 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:28.290197 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f83ccc-e36c-483c-9fb4-4062a1d3d514 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:28.300408 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-c1f83ccc-e36c-483c-9fb4-4062a1d3d514 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 07:23:28.300408 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:28.300408 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:28.300408 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:28.300408 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:28.300408 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:28.300408 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:28.300408 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:28.300408 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 07:23:28.300408 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:28.300408 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:28.300408 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:28.300408 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:28.300408 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:28.300408 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:28.300408 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:28.300408 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:28.301516 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:28.301516 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:28.301516 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:28.301516 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:28.301516 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:28.301516 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:28.301516 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:28.301516 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:28.301516 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:28.301516 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:28.301516 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:28.301516 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:28.301516 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:28.301516 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:28.301516 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:28.301516 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:28.302370 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:28.302370 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:28.302370 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:28.302370 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:28.302370 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:28.302370 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:28.302370 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:28.302370 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:28.302370 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:28.302370 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:28.302370 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:28.302370 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:28.302370 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 07:23:28.302370 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:28.302370 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 330/658] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Nov 2 07:23:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:23:28.309973 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4bae9-9b60-4df1-9e8f-4f0a8fe51379 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:28.430554 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4bae9-9b60-4df1-9e8f-4f0a8fe51379 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:28.464009 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:28.469609 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2db153-7625-431a-a0cf-284c27e710dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:28.470241 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2db153-7625-431a-a0cf-284c27e710dd None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:28.470564 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2db153-7625-431a-a0cf-284c27e710dd None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:28.470782 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2db153-7625-431a-a0cf-284c27e710dd None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:28.471494 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2db153-7625-431a-a0cf-284c27e710dd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:28.471797 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2db153-7625-431a-a0cf-284c27e710dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:28.473229 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2db153-7625-431a-a0cf-284c27e710dd None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:28.479365 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 329/659] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Nov 2 07:23:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:28.485139 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f83ccc-e36c-483c-9fb4-4062a1d3d514 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:28.590790 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f83ccc-e36c-483c-9fb4-4062a1d3d514 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:28.625423 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20d9f0-ae76-4090-b6c7-9bbfd40150cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:28.626029 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20d9f0-ae76-4090-b6c7-9bbfd40150cc None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:28.626303 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20d9f0-ae76-4090-b6c7-9bbfd40150cc None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:28.626628 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20d9f0-ae76-4090-b6c7-9bbfd40150cc None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:28.627251 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20d9f0-ae76-4090-b6c7-9bbfd40150cc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:28.627548 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20d9f0-ae76-4090-b6c7-9bbfd40150cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:28.628929 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20d9f0-ae76-4090-b6c7-9bbfd40150cc None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:28.633898 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 331/660] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Nov 2 07:23:28 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:29.769199 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205debf9-ed9e-4a6e-8b98-914da9a4c398 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:29.769714 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205debf9-ed9e-4a6e-8b98-914da9a4c398 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:29.769714 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205debf9-ed9e-4a6e-8b98-914da9a4c398 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:29.771372 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 330/661] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:29.776477 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6365143-a6fc-4a4f-aad4-c0a5d36943ae None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:29.776860 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6365143-a6fc-4a4f-aad4-c0a5d36943ae None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:29.777049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6365143-a6fc-4a4f-aad4-c0a5d36943ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:29.796459 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-d6365143-a6fc-4a4f-aad4-c0a5d36943ae None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:29.797638 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-d6365143-a6fc-4a4f-aad4-c0a5d36943ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:29.823814 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:29.865748 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 332/662] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:29 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:30.137722 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205debf9-ed9e-4a6e-8b98-914da9a4c398 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:30.247833 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205debf9-ed9e-4a6e-8b98-914da9a4c398 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:30.283157 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa9777-4f5a-44a1-86e8-4ef4c396ff49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:30.283780 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa9777-4f5a-44a1-86e8-4ef4c396ff49 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:30.284079 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa9777-4f5a-44a1-86e8-4ef4c396ff49 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:30.284345 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa9777-4f5a-44a1-86e8-4ef4c396ff49 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:30.284921 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa9777-4f5a-44a1-86e8-4ef4c396ff49 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:30.286269 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa9777-4f5a-44a1-86e8-4ef4c396ff49 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:30.295335 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-95fa9777-4f5a-44a1-86e8-4ef4c396ff49 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 07:23:30.295335 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:30.295335 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:30.295335 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:30.295335 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:30.295335 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:30.295335 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:30.295335 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:30.295335 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 07:23:30.295335 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:30.295335 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:30.295335 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:30.295335 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:30.295335 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:30.295335 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:30.295335 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:30.296305 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:30.296305 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:30.296305 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:30.296305 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:30.296305 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:30.296305 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:30.296305 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:30.296305 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:30.296305 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:30.296305 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:30.296305 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:30.296305 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:30.296305 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:30.296305 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:30.296305 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:30.296305 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:30.296305 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:30.297778 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:30.297778 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:30.297778 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:30.297778 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:30.297778 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:30.297778 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:30.297778 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:30.297778 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:30.297778 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:30.297778 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:30.297778 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:30.297778 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:30.297778 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 07:23:30.297778 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:30.297778 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 331/663] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Nov 2 07:23:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:30.302176 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6365143-a6fc-4a4f-aad4-c0a5d36943ae None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:30.303761 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13988035-07af-469b-b10b-0a70ffb0ded5 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:30.304041 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13988035-07af-469b-b10b-0a70ffb0ded5 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:30.304336 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13988035-07af-469b-b10b-0a70ffb0ded5 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:30.305619 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 332/664] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:30.311933 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953b71f-7feb-4216-8377-8ce518d8643a None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:30.312239 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953b71f-7feb-4216-8377-8ce518d8643a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:30.312510 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953b71f-7feb-4216-8377-8ce518d8643a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:30.331762 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-1953b71f-7feb-4216-8377-8ce518d8643a None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:30.333091 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-1953b71f-7feb-4216-8377-8ce518d8643a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:30.407614 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:30.419117 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6365143-a6fc-4a4f-aad4-c0a5d36943ae None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:30.427570 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 333/665] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:30 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:23:30.459949 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56617e8-be93-4c08-8a53-3b79b5792deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:30.460582 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56617e8-be93-4c08-8a53-3b79b5792deb None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:30.460856 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56617e8-be93-4c08-8a53-3b79b5792deb None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:30.461125 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56617e8-be93-4c08-8a53-3b79b5792deb None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:30.461744 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56617e8-be93-4c08-8a53-3b79b5792deb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:30.462039 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56617e8-be93-4c08-8a53-3b79b5792deb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:30.463416 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56617e8-be93-4c08-8a53-3b79b5792deb None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:30.469287 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 333/666] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Nov 2 07:23:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:30.477373 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953b71f-7feb-4216-8377-8ce518d8643a None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:30.486822 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab2bce-d1e1-4fa5-85c3-e598dfbc7402 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:30.487415 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab2bce-d1e1-4fa5-85c3-e598dfbc7402 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:30.487954 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab2bce-d1e1-4fa5-85c3-e598dfbc7402 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:30.490335 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 334/667] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:23:30.497439 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23875d9-c05a-408b-b10a-61d19c2a58b1 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:30.497719 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23875d9-c05a-408b-b10a-61d19c2a58b1 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:30.498046 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23875d9-c05a-408b-b10a-61d19c2a58b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:30.520927 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-b23875d9-c05a-408b-b10a-61d19c2a58b1 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:30.523249 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-b23875d9-c05a-408b-b10a-61d19c2a58b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:30.568422 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:30.602675 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953b71f-7feb-4216-8377-8ce518d8643a None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:30.612380 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 335/668] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:30 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:30.639750 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27e90a-9587-4414-a8fc-3eb0276ce937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:30.640383 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27e90a-9587-4414-a8fc-3eb0276ce937 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:30.640657 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27e90a-9587-4414-a8fc-3eb0276ce937 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:30.640924 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27e90a-9587-4414-a8fc-3eb0276ce937 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:30.641544 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27e90a-9587-4414-a8fc-3eb0276ce937 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:30.641841 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27e90a-9587-4414-a8fc-3eb0276ce937 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:30.643191 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27e90a-9587-4414-a8fc-3eb0276ce937 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:30.648422 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 334/669] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Nov 2 07:23:30 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:30.654859 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23875d9-c05a-408b-b10a-61d19c2a58b1 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:30.711971 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27e90a-9587-4414-a8fc-3eb0276ce937 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:30.771483 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23875d9-c05a-408b-b10a-61d19c2a58b1 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:30.785980 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:30.821302 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c70ad-49a9-4fc4-8324-1a68b36c8cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:30.822538 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c70ad-49a9-4fc4-8324-1a68b36c8cea None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:30.822827 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c70ad-49a9-4fc4-8324-1a68b36c8cea None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:30.823225 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c70ad-49a9-4fc4-8324-1a68b36c8cea None admin] PATH_INFO: `/v3/endpoints` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:30.824072 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c70ad-49a9-4fc4-8324-1a68b36c8cea None admin] RBAC: Adding query filter params (interface=public, service_id=3dd3956694654b1fa46a1d5d8c75d3a7, region_id=RegionOne) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:30.825297 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c70ad-49a9-4fc4-8324-1a68b36c8cea None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:30.827292 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c70ad-49a9-4fc4-8324-1a68b36c8cea None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:30.831534 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27e90a-9587-4414-a8fc-3eb0276ce937 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:30.840570 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 336/670] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Nov 2 07:23:30 2022] GET /identity/v3/endpoints?service_id=3dd3956694654b1fa46a1d5d8c75d3a7&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:30.843090 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c70ad-49a9-4fc4-8324-1a68b36c8cea None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:30.872389 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7961e0aa-d2ce-41d3-b965-c5f6be3d8e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:30.872995 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961e0aa-d2ce-41d3-b965-c5f6be3d8e55 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:30.873268 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961e0aa-d2ce-41d3-b965-c5f6be3d8e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:30.873641 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961e0aa-d2ce-41d3-b965-c5f6be3d8e55 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:30.874289 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7961e0aa-d2ce-41d3-b965-c5f6be3d8e55 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:30.875120 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:30.875882 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7961e0aa-d2ce-41d3-b965-c5f6be3d8e55 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:30.953869 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c70ad-49a9-4fc4-8324-1a68b36c8cea None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:30.954974 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 335/671] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Nov 2 07:23:30 2022] POST /identity/v3/services => generated 241 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:23:30.956378 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8e346-9729-447c-b233-b4b7c1cde7ec None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:30.956660 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8e346-9729-447c-b233-b4b7c1cde7ec None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:30.956929 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8e346-9729-447c-b233-b4b7c1cde7ec None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:30.960103 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 336/672] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:30.960103 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8e346-9729-447c-b233-b4b7c1cde7ec None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:30.999503 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d5027-bd94-4311-a3ab-cc1f537a7892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:31.000023 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d5027-bd94-4311-a3ab-cc1f537a7892 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:31.000322 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d5027-bd94-4311-a3ab-cc1f537a7892 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:31.000588 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d5027-bd94-4311-a3ab-cc1f537a7892 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:31.001180 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d5027-bd94-4311-a3ab-cc1f537a7892 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:31.002565 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d5027-bd94-4311-a3ab-cc1f537a7892 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:31.009224 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 337/673] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Nov 2 07:23:30 2022] GET /identity/v3/services => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:23:31.010589 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42411d-afb8-4090-bc0e-3f11e2c1d51a None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:31.010877 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42411d-afb8-4090-bc0e-3f11e2c1d51a None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:31.011149 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42411d-afb8-4090-bc0e-3f11e2c1d51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:31.032606 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-ce42411d-afb8-4090-bc0e-3f11e2c1d51a None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:31.033883 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-ce42411d-afb8-4090-bc0e-3f11e2c1d51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:31.099324 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8e346-9729-447c-b233-b4b7c1cde7ec None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:31.117872 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:31.143357 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d73038-55ba-4b5f-acd2-96937743c631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:31.144014 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d73038-55ba-4b5f-acd2-96937743c631 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:31.144317 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d73038-55ba-4b5f-acd2-96937743c631 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:31.144584 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d73038-55ba-4b5f-acd2-96937743c631 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:31.149605 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 338/674] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:31 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:31.158156 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d73038-55ba-4b5f-acd2-96937743c631 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:23:31.162997 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-f4d73038-55ba-4b5f-acd2-96937743c631 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 07:23:31.162997 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:31.162997 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:31.162997 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:31.162997 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:31.162997 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:31.162997 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:31.162997 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:31.162997 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:31.162997 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:31.162997 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:31.162997 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:31.162997 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:23:31.162997 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:23:31.162997 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:23:31.162997 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:23:31.163960 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:23:31.163960 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:23:31.163960 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:23:31.163960 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:23:31.163960 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:31.163960 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:31.163960 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:31.163960 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:31.163960 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:31.163960 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:31.163960 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:31.163960 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:31.163960 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:31.163960 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:31.163960 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:31.163960 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:31.165165 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:31.165165 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:31.165165 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:31.165165 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:31.165165 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:23:31.165165 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:23:31.165165 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:23:31.165165 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:23:31.165165 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:23:31.165165 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:23:31.165165 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 07:23:31.165165 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:31.165165 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 337/675] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Nov 2 07:23:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:31.172761 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42411d-afb8-4090-bc0e-3f11e2c1d51a None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:31.185918 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:31.282511 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42411d-afb8-4090-bc0e-3f11e2c1d51a None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:31.319034 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de176c-df17-43bf-b651-f807e9302908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:31.319638 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de176c-df17-43bf-b651-f807e9302908 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:31.319917 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de176c-df17-43bf-b651-f807e9302908 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:31.320216 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de176c-df17-43bf-b651-f807e9302908 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:31.320858 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de176c-df17-43bf-b651-f807e9302908 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:31.321151 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de176c-df17-43bf-b651-f807e9302908 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:31.322502 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de176c-df17-43bf-b651-f807e9302908 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:31.331448 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 339/676] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Nov 2 07:23:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:31.337068 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d73038-55ba-4b5f-acd2-96937743c631 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:31.424222 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de176c-df17-43bf-b651-f807e9302908 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:31.443670 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d73038-55ba-4b5f-acd2-96937743c631 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:31.484267 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9ba0a-083b-4a28-8a67-9878ca97c6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:31.485281 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9ba0a-083b-4a28-8a67-9878ca97c6cf None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:31.485903 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9ba0a-083b-4a28-8a67-9878ca97c6cf None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:31.486459 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9ba0a-083b-4a28-8a67-9878ca97c6cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:31.497920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a9ba0a-083b-4a28-8a67-9878ca97c6cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:31.499831 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a9ba0a-083b-4a28-8a67-9878ca97c6cf None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:31.503359 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:31.516859 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-15a9ba0a-083b-4a28-8a67-9878ca97c6cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:31.516859 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:31.516859 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:31.516859 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:31.516859 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:31.516859 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:31.516859 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:31.516859 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:31.516859 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:31.516859 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:31.516859 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:31.516859 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:31.516859 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:31.516859 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:31.516859 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:31.516859 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:31.518552 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:31.518552 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:31.518552 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:31.518552 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:31.518552 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:31.518552 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:31.518552 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:31.518552 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:31.518552 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:31.518552 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:31.518552 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:31.518552 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:31.518552 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:31.518552 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:31.518552 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:31.518552 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:31.518552 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:31.519461 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:31.519461 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:31.519461 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:31.521035 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 338/677] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:31.526221 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9ba0a-083b-4a28-8a67-9878ca97c6cf None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:31.536298 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de176c-df17-43bf-b651-f807e9302908 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:31.556097 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:31.589111 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e7aa6-d8ae-425b-92fe-f2540b168725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:31.589717 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e7aa6-d8ae-425b-92fe-f2540b168725 None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:31.590045 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e7aa6-d8ae-425b-92fe-f2540b168725 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:31.590547 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e7aa6-d8ae-425b-92fe-f2540b168725 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:31.591105 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e7aa6-d8ae-425b-92fe-f2540b168725 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:31.592493 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e7aa6-d8ae-425b-92fe-f2540b168725 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:31.643021 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9ba0a-083b-4a28-8a67-9878ca97c6cf None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:31.678420 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cceb5f1-f42c-4209-b4e6-845df202a873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:31.679016 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cceb5f1-f42c-4209-b4e6-845df202a873 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:31.679290 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cceb5f1-f42c-4209-b4e6-845df202a873 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:31.679563 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cceb5f1-f42c-4209-b4e6-845df202a873 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:31.680207 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cceb5f1-f42c-4209-b4e6-845df202a873 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:31.680503 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cceb5f1-f42c-4209-b4e6-845df202a873 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:31.682013 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cceb5f1-f42c-4209-b4e6-845df202a873 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:31.690049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 340/678] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Nov 2 07:23:31 2022] POST /identity/v3/services => generated 251 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:23:31.698951 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 339/679] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:31.700421 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e7aa6-d8ae-425b-92fe-f2540b168725 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:31.829943 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e7aa6-d8ae-425b-92fe-f2540b168725 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:31.861750 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:31.870120 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c1266-dd65-480d-81bd-1e4734bede41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:31.870767 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c1266-dd65-480d-81bd-1e4734bede41 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:31.871207 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c1266-dd65-480d-81bd-1e4734bede41 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:31.871567 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c1266-dd65-480d-81bd-1e4734bede41 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:31.879750 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c1266-dd65-480d-81bd-1e4734bede41 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:31.883399 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c1266-dd65-480d-81bd-1e4734bede41 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:31.895049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-c44c1266-dd65-480d-81bd-1e4734bede41 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 07:23:31.895049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:31.895049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:31.895049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:31.895049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:31.895049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:31.895049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:31.895049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:31.895049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:31.895049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:31.895049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:31.895049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:31.895049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:23:31.895049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:23:31.895049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:23:31.895049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:23:31.896178 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:31.896178 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:31.896178 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:23:31.896178 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:31.896178 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:23:31.896178 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:31.896178 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:31.896178 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:31.896178 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:31.896178 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:31.896178 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:31.896178 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:31.896178 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:31.896178 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:31.896178 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:31.896178 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:31.896178 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:31.896178 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:31.897159 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:31.897159 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:31.897159 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:23:31.897159 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:23:31.897159 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:23:31.897159 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:23:31.897159 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:23:31.897159 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:23:31.897159 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 07:23:31.897159 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:31.898245 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 341/680] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Nov 2 07:23:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:31.903919 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cceb5f1-f42c-4209-b4e6-845df202a873 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:32.002442 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:32.018388 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cceb5f1-f42c-4209-b4e6-845df202a873 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:32.057023 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088bf173-fc17-4863-90be-3f4c19a640f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:32.057634 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088bf173-fc17-4863-90be-3f4c19a640f2 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:32.057913 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088bf173-fc17-4863-90be-3f4c19a640f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:32.058191 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088bf173-fc17-4863-90be-3f4c19a640f2 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:32.059607 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088bf173-fc17-4863-90be-3f4c19a640f2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:32.059914 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088bf173-fc17-4863-90be-3f4c19a640f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:32.061373 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088bf173-fc17-4863-90be-3f4c19a640f2 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:32.079279 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 340/681] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Nov 2 07:23:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:32.084836 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c1266-dd65-480d-81bd-1e4734bede41 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:32.187587 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c1266-dd65-480d-81bd-1e4734bede41 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:32.222994 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af4a665-d6eb-4adf-97b7-8e3422644eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:32.223600 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4a665-d6eb-4adf-97b7-8e3422644eae None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:32.223878 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4a665-d6eb-4adf-97b7-8e3422644eae None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:32.224229 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4a665-d6eb-4adf-97b7-8e3422644eae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:32.282011 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:32.294812 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af4a665-d6eb-4adf-97b7-8e3422644eae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:32.296289 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af4a665-d6eb-4adf-97b7-8e3422644eae None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:32.399804 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 342/682] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Nov 2 07:23:32 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 07:23:32.408920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088bf173-fc17-4863-90be-3f4c19a640f2 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:32.520546 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088bf173-fc17-4863-90be-3f4c19a640f2 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:32.557775 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc582f69-27b2-43c8-8f69-76a7742492e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:32.558403 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc582f69-27b2-43c8-8f69-76a7742492e2 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:32.558856 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc582f69-27b2-43c8-8f69-76a7742492e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:32.559320 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc582f69-27b2-43c8-8f69-76a7742492e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:32.569569 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc582f69-27b2-43c8-8f69-76a7742492e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:32.571019 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc582f69-27b2-43c8-8f69-76a7742492e2 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:32.585638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-bc582f69-27b2-43c8-8f69-76a7742492e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:32.585638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:32.585638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:32.585638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:32.585638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:32.585638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:32.585638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:32.585638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:32.585638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:32.585638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:32.585638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:32.585638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:32.585638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:32.585638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:32.585638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:32.585638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:32.586592 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:32.586592 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:32.586592 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:32.586592 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:32.586592 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:32.586592 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:32.586592 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:32.586592 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:32.586592 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:32.586592 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:32.586592 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:32.586592 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:32.586592 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:32.586592 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:32.586592 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:32.586592 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:32.586592 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:32.587522 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:32.587522 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:32.587522 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:32.587522 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 341/683] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:32.588350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:32.597297 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af4a665-d6eb-4adf-97b7-8e3422644eae None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:32.684893 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:32.696588 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af4a665-d6eb-4adf-97b7-8e3422644eae None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:32.733289 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661cb994-0f6e-4a7e-a824-f4115d57a6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:32.733896 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661cb994-0f6e-4a7e-a824-f4115d57a6c8 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:32.734547 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661cb994-0f6e-4a7e-a824-f4115d57a6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:32.735172 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661cb994-0f6e-4a7e-a824-f4115d57a6c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:32.735810 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661cb994-0f6e-4a7e-a824-f4115d57a6c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:32.736382 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661cb994-0f6e-4a7e-a824-f4115d57a6c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:32.738268 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661cb994-0f6e-4a7e-a824-f4115d57a6c8 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:32.750613 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 343/684] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:32.756279 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc582f69-27b2-43c8-8f69-76a7742492e2 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:32.860320 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc582f69-27b2-43c8-8f69-76a7742492e2 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:32.897701 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9e6f9-fbce-4cab-a5af-c76fea6bcf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:32.898705 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9e6f9-fbce-4cab-a5af-c76fea6bcf78 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:32.899201 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9e6f9-fbce-4cab-a5af-c76fea6bcf78 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:32.899676 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9e6f9-fbce-4cab-a5af-c76fea6bcf78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:32.907727 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad9e6f9-fbce-4cab-a5af-c76fea6bcf78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:32.909911 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad9e6f9-fbce-4cab-a5af-c76fea6bcf78 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:32.922935 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-aad9e6f9-fbce-4cab-a5af-c76fea6bcf78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:32.922935 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:32.922935 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:32.922935 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:32.922935 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:32.922935 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:32.922935 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:32.922935 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:32.922935 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:32.922935 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:32.922935 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:32.922935 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:32.922935 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:23:32.922935 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:23:32.922935 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:23:32.923920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:23:32.923920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:32.923920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:32.923920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:32.923920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:32.923920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:32.923920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:32.923920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:32.923920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:32.923920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:32.923920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:32.923920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:32.923920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:32.923920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:32.923920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:32.923920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:32.923920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:32.924866 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:23:32.924866 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:23:32.924866 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:23:32.924866 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:23:32.924866 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:23:32.924866 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:23:32.924866 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:32.924866 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:32.927344 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 342/685] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Nov 2 07:23:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:32.935103 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661cb994-0f6e-4a7e-a824-f4115d57a6c8 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:33.041433 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661cb994-0f6e-4a7e-a824-f4115d57a6c8 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:33.082407 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed9e62-6511-41ef-99d6-34530cce5129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:33.083015 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed9e62-6511-41ef-99d6-34530cce5129 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:33.083292 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed9e62-6511-41ef-99d6-34530cce5129 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:33.083566 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed9e62-6511-41ef-99d6-34530cce5129 None admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:33.084280 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed9e62-6511-41ef-99d6-34530cce5129 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:33.084584 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed9e62-6511-41ef-99d6-34530cce5129 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:33.086001 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed9e62-6511-41ef-99d6-34530cce5129 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:33.100807 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 344/686] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Nov 2 07:23:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:33.113152 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9e6f9-fbce-4cab-a5af-c76fea6bcf78 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:33.175381 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:33.226272 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9e6f9-fbce-4cab-a5af-c76fea6bcf78 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:33.266935 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436bf196-0995-4b04-a42d-2b324e19af31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:33.267560 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bf196-0995-4b04-a42d-2b324e19af31 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:33.267839 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bf196-0995-4b04-a42d-2b324e19af31 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:33.268140 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bf196-0995-4b04-a42d-2b324e19af31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:33.268879 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436bf196-0995-4b04-a42d-2b324e19af31 None admin] RBAC: Adding query filter params (role.id=5b5508e17b84483d879dd20ce1aa4723, scope.project.id=2c3bf3e930dd407f8401c0487edc8c20, user.id=0c65f5001a224e0b92e94dc6df9f8f43) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:33.269184 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436bf196-0995-4b04-a42d-2b324e19af31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:33.270657 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436bf196-0995-4b04-a42d-2b324e19af31 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:33.279158 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 343/687] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Nov 2 07:23:33 2022] GET /identity/v3/role_assignments?user.id=0c65f5001a224e0b92e94dc6df9f8f43&scope.project.id=2c3bf3e930dd407f8401c0487edc8c20&role.id=5b5508e17b84483d879dd20ce1aa4723 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:33.324827 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd915c3-999e-4d67-85b0-d97b3a3379af None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:33.325450 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd915c3-999e-4d67-85b0-d97b3a3379af None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:33.325945 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd915c3-999e-4d67-85b0-d97b3a3379af None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:33.327862 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 345/688] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:33.333802 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fd0d2-2107-43a8-b8cc-95ddf4d89551 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:33.334431 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fd0d2-2107-43a8-b8cc-95ddf4d89551 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:33.334895 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fd0d2-2107-43a8-b8cc-95ddf4d89551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:33.360414 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-af4fd0d2-2107-43a8-b8cc-95ddf4d89551 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:33.361653 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-af4fd0d2-2107-43a8-b8cc-95ddf4d89551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:33.372995 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743b896-a2cf-40bb-999b-b29da57f1230 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:33.373320 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743b896-a2cf-40bb-999b-b29da57f1230 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:33.373531 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743b896-a2cf-40bb-999b-b29da57f1230 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:33.375341 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 346/689] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:23:33.381295 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177891ec-4d50-4699-9b7a-e42063635919 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:33.381565 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177891ec-4d50-4699-9b7a-e42063635919 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:33.381834 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177891ec-4d50-4699-9b7a-e42063635919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:33.401497 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-177891ec-4d50-4699-9b7a-e42063635919 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:33.403485 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-177891ec-4d50-4699-9b7a-e42063635919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:33.405860 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:33.445534 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 344/690] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:33.478929 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 347/691] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:23:33.714351 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fd0d2-2107-43a8-b8cc-95ddf4d89551 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:33.755522 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177891ec-4d50-4699-9b7a-e42063635919 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:33.766181 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:33.829057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fd0d2-2107-43a8-b8cc-95ddf4d89551 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:33.867284 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177891ec-4d50-4699-9b7a-e42063635919 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:33.869554 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8df402-4cc4-41be-ab32-f2492ad5373d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:33.870197 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8df402-4cc4-41be-ab32-f2492ad5373d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:33.870468 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8df402-4cc4-41be-ab32-f2492ad5373d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:33.870743 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8df402-4cc4-41be-ab32-f2492ad5373d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:33.871386 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8df402-4cc4-41be-ab32-f2492ad5373d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:33.872899 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8df402-4cc4-41be-ab32-f2492ad5373d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:33.882091 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-4a8df402-4cc4-41be-ab32-f2492ad5373d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:23:33.882091 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:33.882091 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:33.882091 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:33.882091 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:33.882091 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:33.882091 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:33.882091 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:33.882091 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:23:33.882091 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:33.882091 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:33.882091 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:33.882091 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:33.882091 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:33.882091 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:33.882091 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:33.882091 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:33.883057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:33.883057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:33.883057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:33.883057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:33.883057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:33.883057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:33.883057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:33.883057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:33.883057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:33.883057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:33.883057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:33.883057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:33.883057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:33.883057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:33.883057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:33.883057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:33.883867 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:33.883867 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:33.883867 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:33.883867 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:33.883867 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:33.883867 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:33.883867 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:33.883867 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:33.883867 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:33.883867 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:33.883867 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:33.883867 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:33.883867 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:23:33.883867 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:33.883867 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 345/692] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Nov 2 07:23:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:33.893177 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8df402-4cc4-41be-ab32-f2492ad5373d None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:33.912239 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0326b6f-dee9-4e29-93d3-c2c706d92f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:33.912972 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0326b6f-dee9-4e29-93d3-c2c706d92f38 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:33.913316 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0326b6f-dee9-4e29-93d3-c2c706d92f38 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:33.913672 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0326b6f-dee9-4e29-93d3-c2c706d92f38 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:33.914293 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0326b6f-dee9-4e29-93d3-c2c706d92f38 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:33.915830 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0326b6f-dee9-4e29-93d3-c2c706d92f38 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:33.925840 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-d0326b6f-dee9-4e29-93d3-c2c706d92f38 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 07:23:33.925840 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:33.925840 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:33.925840 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:33.925840 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:33.925840 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:33.925840 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:33.925840 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:33.925840 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 07:23:33.925840 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:33.925840 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:33.925840 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:33.925840 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:33.925840 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:33.925840 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:33.925840 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:33.926787 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:33.926787 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:33.926787 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:33.926787 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:33.926787 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:33.926787 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:33.926787 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:33.926787 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:33.926787 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:33.926787 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:33.926787 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:33.926787 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:33.926787 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:33.926787 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:33.926787 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:33.926787 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:33.926787 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:33.927649 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:33.927649 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:33.927649 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:33.927649 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:33.927649 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:33.927649 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:33.927649 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:33.927649 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:33.927649 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:33.927649 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:33.927649 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:33.927649 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:33.927649 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 07:23:33.927649 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:33.932137 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 348/693] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Nov 2 07:23:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:33.932905 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0326b6f-dee9-4e29-93d3-c2c706d92f38 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:33.938353 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:34.042252 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8df402-4cc4-41be-ab32-f2492ad5373d None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:34.056981 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0326b6f-dee9-4e29-93d3-c2c706d92f38 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:34.057371 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:34.081210 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48e2a3-e832-4481-af7a-a3c2758f9b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:34.081867 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48e2a3-e832-4481-af7a-a3c2758f9b24 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:34.082142 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48e2a3-e832-4481-af7a-a3c2758f9b24 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:34.082407 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48e2a3-e832-4481-af7a-a3c2758f9b24 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:34.083073 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48e2a3-e832-4481-af7a-a3c2758f9b24 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:34.083374 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48e2a3-e832-4481-af7a-a3c2758f9b24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:34.084927 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48e2a3-e832-4481-af7a-a3c2758f9b24 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:34.091832 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 346/694] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Nov 2 07:23:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:34.096185 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48e2a3-e832-4481-af7a-a3c2758f9b24 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:34.101520 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97a582-60d4-4ce7-8e77-18c1de412238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:34.102480 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97a582-60d4-4ce7-8e77-18c1de412238 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:34.102957 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97a582-60d4-4ce7-8e77-18c1de412238 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:34.103422 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97a582-60d4-4ce7-8e77-18c1de412238 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:34.104267 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97a582-60d4-4ce7-8e77-18c1de412238 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:34.105224 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97a582-60d4-4ce7-8e77-18c1de412238 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:34.106955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97a582-60d4-4ce7-8e77-18c1de412238 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:34.114257 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 349/695] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Nov 2 07:23:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:34.120542 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159faf59-88aa-47ed-a3c3-596a675a7c2c None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:34.120542 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159faf59-88aa-47ed-a3c3-596a675a7c2c None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:34.120542 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159faf59-88aa-47ed-a3c3-596a675a7c2c None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:34.120542 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 350/696] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:23:34.120542 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159faf59-88aa-47ed-a3c3-596a675a7c2c None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:34.192023 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:34.201978 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48e2a3-e832-4481-af7a-a3c2758f9b24 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:34.232634 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159faf59-88aa-47ed-a3c3-596a675a7c2c None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:34.238912 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f20291-e96a-41db-b2f8-851ad3fc6387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:34.239523 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f20291-e96a-41db-b2f8-851ad3fc6387 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:34.239828 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f20291-e96a-41db-b2f8-851ad3fc6387 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:34.240555 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f20291-e96a-41db-b2f8-851ad3fc6387 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:34.241181 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f20291-e96a-41db-b2f8-851ad3fc6387 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:34.241480 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f20291-e96a-41db-b2f8-851ad3fc6387 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:34.243199 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f20291-e96a-41db-b2f8-851ad3fc6387 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:34.253971 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 347/697] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Nov 2 07:23:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:34.253971 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c459f-2ea3-4bd0-81f2-e44564b9d1ac None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:34.253971 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c459f-2ea3-4bd0-81f2-e44564b9d1ac None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:34.253971 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c459f-2ea3-4bd0-81f2-e44564b9d1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:34.269911 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-505c459f-2ea3-4bd0-81f2-e44564b9d1ac None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:34.271082 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-505c459f-2ea3-4bd0-81f2-e44564b9d1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:34.274221 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d6cbc-d938-49fb-8b40-2095347ae28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:34.274825 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d6cbc-d938-49fb-8b40-2095347ae28e None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:34.275101 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d6cbc-d938-49fb-8b40-2095347ae28e None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:34.275367 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d6cbc-d938-49fb-8b40-2095347ae28e None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:34.275983 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d6cbc-d938-49fb-8b40-2095347ae28e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:34.276309 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d6cbc-d938-49fb-8b40-2095347ae28e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:34.277685 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d6cbc-d938-49fb-8b40-2095347ae28e None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:34.282707 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 351/698] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Nov 2 07:23:34 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:34.283394 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d6cbc-d938-49fb-8b40-2095347ae28e None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:34.314781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:34.347802 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 348/699] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:34.348738 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c459f-2ea3-4bd0-81f2-e44564b9d1ac None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:34.412629 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d6cbc-d938-49fb-8b40-2095347ae28e None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:34.445573 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:34.451993 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f0d8e-fb59-4176-a3c7-4f7fbbdb7542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:34.452676 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f0d8e-fb59-4176-a3c7-4f7fbbdb7542 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:34.452952 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f0d8e-fb59-4176-a3c7-4f7fbbdb7542 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:34.453221 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f0d8e-fb59-4176-a3c7-4f7fbbdb7542 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:34.454020 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f0d8e-fb59-4176-a3c7-4f7fbbdb7542 None admin] RBAC: Adding query filter params (interface=public, service_id=17ff53cdac234df88f63f11c5bc0df4e, region_id=RegionOne) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:34.458505 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f0d8e-fb59-4176-a3c7-4f7fbbdb7542 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:34.458505 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f0d8e-fb59-4176-a3c7-4f7fbbdb7542 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:34.461701 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 352/700] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Nov 2 07:23:34 2022] GET /identity/v3/endpoints?service_id=17ff53cdac234df88f63f11c5bc0df4e&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:34.464159 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c459f-2ea3-4bd0-81f2-e44564b9d1ac None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:34.466898 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f0d8e-fb59-4176-a3c7-4f7fbbdb7542 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:34.509461 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def3329-4dae-4bbe-94a6-0e082e0ca079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:34.510480 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def3329-4dae-4bbe-94a6-0e082e0ca079 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:34.511003 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def3329-4dae-4bbe-94a6-0e082e0ca079 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:34.511496 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def3329-4dae-4bbe-94a6-0e082e0ca079 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:34.512889 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def3329-4dae-4bbe-94a6-0e082e0ca079 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:34.514519 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def3329-4dae-4bbe-94a6-0e082e0ca079 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:34.577118 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f0d8e-fb59-4176-a3c7-4f7fbbdb7542 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:34.596078 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 349/701] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:23:34 2022] POST /identity/v3/endpoints => generated 347 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:23:34.621872 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def3329-4dae-4bbe-94a6-0e082e0ca079 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:34.632957 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20898757-3836-4f8b-938a-d58688620801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:34.633663 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20898757-3836-4f8b-938a-d58688620801 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:34.633940 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20898757-3836-4f8b-938a-d58688620801 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:34.634325 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20898757-3836-4f8b-938a-d58688620801 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:34.635086 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20898757-3836-4f8b-938a-d58688620801 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:34.636822 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20898757-3836-4f8b-938a-d58688620801 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:34.644517 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 353/702] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Nov 2 07:23:34 2022] GET /identity/v3/services => generated 1497 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:23:34.653981 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:34.740384 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def3329-4dae-4bbe-94a6-0e082e0ca079 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:34.781598 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab59632-f242-4f19-a71b-75e7deb25315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:34.782510 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab59632-f242-4f19-a71b-75e7deb25315 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:34.782960 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab59632-f242-4f19-a71b-75e7deb25315 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:34.783380 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab59632-f242-4f19-a71b-75e7deb25315 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:34.784186 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab59632-f242-4f19-a71b-75e7deb25315 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:34.785741 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab59632-f242-4f19-a71b-75e7deb25315 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:34.796294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-5ab59632-f242-4f19-a71b-75e7deb25315 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 07:23:34.796294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:34.796294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:34.796294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:34.796294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:34.796294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:34.796294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:34.796294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:34.796294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 07:23:34.796294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:34.796294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:34.796294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:34.796294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:34.796294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:34.796294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:34.796294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:34.796294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:34.797609 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:34.797609 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:34.797609 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:34.797609 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:34.797609 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:34.797609 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:34.797609 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:34.797609 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:34.797609 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:34.797609 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:34.797609 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:34.797609 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:34.797609 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:34.797609 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:34.797609 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:34.797609 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:34.798781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:34.798781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:34.798781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:34.798781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:34.798781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:34.798781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:34.798781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:34.798781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:34.798781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:34.798781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:34.798781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:34.798781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:34.798781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 07:23:34.798781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:34.801458 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 350/703] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Nov 2 07:23:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:23:34.807967 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20898757-3836-4f8b-938a-d58688620801 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:34.876817 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:34.927398 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20898757-3836-4f8b-938a-d58688620801 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:34.967876 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b8351-e957-47ad-b4f7-d309d1c2fde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:34.969177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b8351-e957-47ad-b4f7-d309d1c2fde6 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:34.969626 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b8351-e957-47ad-b4f7-d309d1c2fde6 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:34.970056 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b8351-e957-47ad-b4f7-d309d1c2fde6 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:34.970814 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b8351-e957-47ad-b4f7-d309d1c2fde6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:34.971313 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b8351-e957-47ad-b4f7-d309d1c2fde6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:34.972840 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b8351-e957-47ad-b4f7-d309d1c2fde6 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:34.978323 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 354/704] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Nov 2 07:23:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:34.986397 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab59632-f242-4f19-a71b-75e7deb25315 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:35.077626 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:35.089609 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab59632-f242-4f19-a71b-75e7deb25315 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:35.125990 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79323c1-773c-4558-959a-096c8c759b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:35.126736 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79323c1-773c-4558-959a-096c8c759b38 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:35.126736 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79323c1-773c-4558-959a-096c8c759b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:35.126736 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79323c1-773c-4558-959a-096c8c759b38 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:35.127319 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79323c1-773c-4558-959a-096c8c759b38 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:35.128581 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79323c1-773c-4558-959a-096c8c759b38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:35.130336 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79323c1-773c-4558-959a-096c8c759b38 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:35.135068 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 351/705] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Nov 2 07:23:34 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:35.141218 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b8351-e957-47ad-b4f7-d309d1c2fde6 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:35.248987 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b8351-e957-47ad-b4f7-d309d1c2fde6 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:35.268250 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:35.285802 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6366ea-0412-4ea2-9f29-a992fffd0937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:35.286741 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6366ea-0412-4ea2-9f29-a992fffd0937 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:35.287246 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6366ea-0412-4ea2-9f29-a992fffd0937 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:35.287718 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6366ea-0412-4ea2-9f29-a992fffd0937 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:35.288642 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6366ea-0412-4ea2-9f29-a992fffd0937 None admin] RBAC: Adding query filter params (interface=public, service_id=913aa8f404224ba6974784417152b68d, region_id=RegionOne) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:35.289188 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6366ea-0412-4ea2-9f29-a992fffd0937 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:35.290882 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6366ea-0412-4ea2-9f29-a992fffd0937 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:35.297668 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 355/706] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Nov 2 07:23:35 2022] GET /identity/v3/endpoints?service_id=913aa8f404224ba6974784417152b68d&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:35.306453 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79323c1-773c-4558-959a-096c8c759b38 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:35.406740 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79323c1-773c-4558-959a-096c8c759b38 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:35.445866 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f7205-c170-4428-b651-ab2b1966c598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:35.446474 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f7205-c170-4428-b651-ab2b1966c598 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:35.446748 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f7205-c170-4428-b651-ab2b1966c598 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:35.447014 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f7205-c170-4428-b651-ab2b1966c598 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:35.447608 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f7205-c170-4428-b651-ab2b1966c598 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:35.449042 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f7205-c170-4428-b651-ab2b1966c598 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:35.455629 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 352/707] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Nov 2 07:23:35 2022] GET /identity/v3/services => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:23:35.531557 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe663d-a23a-42c6-90e9-e55297ddb4dd None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:35.531852 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe663d-a23a-42c6-90e9-e55297ddb4dd None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:35.532127 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe663d-a23a-42c6-90e9-e55297ddb4dd None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:35.533715 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 356/708] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:35.539298 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a89cb7-b06d-42e6-a93b-0a0750a780af None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:35.539819 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a89cb7-b06d-42e6-a93b-0a0750a780af None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:35.540278 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a89cb7-b06d-42e6-a93b-0a0750a780af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:35.561067 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-05a89cb7-b06d-42e6-a93b-0a0750a780af None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:35.562533 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-05a89cb7-b06d-42e6-a93b-0a0750a780af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:35.579702 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:35.639328 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 353/709] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:35.909500 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe663d-a23a-42c6-90e9-e55297ddb4dd None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:36.017724 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe663d-a23a-42c6-90e9-e55297ddb4dd None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:36.060002 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df9de5-a7dc-4199-b819-24cb4d1710ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:36.060665 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df9de5-a7dc-4199-b819-24cb4d1710ae None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:36.060943 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df9de5-a7dc-4199-b819-24cb4d1710ae None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:36.061215 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df9de5-a7dc-4199-b819-24cb4d1710ae None admin] PATH_INFO: `/v3/services/image` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:36.061795 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df9de5-a7dc-4199-b819-24cb4d1710ae None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:36.063172 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df9de5-a7dc-4199-b819-24cb4d1710ae None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:36.072441 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-95df9de5-a7dc-4199-b819-24cb4d1710ae None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 07:23:36.072441 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:36.072441 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:36.072441 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:36.072441 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:36.072441 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:36.072441 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:36.072441 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:36.072441 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 07:23:36.072441 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:36.072441 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:36.072441 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:36.072441 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:36.072441 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:36.072441 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:36.072441 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:36.072441 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:36.073442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:36.073442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:36.073442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:36.073442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:36.073442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:36.073442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:36.073442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:36.073442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:36.073442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:36.073442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:36.073442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:36.073442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:36.073442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:36.073442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:36.073442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:36.073442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:36.074988 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:36.074988 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:36.074988 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:36.074988 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:36.074988 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:36.074988 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:36.074988 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:36.074988 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:36.074988 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:36.074988 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:36.074988 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:36.074988 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:36.074988 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 07:23:36.074988 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:36.074988 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 357/710] 10.222.0.16 () {56 vars in 1105 bytes} [Wed Nov 2 07:23:35 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:36.082403 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a89cb7-b06d-42e6-a93b-0a0750a780af None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:36.190895 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a89cb7-b06d-42e6-a93b-0a0750a780af None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:36.226059 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485442cc-3518-433c-beae-91ed92707130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:36.226638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485442cc-3518-433c-beae-91ed92707130 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:36.226912 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485442cc-3518-433c-beae-91ed92707130 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:36.227181 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485442cc-3518-433c-beae-91ed92707130 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:36.227795 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485442cc-3518-433c-beae-91ed92707130 None admin] RBAC: Adding query filter params (name=image) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:36.228112 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485442cc-3518-433c-beae-91ed92707130 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:36.229471 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485442cc-3518-433c-beae-91ed92707130 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:36.234686 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 354/711] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:36.240270 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df9de5-a7dc-4199-b819-24cb4d1710ae None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:36.290985 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:36.350648 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df9de5-a7dc-4199-b819-24cb4d1710ae None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:36.390076 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4fad0-5b10-4deb-a1d4-f35e2732023e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:36.390728 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4fad0-5b10-4deb-a1d4-f35e2732023e None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:36.391006 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4fad0-5b10-4deb-a1d4-f35e2732023e None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:36.391274 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4fad0-5b10-4deb-a1d4-f35e2732023e None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:36.391938 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4fad0-5b10-4deb-a1d4-f35e2732023e None admin] RBAC: Adding query filter params (type=image) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:36.392265 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4fad0-5b10-4deb-a1d4-f35e2732023e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:36.393612 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4fad0-5b10-4deb-a1d4-f35e2732023e None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:36.398560 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 358/712] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:36 2022] GET /identity/v3/services?type=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:37.018721 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abaaed-c353-467b-a53d-81049c0a959e None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:37.019045 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abaaed-c353-467b-a53d-81049c0a959e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:37.019274 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abaaed-c353-467b-a53d-81049c0a959e None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:37.020957 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 355/713] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:37.026254 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf94ffa-0492-43e6-a404-09f5d240404c None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:37.026711 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf94ffa-0492-43e6-a404-09f5d240404c None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:37.026793 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf94ffa-0492-43e6-a404-09f5d240404c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:37.042156 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e4497-949a-4d65-a677-6a5b43259a05 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:37.042471 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e4497-949a-4d65-a677-6a5b43259a05 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:37.042701 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e4497-949a-4d65-a677-6a5b43259a05 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:37.044472 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 356/714] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:37.046339 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-7cf94ffa-0492-43e6-a404-09f5d240404c None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:37.047530 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-7cf94ffa-0492-43e6-a404-09f5d240404c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:37.049530 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2642b-e65d-4782-93ab-f7bac0c980f5 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:37.049813 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2642b-e65d-4782-93ab-f7bac0c980f5 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:37.050084 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2642b-e65d-4782-93ab-f7bac0c980f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:37.068674 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-b2e2642b-e65d-4782-93ab-f7bac0c980f5 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:37.069845 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b2e2642b-e65d-4782-93ab-f7bac0c980f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:37.079666 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:37.128476 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 359/715] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:37.143190 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 357/716] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:23:37.401095 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf94ffa-0492-43e6-a404-09f5d240404c None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:37.411036 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2642b-e65d-4782-93ab-f7bac0c980f5 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:37.444443 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:37.505362 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf94ffa-0492-43e6-a404-09f5d240404c None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:37.516739 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2642b-e65d-4782-93ab-f7bac0c980f5 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:37.544065 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed2f30-78d8-4434-b612-ee93bd283ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:37.545012 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed2f30-78d8-4434-b612-ee93bd283ca6 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:37.545299 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed2f30-78d8-4434-b612-ee93bd283ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:37.545586 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed2f30-78d8-4434-b612-ee93bd283ca6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:37.546171 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed2f30-78d8-4434-b612-ee93bd283ca6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:37.547568 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed2f30-78d8-4434-b612-ee93bd283ca6 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:37.557099 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-71ed2f30-78d8-4434-b612-ee93bd283ca6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 07:23:37.557099 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:37.557099 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:37.557099 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:37.557099 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:37.557099 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:37.557099 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:37.557099 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:37.557099 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 07:23:37.557099 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:37.557099 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:37.557099 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:37.557099 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:37.557099 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:37.557099 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:37.557099 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:37.557099 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:37.558219 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:37.558219 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:37.558219 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:37.558219 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:37.558219 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:37.558219 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:37.558219 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:37.558219 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:37.558219 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:37.558219 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:37.558219 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:37.558219 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:37.558219 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:37.558219 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:37.558219 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:37.558219 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:37.559665 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:37.559665 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:37.559665 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:37.559665 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:37.559665 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:37.559665 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:37.559665 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:37.559665 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:37.559665 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:37.559665 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:37.559665 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:37.559665 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:37.559665 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 07:23:37.559665 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:37.562128 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d995542-7f57-433c-857b-8f6d6e7093c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:37.563030 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d995542-7f57-433c-857b-8f6d6e7093c1 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:37.563495 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d995542-7f57-433c-857b-8f6d6e7093c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:37.563950 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 360/717] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Nov 2 07:23:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:37.564165 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d995542-7f57-433c-857b-8f6d6e7093c1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:37.564924 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d995542-7f57-433c-857b-8f6d6e7093c1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:37.565151 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed2f30-78d8-4434-b612-ee93bd283ca6 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:37.566753 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d995542-7f57-433c-857b-8f6d6e7093c1 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:37.576359 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-0d995542-7f57-433c-857b-8f6d6e7093c1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:23:37.576359 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:37.576359 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:37.576359 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:37.576359 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:37.576359 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:37.576359 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:37.576359 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:37.576359 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:23:37.576359 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:37.576359 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:37.576359 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:37.576359 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:37.576359 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:37.576359 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:37.576359 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:37.576359 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:37.577350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:37.577350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:37.577350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:37.577350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:37.577350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:37.577350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:37.577350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:37.577350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:37.577350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:37.577350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:37.577350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:37.577350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:37.577350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:37.577350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:37.577350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:37.577350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:37.578153 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:37.578153 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:37.578153 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:37.578153 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:37.578153 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:37.578153 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:37.578153 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:37.578153 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:37.578153 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:37.578153 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:37.578153 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:37.578153 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:37.578153 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:23:37.578153 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:37.585362 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 358/718] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Nov 2 07:23:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:23:37.586457 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d995542-7f57-433c-857b-8f6d6e7093c1 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:37.598760 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:37.671965 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed2f30-78d8-4434-b612-ee93bd283ca6 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:37.675168 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:37.695292 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d995542-7f57-433c-857b-8f6d6e7093c1 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:37.709697 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af55864-e963-4b3d-886a-4b9d02dfc510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:37.710308 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af55864-e963-4b3d-886a-4b9d02dfc510 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:37.710582 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af55864-e963-4b3d-886a-4b9d02dfc510 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:37.710849 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af55864-e963-4b3d-886a-4b9d02dfc510 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:37.711465 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af55864-e963-4b3d-886a-4b9d02dfc510 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:37.711763 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af55864-e963-4b3d-886a-4b9d02dfc510 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:37.713145 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af55864-e963-4b3d-886a-4b9d02dfc510 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:37.718363 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 361/719] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Nov 2 07:23:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:23:37.719743 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8752e3-869c-4591-ae3b-6a72279897d7 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:37.720694 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8752e3-869c-4591-ae3b-6a72279897d7 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:37.721196 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8752e3-869c-4591-ae3b-6a72279897d7 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:37.722845 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 362/720] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:37.728141 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8752e3-869c-4591-ae3b-6a72279897d7 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:37.735948 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10bea69-0bec-49b2-85eb-8176e42ebcde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:37.736606 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10bea69-0bec-49b2-85eb-8176e42ebcde None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:37.736880 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10bea69-0bec-49b2-85eb-8176e42ebcde None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:37.737414 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10bea69-0bec-49b2-85eb-8176e42ebcde None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:37.737755 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10bea69-0bec-49b2-85eb-8176e42ebcde None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:37.738047 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10bea69-0bec-49b2-85eb-8176e42ebcde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:37.739401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10bea69-0bec-49b2-85eb-8176e42ebcde None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:37.748100 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 359/721] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Nov 2 07:23:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:37.748100 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46039021-9193-4a69-9b8c-870f71d6d3c4 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:37.748100 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46039021-9193-4a69-9b8c-870f71d6d3c4 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:37.748100 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46039021-9193-4a69-9b8c-870f71d6d3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:37.765054 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-46039021-9193-4a69-9b8c-870f71d6d3c4 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:37.766218 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-46039021-9193-4a69-9b8c-870f71d6d3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:37.835204 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 360/722] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:37.842542 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8752e3-869c-4591-ae3b-6a72279897d7 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:37.848928 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46039021-9193-4a69-9b8c-870f71d6d3c4 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:37.851811 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:37.885598 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f35d38-21b2-415b-945c-c5d374a67d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:37.886781 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f35d38-21b2-415b-945c-c5d374a67d18 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:37.887637 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f35d38-21b2-415b-945c-c5d374a67d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:37.888351 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f35d38-21b2-415b-945c-c5d374a67d18 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:37.889146 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f35d38-21b2-415b-945c-c5d374a67d18 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:37.889620 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f35d38-21b2-415b-945c-c5d374a67d18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:37.892089 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f35d38-21b2-415b-945c-c5d374a67d18 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:37.897533 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 363/723] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Nov 2 07:23:37 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:37.975532 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46039021-9193-4a69-9b8c-870f71d6d3c4 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:38.016212 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ae7e9-4c7a-490e-868d-42ff30eb14d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:38.016836 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ae7e9-4c7a-490e-868d-42ff30eb14d5 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:38.017116 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ae7e9-4c7a-490e-868d-42ff30eb14d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:38.017425 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ae7e9-4c7a-490e-868d-42ff30eb14d5 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:38.018062 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ae7e9-4c7a-490e-868d-42ff30eb14d5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:38.018362 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ae7e9-4c7a-490e-868d-42ff30eb14d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:38.019743 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ae7e9-4c7a-490e-868d-42ff30eb14d5 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:38.025492 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 361/724] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Nov 2 07:23:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:38.031510 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f35d38-21b2-415b-945c-c5d374a67d18 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:38.067843 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:38.108728 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ae7e9-4c7a-490e-868d-42ff30eb14d5 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:38.148582 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f35d38-21b2-415b-945c-c5d374a67d18 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:38.191177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f640e2eb-b4ef-4dc3-82bf-8833d05c2c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:38.191932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640e2eb-b4ef-4dc3-82bf-8833d05c2c86 None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:38.192328 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640e2eb-b4ef-4dc3-82bf-8833d05c2c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:38.192749 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640e2eb-b4ef-4dc3-82bf-8833d05c2c86 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:38.193461 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f640e2eb-b4ef-4dc3-82bf-8833d05c2c86 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:38.194903 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f640e2eb-b4ef-4dc3-82bf-8833d05c2c86 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:38.204531 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:38.222836 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ae7e9-4c7a-490e-868d-42ff30eb14d5 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:38.258192 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf9a04-2d00-4ba1-ac2d-5d586dee8c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:38.258822 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf9a04-2d00-4ba1-ac2d-5d586dee8c7a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:38.259100 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf9a04-2d00-4ba1-ac2d-5d586dee8c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:38.259372 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf9a04-2d00-4ba1-ac2d-5d586dee8c7a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:38.260000 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbf9a04-2d00-4ba1-ac2d-5d586dee8c7a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:38.261397 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbf9a04-2d00-4ba1-ac2d-5d586dee8c7a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:38.270221 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-1fbf9a04-2d00-4ba1-ac2d-5d586dee8c7a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 07:23:38.270221 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:38.270221 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:38.270221 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:38.270221 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:38.270221 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:38.270221 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:38.270221 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:38.270221 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 07:23:38.270221 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:38.270221 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:38.270221 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:38.270221 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:38.270221 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:38.270221 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:38.270221 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:38.270221 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:38.271257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:38.271257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:38.271257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:38.271257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:38.271257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:38.271257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:38.271257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:38.271257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:38.271257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:38.271257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:38.271257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:38.271257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:38.271257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:38.271257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:38.271257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:38.271257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:38.272258 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:38.272258 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:38.272258 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:38.272258 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:38.272258 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:38.272258 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:38.272258 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:38.272258 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:38.272258 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:38.272258 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:38.272258 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:38.272258 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:38.272258 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 07:23:38.272258 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:38.272258 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 362/725] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Nov 2 07:23:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:38.277582 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf9a04-2d00-4ba1-ac2d-5d586dee8c7a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:38.279908 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 364/726] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:23:38 2022] POST /identity/v3/endpoints => generated 349 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:23:38.409561 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf9a04-2d00-4ba1-ac2d-5d586dee8c7a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:38.444524 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:38.455133 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d25761-f893-44c6-a4d8-1ddf1c1fe924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:38.455746 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d25761-f893-44c6-a4d8-1ddf1c1fe924 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:38.456072 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d25761-f893-44c6-a4d8-1ddf1c1fe924 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:38.466059 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d25761-f893-44c6-a4d8-1ddf1c1fe924 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:38.466059 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d25761-f893-44c6-a4d8-1ddf1c1fe924 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:38.466059 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d25761-f893-44c6-a4d8-1ddf1c1fe924 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:38.466059 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d25761-f893-44c6-a4d8-1ddf1c1fe924 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:38.466059 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 363/727] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Nov 2 07:23:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:23:38.470469 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f640e2eb-b4ef-4dc3-82bf-8833d05c2c86 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:38.581017 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:38.594046 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f640e2eb-b4ef-4dc3-82bf-8833d05c2c86 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:38.609869 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eff6b0-2158-4256-a4df-9614e4ce16b6 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:38.610163 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eff6b0-2158-4256-a4df-9614e4ce16b6 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:38.610429 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eff6b0-2158-4256-a4df-9614e4ce16b6 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:38.612006 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 364/728] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:23:38.617020 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3872bb-9f49-4fab-aa45-26a20f2893a2 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:38.617303 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3872bb-9f49-4fab-aa45-26a20f2893a2 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:38.617575 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3872bb-9f49-4fab-aa45-26a20f2893a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:38.631132 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ffde3-ab30-4c59-8710-426982bd7375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:38.632212 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ffde3-ab30-4c59-8710-426982bd7375 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:38.632212 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ffde3-ab30-4c59-8710-426982bd7375 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:38.632473 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ffde3-ab30-4c59-8710-426982bd7375 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:38.633049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ffde3-ab30-4c59-8710-426982bd7375 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:38.633351 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ffde3-ab30-4c59-8710-426982bd7375 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:38.634844 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ffde3-ab30-4c59-8710-426982bd7375 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:38.639943 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-ef3872bb-9f49-4fab-aa45-26a20f2893a2 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:38.641103 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 365/729] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Nov 2 07:23:38 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:38.641313 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ef3872bb-9f49-4fab-aa45-26a20f2893a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:38.647077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ffde3-ab30-4c59-8710-426982bd7375 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:38.732218 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 365/730] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:23:38.762896 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ffde3-ab30-4c59-8710-426982bd7375 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:38.800462 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a747b-f968-4a86-bec6-25dbd1ea87c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:38.801404 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a747b-f968-4a86-bec6-25dbd1ea87c3 None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:38.801883 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a747b-f968-4a86-bec6-25dbd1ea87c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:38.802323 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a747b-f968-4a86-bec6-25dbd1ea87c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:38.803148 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a747b-f968-4a86-bec6-25dbd1ea87c3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:38.804797 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a747b-f968-4a86-bec6-25dbd1ea87c3 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:38.922889 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 366/731] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:23:38 2022] POST /identity/v3/endpoints => generated 346 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:23:39.015401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3872bb-9f49-4fab-aa45-26a20f2893a2 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:39.133464 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3872bb-9f49-4fab-aa45-26a20f2893a2 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:39.156369 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:39.181307 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43358826-8e2f-4610-9cea-f009efd9d5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:39.182269 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43358826-8e2f-4610-9cea-f009efd9d5d4 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:39.182761 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43358826-8e2f-4610-9cea-f009efd9d5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:39.183233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43358826-8e2f-4610-9cea-f009efd9d5d4 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:39.184755 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43358826-8e2f-4610-9cea-f009efd9d5d4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:39.186316 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43358826-8e2f-4610-9cea-f009efd9d5d4 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:39.254125 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 366/732] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Nov 2 07:23:39 2022] POST /identity/v3/services => generated 242 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:23:40.221689 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63ed34-54cc-4425-b96d-2eb25e7a4139 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:40.222710 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63ed34-54cc-4425-b96d-2eb25e7a4139 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:40.223206 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63ed34-54cc-4425-b96d-2eb25e7a4139 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:40.225109 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 367/733] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:40.230756 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6458b6-e930-449a-8f72-03a500a47f09 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:40.231325 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6458b6-e930-449a-8f72-03a500a47f09 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:40.231794 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6458b6-e930-449a-8f72-03a500a47f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:40.255098 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-0a6458b6-e930-449a-8f72-03a500a47f09 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:40.256570 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0a6458b6-e930-449a-8f72-03a500a47f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:40.332064 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 367/734] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:40 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:40.540000 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139eb7f-fe64-445e-accc-f85fe4cc60f5 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:40.540353 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139eb7f-fe64-445e-accc-f85fe4cc60f5 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:40.540469 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139eb7f-fe64-445e-accc-f85fe4cc60f5 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:40.542008 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 368/735] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:40.547957 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a645ad-8886-4448-a9fe-1f2368187433 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:40.548275 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a645ad-8886-4448-a9fe-1f2368187433 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:40.548548 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a645ad-8886-4448-a9fe-1f2368187433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:40.567006 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-e8a645ad-8886-4448-a9fe-1f2368187433 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:40.568220 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e8a645ad-8886-4448-a9fe-1f2368187433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:40.607917 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139eb7f-fe64-445e-accc-f85fe4cc60f5 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:40.619666 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:40.643527 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 368/736] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:40 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:40.716226 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139eb7f-fe64-445e-accc-f85fe4cc60f5 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:40.751734 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7c6d6-cd54-4e27-a236-3673c0082c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:40.752370 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7c6d6-cd54-4e27-a236-3673c0082c3d None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:40.752642 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7c6d6-cd54-4e27-a236-3673c0082c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:40.752908 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7c6d6-cd54-4e27-a236-3673c0082c3d None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:40.753556 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f7c6d6-cd54-4e27-a236-3673c0082c3d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:40.754899 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f7c6d6-cd54-4e27-a236-3673c0082c3d None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:40.859941 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 369/737] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Nov 2 07:23:40 2022] POST /identity/v3/services => generated 242 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:23:40.911989 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a645ad-8886-4448-a9fe-1f2368187433 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:40.957603 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:41.037560 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a645ad-8886-4448-a9fe-1f2368187433 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:41.085087 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ee39a-dbf3-4dfd-84a2-b3356557f2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:41.085748 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ee39a-dbf3-4dfd-84a2-b3356557f2c3 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:41.086022 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ee39a-dbf3-4dfd-84a2-b3356557f2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:41.086321 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ee39a-dbf3-4dfd-84a2-b3356557f2c3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:41.086881 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88ee39a-dbf3-4dfd-84a2-b3356557f2c3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:41.088343 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88ee39a-dbf3-4dfd-84a2-b3356557f2c3 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:41.098799 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-f88ee39a-dbf3-4dfd-84a2-b3356557f2c3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:23:41.098799 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:41.098799 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:41.098799 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:41.098799 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:41.098799 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:41.098799 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:41.098799 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:41.098799 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:23:41.098799 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:41.098799 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:41.098799 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:41.098799 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:41.098799 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:41.098799 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:41.098799 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:41.098799 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:41.099850 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:41.099850 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:41.099850 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:41.099850 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:41.099850 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:41.099850 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:41.099850 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:41.099850 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:41.099850 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:41.099850 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:41.099850 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:41.099850 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:41.099850 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:41.099850 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:41.099850 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:41.099850 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:41.100729 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:41.100729 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:41.100729 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:41.100729 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:41.100729 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:41.100729 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:41.100729 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:41.100729 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:41.100729 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:41.100729 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:41.100729 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:41.100729 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:41.100729 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:23:41.100729 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:41.100729 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 369/738] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Nov 2 07:23:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:41.106694 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7c6d6-cd54-4e27-a236-3673c0082c3d None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:41.186953 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:41.195675 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32326051-afa9-4c2b-83a0-01f9f588a2aa None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:41.195936 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32326051-afa9-4c2b-83a0-01f9f588a2aa None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:41.196216 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32326051-afa9-4c2b-83a0-01f9f588a2aa None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:41.202276 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 370/739] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:23:41.203171 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7220b-0287-41ca-8767-8bc6b21cdb2d None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:41.203454 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7220b-0287-41ca-8767-8bc6b21cdb2d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:41.203725 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7220b-0287-41ca-8767-8bc6b21cdb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:41.226495 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-b0e7220b-0287-41ca-8767-8bc6b21cdb2d None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:41.228454 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b0e7220b-0287-41ca-8767-8bc6b21cdb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:41.232145 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7c6d6-cd54-4e27-a236-3673c0082c3d None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:41.270125 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca462b-21e3-4181-ba03-1d5323ef4b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:41.270733 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca462b-21e3-4181-ba03-1d5323ef4b77 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:41.271010 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca462b-21e3-4181-ba03-1d5323ef4b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:41.271281 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca462b-21e3-4181-ba03-1d5323ef4b77 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:41.271908 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca462b-21e3-4181-ba03-1d5323ef4b77 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:41.272254 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca462b-21e3-4181-ba03-1d5323ef4b77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:41.273671 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca462b-21e3-4181-ba03-1d5323ef4b77 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:41.280267 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 370/740] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Nov 2 07:23:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:41.285626 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca462b-21e3-4181-ba03-1d5323ef4b77 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:41.317862 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 371/741] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:41 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:23:41.390261 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca462b-21e3-4181-ba03-1d5323ef4b77 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:41.422265 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:41.428759 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79211f07-072a-4dc5-8ba2-2242df9dcbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:41.429254 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79211f07-072a-4dc5-8ba2-2242df9dcbb1 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:41.429985 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79211f07-072a-4dc5-8ba2-2242df9dcbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:41.430430 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79211f07-072a-4dc5-8ba2-2242df9dcbb1 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:41.431453 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79211f07-072a-4dc5-8ba2-2242df9dcbb1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:41.431957 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79211f07-072a-4dc5-8ba2-2242df9dcbb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:41.434115 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79211f07-072a-4dc5-8ba2-2242df9dcbb1 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:41.439433 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 371/742] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Nov 2 07:23:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:41.445395 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7220b-0287-41ca-8767-8bc6b21cdb2d None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:41.477081 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:41.495149 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734b4b2-a2e4-4cb5-9362-08b464c9b456 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:41.495450 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734b4b2-a2e4-4cb5-9362-08b464c9b456 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:41.495698 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734b4b2-a2e4-4cb5-9362-08b464c9b456 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:41.497657 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 372/743] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:41.503357 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560d3e5-f0e2-48d7-872c-129e2f75febe None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:41.504090 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560d3e5-f0e2-48d7-872c-129e2f75febe None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:41.504354 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560d3e5-f0e2-48d7-872c-129e2f75febe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:41.524526 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-9560d3e5-f0e2-48d7-872c-129e2f75febe None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:41.526439 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-9560d3e5-f0e2-48d7-872c-129e2f75febe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:41.573906 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7220b-0287-41ca-8767-8bc6b21cdb2d None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:41.610418 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 373/744] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:41 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:41.613074 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560d3e5-f0e2-48d7-872c-129e2f75febe None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:41.615745 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901cffb-d720-450f-a543-707e09c14741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:41.616400 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901cffb-d720-450f-a543-707e09c14741 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:41.616678 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901cffb-d720-450f-a543-707e09c14741 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:41.616951 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901cffb-d720-450f-a543-707e09c14741 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:41.617661 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901cffb-d720-450f-a543-707e09c14741 None admin] RBAC: Adding query filter params (interface=admin, service_id=17ff53cdac234df88f63f11c5bc0df4e, region_id=RegionOne) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:41.617971 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901cffb-d720-450f-a543-707e09c14741 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:41.619354 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901cffb-d720-450f-a543-707e09c14741 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:41.628539 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 372/745] 10.222.0.16 () {56 vars in 1249 bytes} [Wed Nov 2 07:23:41 2022] GET /identity/v3/endpoints?service_id=17ff53cdac234df88f63f11c5bc0df4e&interface=admin®ion_id=RegionOne => generated 193 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:41.637151 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901cffb-d720-450f-a543-707e09c14741 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:41.743279 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560d3e5-f0e2-48d7-872c-129e2f75febe None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:41.745088 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:41.761347 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901cffb-d720-450f-a543-707e09c14741 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:41.779280 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:41.790730 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905e8a3-8b6f-46ed-89d2-f0029c0b3f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:41.792079 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905e8a3-8b6f-46ed-89d2-f0029c0b3f99 None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:41.793345 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905e8a3-8b6f-46ed-89d2-f0029c0b3f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:41.793822 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905e8a3-8b6f-46ed-89d2-f0029c0b3f99 None admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:41.794690 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c905e8a3-8b6f-46ed-89d2-f0029c0b3f99 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:41.796414 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c905e8a3-8b6f-46ed-89d2-f0029c0b3f99 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:41.797395 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4662fb8-fc24-423f-90ee-937a1dd61dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:41.798011 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4662fb8-fc24-423f-90ee-937a1dd61dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:41.798290 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4662fb8-fc24-423f-90ee-937a1dd61dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:41.798562 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4662fb8-fc24-423f-90ee-937a1dd61dd1 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:41.804282 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4662fb8-fc24-423f-90ee-937a1dd61dd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:41.804410 dv-cinder-804757-31-smb devstack@keystone.service[81610]: WARNING keystone.server.flask.common [None req-c905e8a3-8b6f-46ed-89d2-f0029c0b3f99 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Nov 02 07:23:41.804501 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4662fb8-fc24-423f-90ee-937a1dd61dd1 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:41.808364 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 373/746] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Nov 2 07:23:41 2022] GET /identity/v3/services => generated 1957 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:23:41.858079 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.sql.core [None req-c905e8a3-8b6f-46ed-89d2-f0029c0b3f99 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Nov 02 07:23:41.858079 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 07:23:41.858079 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [parameters: {'id': '4a7835bfd4914aabba2c97f5c010e77a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Nov 02 07:23:41.858079 dv-cinder-804757-31-smb devstack@keystone.service[81610]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81610) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 07:23:41.866367 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-c905e8a3-8b6f-46ed-89d2-f0029c0b3f99 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4a7835bfd4914aabba2c97f5c010e77a.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4a7835bfd4914aabba2c97f5c010e77a. Nov 02 07:23:41.866367 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:41.866367 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 07:23:41.866367 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 07:23:41.866367 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 07:23:41.866367 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 07:23:41.866367 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 07:23:41.866367 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 07:23:41.866367 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 07:23:41.866367 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application conn.query(q) Nov 02 07:23:41.866367 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 07:23:41.866367 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 07:23:41.866367 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 07:23:41.872442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application result.read() Nov 02 07:23:41.872442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 07:23:41.872442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 07:23:41.872442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 07:23:41.872442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 07:23:41.872442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 07:23:41.872442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 07:23:41.872442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 07:23:41.872442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 07:23:41.872442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Nov 02 07:23:41.872442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:41.872442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Nov 02 07:23:41.872442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:41.872442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:41.872442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Nov 02 07:23:41.872442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return method(*args, **kwargs) Nov 02 07:23:41.872442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Nov 02 07:23:41.872442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return project_ref.to_dict() Nov 02 07:23:41.874195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 07:23:41.874195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application next(self.gen) Nov 02 07:23:41.874195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Nov 02 07:23:41.874195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application yield resource Nov 02 07:23:41.874195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 07:23:41.874195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application next(self.gen) Nov 02 07:23:41.874195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Nov 02 07:23:41.874195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self.session.rollback() Nov 02 07:23:41.874195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 07:23:41.874195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self.force_reraise() Nov 02 07:23:41.874195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 07:23:41.874195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise self.value Nov 02 07:23:41.874195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Nov 02 07:23:41.874195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Nov 02 07:23:41.874195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Nov 02 07:23:41.874195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application session.commit() Nov 02 07:23:41.874195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Nov 02 07:23:41.875298 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Nov 02 07:23:41.875298 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Nov 02 07:23:41.875298 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._prepare_impl() Nov 02 07:23:41.875298 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Nov 02 07:23:41.875298 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self.session.flush() Nov 02 07:23:41.875298 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 07:23:41.875298 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._flush(objects) Nov 02 07:23:41.875298 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 07:23:41.875298 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Nov 02 07:23:41.875298 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 07:23:41.875298 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application compat.raise_( Nov 02 07:23:41.875298 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 07:23:41.875298 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception Nov 02 07:23:41.875298 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 07:23:41.875298 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application flush_context.execute() Nov 02 07:23:41.875298 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 07:23:41.875298 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rec.execute(self) Nov 02 07:23:41.876428 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 07:23:41.876428 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Nov 02 07:23:41.876428 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 07:23:41.876428 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application _emit_insert_statements( Nov 02 07:23:41.876428 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Nov 02 07:23:41.876428 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application c = connection._execute_20( Nov 02 07:23:41.876428 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 07:23:41.876428 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 07:23:41.876428 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 07:23:41.876428 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Nov 02 07:23:41.876428 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 07:23:41.876428 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ret = self._execute_context( Nov 02 07:23:41.876428 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 07:23:41.876428 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Nov 02 07:23:41.876428 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 07:23:41.877401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 07:23:41.877401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 07:23:41.877401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception Nov 02 07:23:41.877401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 07:23:41.877401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 07:23:41.877401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 07:23:41.877401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 07:23:41.877401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 07:23:41.877401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 07:23:41.877401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 07:23:41.877401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application conn.query(q) Nov 02 07:23:41.877401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 07:23:41.877401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 07:23:41.877401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 07:23:41.877401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application result.read() Nov 02 07:23:41.877401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 07:23:41.877401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 07:23:41.885129 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 07:23:41.885129 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 07:23:41.885129 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 07:23:41.885129 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 07:23:41.885129 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 07:23:41.885129 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 07:23:41.885129 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Nov 02 07:23:41.885129 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 07:23:41.885129 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [parameters: {'id': '4a7835bfd4914aabba2c97f5c010e77a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Nov 02 07:23:41.885129 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 07:23:41.885129 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:41.885129 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:41.885129 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:41.885129 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:41.885129 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Nov 02 07:23:41.886098 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Nov 02 07:23:41.886098 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Nov 02 07:23:41.886098 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Nov 02 07:23:41.886098 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Nov 02 07:23:41.886098 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:41.886098 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:41.886098 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:41.886098 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:41.886098 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:41.886098 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:41.886098 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:41.886098 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:41.886098 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:41.886098 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:41.886098 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:41.886098 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:41.886098 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:41.887729 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:41.887729 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Nov 02 07:23:41.887729 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Nov 02 07:23:41.887729 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:41.887729 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:41.887729 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Nov 02 07:23:41.887729 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.Conflict( Nov 02 07:23:41.887729 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4a7835bfd4914aabba2c97f5c010e77a. Nov 02 07:23:41.887729 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:41.887729 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 374/747] 10.222.0.16 () {60 vars in 1140 bytes} [Wed Nov 2 07:23:41 2022] POST /identity/v3/projects => generated 262 bytes in 255 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:41.888494 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4662fb8-fc24-423f-90ee-937a1dd61dd1 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:41.906395 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905e8a3-8b6f-46ed-89d2-f0029c0b3f99 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:42.003632 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4662fb8-fc24-423f-90ee-937a1dd61dd1 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:42.044200 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905e8a3-8b6f-46ed-89d2-f0029c0b3f99 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:42.048857 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777467a-601a-4950-992b-e43f18c0966f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:42.049510 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777467a-601a-4950-992b-e43f18c0966f None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:42.049769 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777467a-601a-4950-992b-e43f18c0966f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:42.050036 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777467a-601a-4950-992b-e43f18c0966f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:42.059249 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c777467a-601a-4950-992b-e43f18c0966f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:42.061041 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c777467a-601a-4950-992b-e43f18c0966f None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:42.076801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-c777467a-601a-4950-992b-e43f18c0966f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:42.076801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:42.076801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:42.076801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:42.076801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:42.076801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:42.076801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:42.076801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:42.076801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:42.076801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:42.076801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:42.076801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:42.076801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:23:42.076801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:23:42.076801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:23:42.077877 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:23:42.077877 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:42.077877 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:42.077877 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:42.077877 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:42.077877 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:42.077877 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:42.077877 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:42.077877 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:42.077877 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:42.077877 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:42.077877 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:42.077877 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:42.077877 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:42.077877 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:42.077877 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:42.077877 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:42.079248 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:23:42.079248 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:23:42.079248 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:23:42.079248 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:23:42.079248 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:23:42.079248 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:23:42.079248 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:42.079248 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:42.079248 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 374/748] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Nov 2 07:23:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:42.083482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777467a-601a-4950-992b-e43f18c0966f None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:42.083679 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aba659-65be-4948-aadf-360147cd157a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:42.084386 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aba659-65be-4948-aadf-360147cd157a None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:42.084660 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aba659-65be-4948-aadf-360147cd157a None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:42.084931 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aba659-65be-4948-aadf-360147cd157a None admin] PATH_INFO: `/v3/services/image` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:42.085510 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aba659-65be-4948-aadf-360147cd157a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:42.088110 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aba659-65be-4948-aadf-360147cd157a None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:42.097047 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-08aba659-65be-4948-aadf-360147cd157a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 07:23:42.097047 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:42.097047 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:42.097047 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:42.097047 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:42.097047 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:42.097047 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:42.097047 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:42.097047 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 07:23:42.097047 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:42.097047 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:42.097047 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:42.097047 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:42.097047 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:42.097047 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:42.097047 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:42.097047 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:42.098028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:42.098028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:42.098028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:42.098028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:42.098028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:42.098028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:42.098028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:42.098028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:42.098028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:42.098028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:42.098028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:42.098028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:42.098028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:42.098028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:42.098028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:42.098028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:42.098870 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:42.098870 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:42.098870 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:42.098870 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:42.098870 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:42.098870 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:42.098870 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:42.098870 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:42.098870 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:42.098870 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:42.098870 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:42.098870 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:42.098870 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 07:23:42.098870 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:42.100764 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:42.100919 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 375/749] 10.222.0.16 () {56 vars in 1105 bytes} [Wed Nov 2 07:23:41 2022] GET /identity/v3/services/image => generated 86 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:23:42.104563 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aba659-65be-4948-aadf-360147cd157a None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:42.157976 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:42.223899 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777467a-601a-4950-992b-e43f18c0966f None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:42.227263 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aba659-65be-4948-aadf-360147cd157a None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:42.267396 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1343d-81f0-4745-89db-fc911c40c5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:42.267928 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1343d-81f0-4745-89db-fc911c40c5c8 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:42.268236 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1343d-81f0-4745-89db-fc911c40c5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:42.268511 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1343d-81f0-4745-89db-fc911c40c5c8 None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:42.269232 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c1343d-81f0-4745-89db-fc911c40c5c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:42.269537 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c1343d-81f0-4745-89db-fc911c40c5c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:42.270789 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2b7ed-6614-47a2-8dd4-8f3902723f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:42.271320 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c1343d-81f0-4745-89db-fc911c40c5c8 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:42.272188 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2b7ed-6614-47a2-8dd4-8f3902723f16 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:42.272955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2b7ed-6614-47a2-8dd4-8f3902723f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:42.273419 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2b7ed-6614-47a2-8dd4-8f3902723f16 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:42.274224 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2b7ed-6614-47a2-8dd4-8f3902723f16 None admin] RBAC: Adding query filter params (name=image) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:42.275280 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2b7ed-6614-47a2-8dd4-8f3902723f16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:42.276858 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2b7ed-6614-47a2-8dd4-8f3902723f16 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:42.291256 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 376/750] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:42.291719 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2b7ed-6614-47a2-8dd4-8f3902723f16 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:42.295884 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 375/751] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Nov 2 07:23:42 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:23:42.413836 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2b7ed-6614-47a2-8dd4-8f3902723f16 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:42.426272 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:42.454008 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827ab4e-81b5-4e81-9ace-0aa0a59642e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:42.454922 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827ab4e-81b5-4e81-9ace-0aa0a59642e1 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:42.455338 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827ab4e-81b5-4e81-9ace-0aa0a59642e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:42.461630 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827ab4e-81b5-4e81-9ace-0aa0a59642e1 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:42.461630 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827ab4e-81b5-4e81-9ace-0aa0a59642e1 None admin] RBAC: Adding query filter params (type=image) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:42.461630 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827ab4e-81b5-4e81-9ace-0aa0a59642e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:42.461630 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827ab4e-81b5-4e81-9ace-0aa0a59642e1 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:42.463887 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 377/752] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:42 2022] GET /identity/v3/services?type=image => generated 350 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:42.470838 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1343d-81f0-4745-89db-fc911c40c5c8 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:42.545202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:42.694135 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1343d-81f0-4745-89db-fc911c40c5c8 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:42.729599 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fee4a6-76d0-4592-947e-eee2491f0441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:42.730206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fee4a6-76d0-4592-947e-eee2491f0441 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:42.731024 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fee4a6-76d0-4592-947e-eee2491f0441 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:42.731290 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fee4a6-76d0-4592-947e-eee2491f0441 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:42.731984 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fee4a6-76d0-4592-947e-eee2491f0441 None admin] RBAC: Adding query filter params (interface=public, service_id=43de5029d29843abba4130c39031870a, region_id=RegionOne) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:42.732312 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fee4a6-76d0-4592-947e-eee2491f0441 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:42.733677 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fee4a6-76d0-4592-947e-eee2491f0441 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:42.739339 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 376/753] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Nov 2 07:23:42 2022] GET /identity/v3/endpoints?service_id=43de5029d29843abba4130c39031870a&interface=public®ion_id=RegionOne => generated 194 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:42.744995 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827ab4e-81b5-4e81-9ace-0aa0a59642e1 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:42.850027 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827ab4e-81b5-4e81-9ace-0aa0a59642e1 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:42.884268 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af8a72-8948-43a3-ba44-55c9ecfbeaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:42.884869 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af8a72-8948-43a3-ba44-55c9ecfbeaf6 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:42.885144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af8a72-8948-43a3-ba44-55c9ecfbeaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:42.885414 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af8a72-8948-43a3-ba44-55c9ecfbeaf6 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:42.886007 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af8a72-8948-43a3-ba44-55c9ecfbeaf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:42.887377 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af8a72-8948-43a3-ba44-55c9ecfbeaf6 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:42.894600 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 378/754] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Nov 2 07:23:42 2022] GET /identity/v3/services => generated 1957 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:23:43.186040 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00219c60-875e-4493-bfbd-2af09de576c9 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:43.186218 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00219c60-875e-4493-bfbd-2af09de576c9 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:43.186503 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00219c60-875e-4493-bfbd-2af09de576c9 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:43.188107 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 377/755] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:43.193434 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d1e75-b6d8-468f-97ee-cb334a4b565f None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:43.193721 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d1e75-b6d8-468f-97ee-cb334a4b565f None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:43.193998 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d1e75-b6d8-468f-97ee-cb334a4b565f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:43.212802 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-ad7d1e75-b6d8-468f-97ee-cb334a4b565f None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:43.214322 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-ad7d1e75-b6d8-468f-97ee-cb334a4b565f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:43.245694 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:43.284100 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 379/756] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:43 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:43.558640 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00219c60-875e-4493-bfbd-2af09de576c9 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:43.669889 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00219c60-875e-4493-bfbd-2af09de576c9 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:43.709446 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0bb753-b5b6-4bd9-8159-20cc5efc6074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:43.710439 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bb753-b5b6-4bd9-8159-20cc5efc6074 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:43.710947 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bb753-b5b6-4bd9-8159-20cc5efc6074 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:43.711413 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bb753-b5b6-4bd9-8159-20cc5efc6074 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:43.712210 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0bb753-b5b6-4bd9-8159-20cc5efc6074 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:43.713771 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0bb753-b5b6-4bd9-8159-20cc5efc6074 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:43.716370 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:43.724704 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-6e0bb753-b5b6-4bd9-8159-20cc5efc6074 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 07:23:43.724704 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:43.724704 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:43.724704 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:43.724704 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:43.724704 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:43.724704 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:43.724704 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:43.724704 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 07:23:43.724704 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:43.724704 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:43.724704 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:43.724704 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:43.724704 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:43.724704 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:43.724704 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:43.724704 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:43.725709 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:43.725709 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:43.725709 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:43.725709 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:43.725709 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:43.725709 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:43.725709 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:43.725709 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:43.725709 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:43.725709 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:43.725709 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:43.725709 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:43.725709 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:43.725709 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:43.725709 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:43.725709 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:43.726540 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:43.726540 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:43.726540 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:43.726540 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:43.726540 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:43.726540 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:43.726540 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:43.726540 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:43.726540 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:43.726540 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:43.726540 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:43.726540 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:43.726540 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 07:23:43.726540 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:43.729229 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 378/757] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Nov 2 07:23:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:43.743562 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d1e75-b6d8-468f-97ee-cb334a4b565f None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:43.839511 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d1e75-b6d8-468f-97ee-cb334a4b565f None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:43.875268 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc733689-7c7d-421e-a067-250bb52465ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:43.875870 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc733689-7c7d-421e-a067-250bb52465ca None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:43.876171 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc733689-7c7d-421e-a067-250bb52465ca None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:43.876488 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc733689-7c7d-421e-a067-250bb52465ca None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:43.877101 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc733689-7c7d-421e-a067-250bb52465ca None admin] RBAC: Adding query filter params (name=compute) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:43.877397 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc733689-7c7d-421e-a067-250bb52465ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:43.878846 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc733689-7c7d-421e-a067-250bb52465ca None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:43.884237 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 380/758] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Nov 2 07:23:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:43.889860 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0bb753-b5b6-4bd9-8159-20cc5efc6074 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:43.997794 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0bb753-b5b6-4bd9-8159-20cc5efc6074 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:44.041256 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0aff64-f2b4-424d-874e-7f665d1bea1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:44.041879 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0aff64-f2b4-424d-874e-7f665d1bea1e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:44.042145 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0aff64-f2b4-424d-874e-7f665d1bea1e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:44.042412 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0aff64-f2b4-424d-874e-7f665d1bea1e None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:44.043594 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0aff64-f2b4-424d-874e-7f665d1bea1e None admin] RBAC: Adding query filter params (type=compute) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:44.043885 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0aff64-f2b4-424d-874e-7f665d1bea1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:44.045440 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0aff64-f2b4-424d-874e-7f665d1bea1e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:44.051633 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 379/759] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Nov 2 07:23:43 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:44.061171 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc733689-7c7d-421e-a067-250bb52465ca None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:44.093378 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:44.152656 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd5ac7-1bec-4033-a065-5024ef93b842 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:44.152980 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd5ac7-1bec-4033-a065-5024ef93b842 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:44.153206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd5ac7-1bec-4033-a065-5024ef93b842 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:44.154785 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 380/760] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:44.160350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6c89b-807c-442a-8d47-a8e0212ae3fe None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:44.160906 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6c89b-807c-442a-8d47-a8e0212ae3fe None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:44.161359 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6c89b-807c-442a-8d47-a8e0212ae3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:44.167155 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc733689-7c7d-421e-a067-250bb52465ca None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:44.181202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-30c6c89b-807c-442a-8d47-a8e0212ae3fe None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:44.184663 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-30c6c89b-807c-442a-8d47-a8e0212ae3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:44.207428 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47245a2-8137-4c86-9ea4-246bfaafcf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:44.208133 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47245a2-8137-4c86-9ea4-246bfaafcf16 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:44.208416 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47245a2-8137-4c86-9ea4-246bfaafcf16 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:44.208690 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47245a2-8137-4c86-9ea4-246bfaafcf16 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:44.209390 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47245a2-8137-4c86-9ea4-246bfaafcf16 None admin] RBAC: Adding query filter params (interface=public, service_id=a5b1bc0bab5b459d967e5f0f467922cf, region_id=RegionOne) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:44.209696 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47245a2-8137-4c86-9ea4-246bfaafcf16 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:44.211067 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47245a2-8137-4c86-9ea4-246bfaafcf16 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:44.217537 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 381/761] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Nov 2 07:23:44 2022] GET /identity/v3/endpoints?service_id=a5b1bc0bab5b459d967e5f0f467922cf&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:44.223448 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47245a2-8137-4c86-9ea4-246bfaafcf16 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:44.265450 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:44.280114 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 381/762] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:44 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Nov 02 07:23:44.338504 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:44.346555 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47245a2-8137-4c86-9ea4-246bfaafcf16 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:44.383897 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5cb03-a49e-45a3-ab3a-8186195819cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:44.384838 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5cb03-a49e-45a3-ab3a-8186195819cf None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:44.385298 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5cb03-a49e-45a3-ab3a-8186195819cf None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:44.385761 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5cb03-a49e-45a3-ab3a-8186195819cf None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:44.386539 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5cb03-a49e-45a3-ab3a-8186195819cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:44.389277 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5cb03-a49e-45a3-ab3a-8186195819cf None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:44.396699 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 382/763] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Nov 2 07:23:44 2022] GET /identity/v3/services => generated 1957 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:23:44.557825 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6c89b-807c-442a-8d47-a8e0212ae3fe None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:44.675789 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6c89b-807c-442a-8d47-a8e0212ae3fe None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:44.694974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc058ee-3cd7-489a-aaef-ec7fed860c0d None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:44.695318 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc058ee-3cd7-489a-aaef-ec7fed860c0d None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:44.695545 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc058ee-3cd7-489a-aaef-ec7fed860c0d None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:44.697092 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 383/764] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:44.704259 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f7461-f100-4afc-8c0c-ed5270751522 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:44.704547 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f7461-f100-4afc-8c0c-ed5270751522 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:44.704822 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f7461-f100-4afc-8c0c-ed5270751522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:44.712655 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ea04c-0521-4fe6-b761-9a94f78749ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:44.713569 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ea04c-0521-4fe6-b761-9a94f78749ad None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:44.714019 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ea04c-0521-4fe6-b761-9a94f78749ad None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:44.714459 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ea04c-0521-4fe6-b761-9a94f78749ad None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:44.715243 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ea04c-0521-4fe6-b761-9a94f78749ad None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:44.716819 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ea04c-0521-4fe6-b761-9a94f78749ad None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:44.723844 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-da7f7461-f100-4afc-8c0c-ed5270751522 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:44.725089 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-da7f7461-f100-4afc-8c0c-ed5270751522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:44.726462 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-009ea04c-0521-4fe6-b761-9a94f78749ad None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:23:44.726462 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:44.726462 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:44.726462 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:44.726462 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:44.726462 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:44.726462 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:44.726462 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:44.726462 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:23:44.726462 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:44.726462 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:44.726462 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:44.726462 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:44.726462 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:44.726462 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:44.726462 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:44.726462 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:44.727485 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:44.727485 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:44.727485 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:44.727485 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:44.727485 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:44.727485 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:44.727485 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:44.727485 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:44.727485 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:44.727485 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:44.727485 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:44.727485 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:44.727485 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:44.727485 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:44.727485 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:44.727485 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:44.728350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:44.728350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:44.728350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:44.728350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:44.728350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:44.728350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:44.728350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:44.728350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:44.728350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:44.728350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:44.728350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:44.728350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:44.728350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:23:44.728350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:44.736134 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 382/765] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Nov 2 07:23:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:44.737580 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ea04c-0521-4fe6-b761-9a94f78749ad None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:44.801884 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 384/766] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:44 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:23:44.812596 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:44.857447 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ea04c-0521-4fe6-b761-9a94f78749ad None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:44.892706 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251ba5f-33e1-4f11-9c4c-96b72568e13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:44.893304 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251ba5f-33e1-4f11-9c4c-96b72568e13e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:44.893579 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251ba5f-33e1-4f11-9c4c-96b72568e13e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:44.893845 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251ba5f-33e1-4f11-9c4c-96b72568e13e None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:44.894456 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251ba5f-33e1-4f11-9c4c-96b72568e13e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:44.894753 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251ba5f-33e1-4f11-9c4c-96b72568e13e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:44.896143 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251ba5f-33e1-4f11-9c4c-96b72568e13e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:44.901435 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 383/767] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Nov 2 07:23:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:23:44.907861 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f7461-f100-4afc-8c0c-ed5270751522 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:45.010848 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:45.021457 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f7461-f100-4afc-8c0c-ed5270751522 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:45.061249 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de92102-7926-4b10-9a77-d4a46fef3ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:45.061876 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de92102-7926-4b10-9a77-d4a46fef3ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:45.062408 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de92102-7926-4b10-9a77-d4a46fef3ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:45.063235 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de92102-7926-4b10-9a77-d4a46fef3ef8 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:45.063864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de92102-7926-4b10-9a77-d4a46fef3ef8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:45.064189 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de92102-7926-4b10-9a77-d4a46fef3ef8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:45.065572 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de92102-7926-4b10-9a77-d4a46fef3ef8 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:45.071284 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 385/768] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Nov 2 07:23:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:45.078936 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251ba5f-33e1-4f11-9c4c-96b72568e13e None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:45.092625 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de92102-7926-4b10-9a77-d4a46fef3ef8 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:45.194429 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251ba5f-33e1-4f11-9c4c-96b72568e13e None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:45.215982 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:45.219430 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de92102-7926-4b10-9a77-d4a46fef3ef8 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:45.230102 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb1031-3411-4725-b1ff-d979e6c91ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:45.230908 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb1031-3411-4725-b1ff-d979e6c91ec3 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:45.231193 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb1031-3411-4725-b1ff-d979e6c91ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:45.231459 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb1031-3411-4725-b1ff-d979e6c91ec3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:45.232159 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb1031-3411-4725-b1ff-d979e6c91ec3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:45.233544 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb1031-3411-4725-b1ff-d979e6c91ec3 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:45.256340 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd21fe0-11ce-4379-82d4-033f6a534e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:45.256943 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd21fe0-11ce-4379-82d4-033f6a534e66 None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:45.257221 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd21fe0-11ce-4379-82d4-033f6a534e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:45.257490 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd21fe0-11ce-4379-82d4-033f6a534e66 None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:45.258134 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd21fe0-11ce-4379-82d4-033f6a534e66 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:45.259549 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd21fe0-11ce-4379-82d4-033f6a534e66 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:45.286272 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 384/769] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:23:45 2022] POST /identity/v3/endpoints => generated 325 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:23:45.286272 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093a2f8-491b-45e1-8667-c65b8adba049 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:45.286272 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093a2f8-491b-45e1-8667-c65b8adba049 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:45.286272 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093a2f8-491b-45e1-8667-c65b8adba049 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:45.286272 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 385/770] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:45.294968 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc8e68-4dc8-4ab4-ae8d-eef86d0f9ff4 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:45.295248 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc8e68-4dc8-4ab4-ae8d-eef86d0f9ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:45.295519 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc8e68-4dc8-4ab4-ae8d-eef86d0f9ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:45.303994 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.sql.core [None req-acd21fe0-11ce-4379-82d4-033f6a534e66 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Nov 02 07:23:45.303994 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Nov 02 07:23:45.303994 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [parameters: {'user_id': '03d8c9baa8ef4becb67941373cc65556', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Nov 02 07:23:45.303994 dv-cinder-804757-31-smb devstack@keystone.service[81610]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81610) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 07:23:45.311831 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-acd21fe0-11ce-4379-82d4-033f6a534e66 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Nov 02 07:23:45.311831 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:45.311831 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 07:23:45.311831 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 07:23:45.311831 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 07:23:45.311831 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 07:23:45.311831 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 07:23:45.311831 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 07:23:45.311831 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 07:23:45.311831 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application conn.query(q) Nov 02 07:23:45.311831 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 07:23:45.311831 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 07:23:45.311831 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 07:23:45.311831 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application result.read() Nov 02 07:23:45.311831 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 07:23:45.316126 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 07:23:45.316126 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 07:23:45.316126 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 07:23:45.316126 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 07:23:45.316126 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 07:23:45.316126 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 07:23:45.316126 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 07:23:45.316126 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Nov 02 07:23:45.316126 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:45.316126 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Nov 02 07:23:45.316126 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:45.316126 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:45.316126 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Nov 02 07:23:45.316126 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return method(*args, **kwargs) Nov 02 07:23:45.316126 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Nov 02 07:23:45.316126 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Nov 02 07:23:45.316126 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 07:23:45.316126 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application next(self.gen) Nov 02 07:23:45.317265 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Nov 02 07:23:45.317265 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application yield resource Nov 02 07:23:45.317265 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 07:23:45.317265 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application next(self.gen) Nov 02 07:23:45.317265 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Nov 02 07:23:45.317265 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self.session.rollback() Nov 02 07:23:45.317265 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 07:23:45.317265 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self.force_reraise() Nov 02 07:23:45.317265 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 07:23:45.317265 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise self.value Nov 02 07:23:45.317265 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Nov 02 07:23:45.317265 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Nov 02 07:23:45.317265 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Nov 02 07:23:45.317265 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application session.commit() Nov 02 07:23:45.317265 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Nov 02 07:23:45.317265 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Nov 02 07:23:45.317265 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Nov 02 07:23:45.318955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._prepare_impl() Nov 02 07:23:45.318955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Nov 02 07:23:45.318955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self.session.flush() Nov 02 07:23:45.318955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 07:23:45.318955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._flush(objects) Nov 02 07:23:45.318955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 07:23:45.318955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Nov 02 07:23:45.318955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 07:23:45.318955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application compat.raise_( Nov 02 07:23:45.318955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 07:23:45.318955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception Nov 02 07:23:45.318955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 07:23:45.318955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application flush_context.execute() Nov 02 07:23:45.318955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 07:23:45.318955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rec.execute(self) Nov 02 07:23:45.318955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 07:23:45.318955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Nov 02 07:23:45.320262 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 07:23:45.320262 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application _emit_insert_statements( Nov 02 07:23:45.320262 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Nov 02 07:23:45.320262 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application result = connection._execute_20( Nov 02 07:23:45.320262 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 07:23:45.320262 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 07:23:45.320262 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 07:23:45.320262 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Nov 02 07:23:45.320262 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 07:23:45.320262 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ret = self._execute_context( Nov 02 07:23:45.320262 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 07:23:45.320262 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Nov 02 07:23:45.320262 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 07:23:45.320262 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 07:23:45.320262 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 07:23:45.320262 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception Nov 02 07:23:45.321275 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 07:23:45.321275 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 07:23:45.321275 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 07:23:45.321275 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 07:23:45.321275 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 07:23:45.321275 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 07:23:45.321275 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 07:23:45.321275 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application conn.query(q) Nov 02 07:23:45.321275 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 07:23:45.321275 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 07:23:45.321275 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 07:23:45.321275 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application result.read() Nov 02 07:23:45.321275 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 07:23:45.321275 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 07:23:45.321275 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 07:23:45.321275 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 07:23:45.323457 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 07:23:45.323457 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 07:23:45.323457 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 07:23:45.323457 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 07:23:45.323457 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Nov 02 07:23:45.323457 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Nov 02 07:23:45.323457 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [parameters: {'user_id': '03d8c9baa8ef4becb67941373cc65556', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Nov 02 07:23:45.323457 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 07:23:45.323457 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:45.323457 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:45.323457 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:45.323457 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:45.323457 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:45.323457 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:45.323457 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:45.333442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:45.333442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:45.333442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:45.333442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:45.333442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:45.333442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:45.333442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:45.333442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Nov 02 07:23:45.333442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Nov 02 07:23:45.333442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:45.333442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:45.333442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:23:45.333442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:45.333442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:23:45.333442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:45.333442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Nov 02 07:23:45.333442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Nov 02 07:23:45.334510 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Nov 02 07:23:45.334510 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Nov 02 07:23:45.334510 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Nov 02 07:23:45.334510 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Nov 02 07:23:45.334510 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Nov 02 07:23:45.334510 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:45.334510 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 386/771] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Nov 2 07:23:45 2022] POST /identity/v3/users => generated 160 bytes in 221 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:23:45.334510 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd21fe0-11ce-4379-82d4-033f6a534e66 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:45.337198 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-7bfc8e68-4dc8-4ab4-ae8d-eef86d0f9ff4 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:45.338890 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7bfc8e68-4dc8-4ab4-ae8d-eef86d0f9ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:45.344410 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:45.444411 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd21fe0-11ce-4379-82d4-033f6a534e66 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:45.460471 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 386/772] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:45 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:23:45.489353 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49277ad6-7947-4c05-bd1a-a07f75cc1796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:45.489913 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49277ad6-7947-4c05-bd1a-a07f75cc1796 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:45.490286 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49277ad6-7947-4c05-bd1a-a07f75cc1796 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:45.490565 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49277ad6-7947-4c05-bd1a-a07f75cc1796 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:45.498936 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49277ad6-7947-4c05-bd1a-a07f75cc1796 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:45.500606 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49277ad6-7947-4c05-bd1a-a07f75cc1796 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:45.513726 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-49277ad6-7947-4c05-bd1a-a07f75cc1796 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 07:23:45.513726 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:45.513726 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:45.513726 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:45.513726 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:45.513726 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:45.513726 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:45.513726 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:45.513726 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:45.513726 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:45.513726 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:45.513726 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:45.513726 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:23:45.513726 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:23:45.513726 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:23:45.513726 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:23:45.514650 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:45.514650 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:45.514650 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:23:45.514650 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:45.514650 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:23:45.514650 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:45.514650 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:45.514650 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:45.514650 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:45.514650 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:45.514650 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:45.514650 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:45.514650 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:45.514650 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:45.514650 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:45.514650 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:45.514650 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:45.514650 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:45.515962 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:45.515962 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:45.515962 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:23:45.515962 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:23:45.515962 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:23:45.515962 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:23:45.515962 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:23:45.515962 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:23:45.515962 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 07:23:45.515962 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:45.515962 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 387/773] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Nov 2 07:23:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:23:45.520507 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc8e68-4dc8-4ab4-ae8d-eef86d0f9ff4 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:45.626149 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc8e68-4dc8-4ab4-ae8d-eef86d0f9ff4 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:45.634430 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:45.661844 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680f3fe-f629-430a-a41a-c83436f70dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:45.662458 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680f3fe-f629-430a-a41a-c83436f70dbb None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:45.664151 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680f3fe-f629-430a-a41a-c83436f70dbb None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:45.664151 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680f3fe-f629-430a-a41a-c83436f70dbb None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:45.664151 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3680f3fe-f629-430a-a41a-c83436f70dbb None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:45.664151 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3680f3fe-f629-430a-a41a-c83436f70dbb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:45.665456 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3680f3fe-f629-430a-a41a-c83436f70dbb None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:45.702675 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 387/774] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Nov 2 07:23:45 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:45.737506 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49277ad6-7947-4c05-bd1a-a07f75cc1796 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:45.826740 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:45.853782 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49277ad6-7947-4c05-bd1a-a07f75cc1796 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:45.893171 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0a88a-b1d6-4836-9e5e-a6aae7a0ed8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:45.893800 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0a88a-b1d6-4836-9e5e-a6aae7a0ed8e None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:45.894075 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0a88a-b1d6-4836-9e5e-a6aae7a0ed8e None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:45.894344 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0a88a-b1d6-4836-9e5e-a6aae7a0ed8e None admin] PATH_INFO: `/v3/services/image` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:45.894917 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0a88a-b1d6-4836-9e5e-a6aae7a0ed8e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:45.896352 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0a88a-b1d6-4836-9e5e-a6aae7a0ed8e None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:45.905447 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-fcd0a88a-b1d6-4836-9e5e-a6aae7a0ed8e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 07:23:45.905447 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:45.905447 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:45.905447 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:45.905447 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:45.905447 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:45.905447 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:45.905447 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:45.905447 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 07:23:45.905447 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:45.905447 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:45.905447 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:45.905447 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:45.905447 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:45.905447 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:45.905447 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:45.905447 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:45.906420 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:45.906420 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:45.906420 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:45.906420 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:45.906420 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:45.906420 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:45.906420 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:45.906420 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:45.906420 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:45.906420 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:45.906420 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:45.906420 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:45.906420 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:45.906420 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:45.906420 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:45.906420 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:45.907244 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:45.907244 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:45.907244 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:45.907244 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:45.907244 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:45.907244 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:45.907244 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:45.907244 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:45.907244 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:45.907244 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:45.907244 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:45.907244 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:45.907244 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 07:23:45.907244 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:45.911470 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 388/775] 10.222.0.16 () {56 vars in 1105 bytes} [Wed Nov 2 07:23:45 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:45.912851 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680f3fe-f629-430a-a41a-c83436f70dbb None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:46.031759 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680f3fe-f629-430a-a41a-c83436f70dbb None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:46.067101 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7652e7-a09e-45ec-8c89-aeb3da8b9c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:46.067708 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7652e7-a09e-45ec-8c89-aeb3da8b9c5d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:46.067979 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7652e7-a09e-45ec-8c89-aeb3da8b9c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:46.068282 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7652e7-a09e-45ec-8c89-aeb3da8b9c5d None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:46.068900 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7652e7-a09e-45ec-8c89-aeb3da8b9c5d None admin] RBAC: Adding query filter params (name=image) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:46.069194 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7652e7-a09e-45ec-8c89-aeb3da8b9c5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:46.070549 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7652e7-a09e-45ec-8c89-aeb3da8b9c5d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:46.080240 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 388/776] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:46.081958 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0a88a-b1d6-4836-9e5e-a6aae7a0ed8e None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:46.182655 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0a88a-b1d6-4836-9e5e-a6aae7a0ed8e None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:46.216630 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1247c-4a1e-4e36-a02d-80a9a62f15ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:46.217224 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1247c-4a1e-4e36-a02d-80a9a62f15ef None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:46.217496 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1247c-4a1e-4e36-a02d-80a9a62f15ef None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:46.217762 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1247c-4a1e-4e36-a02d-80a9a62f15ef None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:46.218377 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1247c-4a1e-4e36-a02d-80a9a62f15ef None admin] RBAC: Adding query filter params (type=image) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:46.218676 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1247c-4a1e-4e36-a02d-80a9a62f15ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:46.220017 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1247c-4a1e-4e36-a02d-80a9a62f15ef None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:46.227929 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 389/777] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:46 2022] GET /identity/v3/services?type=image => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:46.233384 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7652e7-a09e-45ec-8c89-aeb3da8b9c5d None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:46.262523 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:46.335991 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7652e7-a09e-45ec-8c89-aeb3da8b9c5d None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:46.369156 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9bfd3-f0ce-416d-87cc-86a00d9b7f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:46.369749 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9bfd3-f0ce-416d-87cc-86a00d9b7f55 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:46.370125 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9bfd3-f0ce-416d-87cc-86a00d9b7f55 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:46.370481 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9bfd3-f0ce-416d-87cc-86a00d9b7f55 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:46.371803 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb9bfd3-f0ce-416d-87cc-86a00d9b7f55 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:46.373186 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb9bfd3-f0ce-416d-87cc-86a00d9b7f55 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:46.499227 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 389/778] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:23:46 2022] POST /identity/v3/endpoints => generated 327 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:23:46.684358 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079c759-4487-4048-9a07-a6d8f9ff9e30 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:46.684853 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079c759-4487-4048-9a07-a6d8f9ff9e30 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:46.684853 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079c759-4487-4048-9a07-a6d8f9ff9e30 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:46.686298 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 390/779] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:46.691429 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa800b-03cd-4750-9ca5-65700da50a34 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:46.691720 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa800b-03cd-4750-9ca5-65700da50a34 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:46.692000 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa800b-03cd-4750-9ca5-65700da50a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:46.710833 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-32aa800b-03cd-4750-9ca5-65700da50a34 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:46.712010 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-32aa800b-03cd-4750-9ca5-65700da50a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:46.788018 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 390/780] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:46 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:47.057432 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079c759-4487-4048-9a07-a6d8f9ff9e30 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:47.061634 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:47.162671 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079c759-4487-4048-9a07-a6d8f9ff9e30 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:47.196664 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472de84c-32b9-473d-97bf-13cd748ce7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:47.197312 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472de84c-32b9-473d-97bf-13cd748ce7f3 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:47.197659 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472de84c-32b9-473d-97bf-13cd748ce7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:47.197998 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472de84c-32b9-473d-97bf-13cd748ce7f3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:47.198640 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472de84c-32b9-473d-97bf-13cd748ce7f3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:47.200653 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472de84c-32b9-473d-97bf-13cd748ce7f3 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:47.209452 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-472de84c-32b9-473d-97bf-13cd748ce7f3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 07:23:47.209452 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:47.209452 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:47.209452 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:47.209452 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:47.209452 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:47.209452 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:47.209452 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:47.209452 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 07:23:47.209452 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:47.209452 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:47.209452 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:47.209452 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:47.209452 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:47.209452 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:47.209452 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:47.209452 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:47.210599 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:47.210599 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:47.210599 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:47.210599 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:47.210599 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:47.210599 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:47.210599 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:47.210599 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:47.210599 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:47.210599 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:47.210599 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:47.210599 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:47.210599 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:47.210599 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:47.210599 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:47.210599 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:47.211617 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:47.211617 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:47.211617 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:47.211617 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:47.211617 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:47.211617 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:47.211617 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:47.211617 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:47.211617 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:47.211617 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:47.211617 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:47.211617 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:47.211617 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 07:23:47.211617 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:47.216418 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 391/781] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Nov 2 07:23:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:47.221501 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa800b-03cd-4750-9ca5-65700da50a34 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:47.241641 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:47.390500 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa800b-03cd-4750-9ca5-65700da50a34 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:47.453295 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f244526-c2a6-4f67-9391-aa920a01a2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:47.454208 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f244526-c2a6-4f67-9391-aa920a01a2b7 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:47.454676 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f244526-c2a6-4f67-9391-aa920a01a2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:47.455139 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f244526-c2a6-4f67-9391-aa920a01a2b7 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:47.456236 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f244526-c2a6-4f67-9391-aa920a01a2b7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:47.456755 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f244526-c2a6-4f67-9391-aa920a01a2b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:47.459204 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f244526-c2a6-4f67-9391-aa920a01a2b7 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:47.472734 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 391/782] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Nov 2 07:23:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:47.474003 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472de84c-32b9-473d-97bf-13cd748ce7f3 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:47.542148 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:47.575500 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472de84c-32b9-473d-97bf-13cd748ce7f3 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:47.614257 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff174b3e-7696-4f6a-9d49-0eda1b11ebec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:47.614872 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff174b3e-7696-4f6a-9d49-0eda1b11ebec None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:47.615150 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff174b3e-7696-4f6a-9d49-0eda1b11ebec None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:47.615421 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff174b3e-7696-4f6a-9d49-0eda1b11ebec None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:47.616079 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff174b3e-7696-4f6a-9d49-0eda1b11ebec None admin] RBAC: Adding query filter params (type=compute) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:47.616376 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff174b3e-7696-4f6a-9d49-0eda1b11ebec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:47.617735 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff174b3e-7696-4f6a-9d49-0eda1b11ebec None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:47.623942 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 392/783] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Nov 2 07:23:47 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:47.629415 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f244526-c2a6-4f67-9391-aa920a01a2b7 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:47.705158 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf5bc4-445c-4abc-bf58-ff08ee183292 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:47.705667 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf5bc4-445c-4abc-bf58-ff08ee183292 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:47.705667 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf5bc4-445c-4abc-bf58-ff08ee183292 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:47.706698 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:47.707422 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 393/784] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:23:47.711943 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a87088-7adf-4285-9de8-0ea632b431a4 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:47.712241 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a87088-7adf-4285-9de8-0ea632b431a4 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:47.712536 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a87088-7adf-4285-9de8-0ea632b431a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:47.730626 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-20a87088-7adf-4285-9de8-0ea632b431a4 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:47.732262 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-20a87088-7adf-4285-9de8-0ea632b431a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:47.733641 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f244526-c2a6-4f67-9391-aa920a01a2b7 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:47.776979 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ad97f-7d71-4df4-be09-cb823f23fb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:47.777624 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ad97f-7d71-4df4-be09-cb823f23fb0c None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:47.778325 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ad97f-7d71-4df4-be09-cb823f23fb0c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:47.778605 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ad97f-7d71-4df4-be09-cb823f23fb0c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:47.779272 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ad97f-7d71-4df4-be09-cb823f23fb0c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:47.781023 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ad97f-7d71-4df4-be09-cb823f23fb0c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:47.805300 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 394/785] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:47 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:23:47.875289 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 392/786] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:23:47 2022] POST /identity/v3/endpoints => generated 334 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:23:48.077575 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a87088-7adf-4285-9de8-0ea632b431a4 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:48.144010 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:48.182859 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a87088-7adf-4285-9de8-0ea632b431a4 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:48.224796 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0a57d-36df-4eed-a082-03e29a66b018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:48.225424 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0a57d-36df-4eed-a082-03e29a66b018 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:48.225697 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0a57d-36df-4eed-a082-03e29a66b018 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:48.225960 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0a57d-36df-4eed-a082-03e29a66b018 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:48.227024 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0a57d-36df-4eed-a082-03e29a66b018 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:48.228515 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0a57d-36df-4eed-a082-03e29a66b018 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:48.232079 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 395/787] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:48.236743 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ad97f-7d71-4df4-be09-cb823f23fb0c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:48.340978 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ad97f-7d71-4df4-be09-cb823f23fb0c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:48.369819 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:48.376133 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1b0b6-0ff5-4c2e-a004-0b0477ef1b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:48.376744 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1b0b6-0ff5-4c2e-a004-0b0477ef1b0a None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:48.377017 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1b0b6-0ff5-4c2e-a004-0b0477ef1b0a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:48.377289 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1b0b6-0ff5-4c2e-a004-0b0477ef1b0a None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:48.378033 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1b0b6-0ff5-4c2e-a004-0b0477ef1b0a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:48.379434 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1b0b6-0ff5-4c2e-a004-0b0477ef1b0a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:48.481977 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 393/788] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Nov 2 07:23:48 2022] POST /identity/v3/projects => generated 311 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:23:48.681261 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48227be4-dde4-4753-96a2-727bcfe0dde5 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:48.681477 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48227be4-dde4-4753-96a2-727bcfe0dde5 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:48.681750 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48227be4-dde4-4753-96a2-727bcfe0dde5 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:48.683210 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 396/789] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:48.689443 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756a6f2-cef4-4b58-b78d-9de74a6d622c None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:48.689731 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756a6f2-cef4-4b58-b78d-9de74a6d622c None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:48.690004 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756a6f2-cef4-4b58-b78d-9de74a6d622c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:48.708507 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-1756a6f2-cef4-4b58-b78d-9de74a6d622c None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:48.709965 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-1756a6f2-cef4-4b58-b78d-9de74a6d622c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:48.779232 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 394/790] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:49.048188 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48227be4-dde4-4753-96a2-727bcfe0dde5 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:49.151862 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48227be4-dde4-4753-96a2-727bcfe0dde5 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:49.177839 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:49.187361 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecadcfe-51e0-4ed1-9d69-91c74cb94cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:49.187971 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecadcfe-51e0-4ed1-9d69-91c74cb94cf2 None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:49.188272 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecadcfe-51e0-4ed1-9d69-91c74cb94cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:49.188544 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecadcfe-51e0-4ed1-9d69-91c74cb94cf2 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:49.192604 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecadcfe-51e0-4ed1-9d69-91c74cb94cf2 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:49.192604 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecadcfe-51e0-4ed1-9d69-91c74cb94cf2 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:49.234405 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.sql.core [None req-8ecadcfe-51e0-4ed1-9d69-91c74cb94cf2 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 07:23:49.234405 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 07:23:49.234405 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [parameters: {'id': '809385b394504237a7255180bdbdd8c9', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Nov 02 07:23:49.234405 dv-cinder-804757-31-smb devstack@keystone.service[81610]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81610) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 07:23:49.244356 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-8ecadcfe-51e0-4ed1-9d69-91c74cb94cf2 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Nov 02 07:23:49.244356 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:49.244356 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 07:23:49.244356 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 07:23:49.244356 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 07:23:49.244356 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 07:23:49.244356 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 07:23:49.244356 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 07:23:49.244356 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 07:23:49.244356 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application conn.query(q) Nov 02 07:23:49.244356 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 07:23:49.244356 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 07:23:49.244356 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 07:23:49.244356 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application result.read() Nov 02 07:23:49.245262 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 07:23:49.245262 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 07:23:49.245262 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 07:23:49.245262 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 07:23:49.245262 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 07:23:49.245262 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 07:23:49.245262 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 07:23:49.245262 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 07:23:49.245262 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 07:23:49.245262 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:49.245262 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Nov 02 07:23:49.245262 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:49.245262 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:49.245262 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Nov 02 07:23:49.245262 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return method(*args, **kwargs) Nov 02 07:23:49.245262 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Nov 02 07:23:49.245262 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return project_ref.to_dict() Nov 02 07:23:49.245262 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 07:23:49.246783 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application next(self.gen) Nov 02 07:23:49.246783 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Nov 02 07:23:49.246783 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application yield resource Nov 02 07:23:49.246783 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 07:23:49.246783 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application next(self.gen) Nov 02 07:23:49.246783 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Nov 02 07:23:49.246783 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self.session.rollback() Nov 02 07:23:49.246783 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 07:23:49.246783 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self.force_reraise() Nov 02 07:23:49.246783 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 07:23:49.246783 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise self.value Nov 02 07:23:49.246783 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Nov 02 07:23:49.246783 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Nov 02 07:23:49.246783 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Nov 02 07:23:49.246783 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application session.commit() Nov 02 07:23:49.246783 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Nov 02 07:23:49.246783 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Nov 02 07:23:49.247630 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Nov 02 07:23:49.247630 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._prepare_impl() Nov 02 07:23:49.247630 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Nov 02 07:23:49.247630 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self.session.flush() Nov 02 07:23:49.247630 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 07:23:49.247630 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._flush(objects) Nov 02 07:23:49.247630 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 07:23:49.247630 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Nov 02 07:23:49.247630 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 07:23:49.247630 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application compat.raise_( Nov 02 07:23:49.247630 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 07:23:49.247630 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception Nov 02 07:23:49.247630 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 07:23:49.247630 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application flush_context.execute() Nov 02 07:23:49.247630 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 07:23:49.247630 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rec.execute(self) Nov 02 07:23:49.247630 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 07:23:49.249817 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Nov 02 07:23:49.249817 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 07:23:49.249817 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application _emit_insert_statements( Nov 02 07:23:49.249817 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Nov 02 07:23:49.249817 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application c = connection._execute_20( Nov 02 07:23:49.249817 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 07:23:49.249817 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 07:23:49.249817 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 07:23:49.249817 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Nov 02 07:23:49.249817 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 07:23:49.249817 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ret = self._execute_context( Nov 02 07:23:49.249817 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 07:23:49.249817 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Nov 02 07:23:49.249817 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 07:23:49.249817 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 07:23:49.254894 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 07:23:49.254894 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception Nov 02 07:23:49.254894 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 07:23:49.254894 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 07:23:49.254894 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 07:23:49.254894 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 07:23:49.254894 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 07:23:49.254894 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 07:23:49.254894 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 07:23:49.254894 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application conn.query(q) Nov 02 07:23:49.254894 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 07:23:49.254894 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 07:23:49.254894 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 07:23:49.254894 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application result.read() Nov 02 07:23:49.254894 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 07:23:49.254894 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 07:23:49.254894 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 07:23:49.257269 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 07:23:49.257269 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 07:23:49.257269 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 07:23:49.257269 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 07:23:49.257269 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 07:23:49.257269 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 07:23:49.257269 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 07:23:49.257269 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [parameters: {'id': '809385b394504237a7255180bdbdd8c9', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Nov 02 07:23:49.257269 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 07:23:49.257269 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:49.257269 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:49.257269 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:49.257269 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:49.257269 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Nov 02 07:23:49.257269 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Nov 02 07:23:49.258670 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Nov 02 07:23:49.258670 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Nov 02 07:23:49.258670 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Nov 02 07:23:49.258670 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:49.258670 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:49.258670 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:49.258670 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:49.258670 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:49.258670 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:49.258670 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:49.258670 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:49.258670 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:49.258670 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:49.258670 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:49.258670 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:49.258670 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:49.258670 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:49.259733 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Nov 02 07:23:49.259733 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Nov 02 07:23:49.259733 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:49.259733 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:49.259733 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Nov 02 07:23:49.259733 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Nov 02 07:23:49.259733 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:49.259733 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:49.259733 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Nov 02 07:23:49.259733 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.Conflict( Nov 02 07:23:49.259733 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Nov 02 07:23:49.259733 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:49.259733 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 397/791] 10.222.0.16 () {60 vars in 1137 bytes} [Wed Nov 2 07:23:49 2022] POST /identity/v3/domains => generated 190 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:49.262837 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756a6f2-cef4-4b58-b78d-9de74a6d622c None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:49.359105 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756a6f2-cef4-4b58-b78d-9de74a6d622c None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:49.373024 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:49.394528 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2a29c-706c-416a-980f-1b53c821a2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:49.395157 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2a29c-706c-416a-980f-1b53c821a2e5 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:49.395432 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2a29c-706c-416a-980f-1b53c821a2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:49.395699 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2a29c-706c-416a-980f-1b53c821a2e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:49.407063 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af2a29c-706c-416a-980f-1b53c821a2e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:49.408653 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af2a29c-706c-416a-980f-1b53c821a2e5 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:49.426202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-3af2a29c-706c-416a-980f-1b53c821a2e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:49.426202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:49.426202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:49.426202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:49.426202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:49.426202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:49.426202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:49.426202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:49.426202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:49.426202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:49.426202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:49.426202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:49.426202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:49.426202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:49.426202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:49.426202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:49.427269 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:49.427269 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:49.427269 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:49.427269 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:49.427269 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:49.427269 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:49.427269 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:49.427269 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:49.427269 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:49.427269 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:49.427269 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:49.427269 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:49.427269 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:49.427269 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:49.427269 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:49.427269 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:49.427269 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:49.433329 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:49.433329 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:49.433329 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:49.433329 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 395/792] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:49.435996 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecadcfe-51e0-4ed1-9d69-91c74cb94cf2 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:49.540383 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecadcfe-51e0-4ed1-9d69-91c74cb94cf2 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:49.574697 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf27f88-6765-4880-9738-10072aac3906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:49.575294 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf27f88-6765-4880-9738-10072aac3906 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:49.575569 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf27f88-6765-4880-9738-10072aac3906 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:49.575837 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf27f88-6765-4880-9738-10072aac3906 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:49.576497 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf27f88-6765-4880-9738-10072aac3906 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:49.576794 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf27f88-6765-4880-9738-10072aac3906 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:49.578130 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf27f88-6765-4880-9738-10072aac3906 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:49.589331 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 398/793] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:50.116237 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b2a39-339c-464f-8939-00aff55d50cf None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:50.116753 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b2a39-339c-464f-8939-00aff55d50cf None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:50.116838 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b2a39-339c-464f-8939-00aff55d50cf None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:50.118106 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 396/794] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:50.123429 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ecc27-313d-4dc6-9863-cd54e288b018 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:50.123819 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ecc27-313d-4dc6-9863-cd54e288b018 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:50.124005 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ecc27-313d-4dc6-9863-cd54e288b018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:50.142332 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-968ecc27-313d-4dc6-9863-cd54e288b018 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:50.143488 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-968ecc27-313d-4dc6-9863-cd54e288b018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:50.187815 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:50.208195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 399/795] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:50.472596 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b2a39-339c-464f-8939-00aff55d50cf None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:50.572784 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b2a39-339c-464f-8939-00aff55d50cf None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:50.611068 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e28e6a-2f3c-4ba9-b264-dfc92520ee4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:50.611688 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e28e6a-2f3c-4ba9-b264-dfc92520ee4e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:50.611960 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e28e6a-2f3c-4ba9-b264-dfc92520ee4e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:50.612251 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e28e6a-2f3c-4ba9-b264-dfc92520ee4e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:50.622337 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e28e6a-2f3c-4ba9-b264-dfc92520ee4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:23:50.626986 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-44e28e6a-2f3c-4ba9-b264-dfc92520ee4e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 07:23:50.626986 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:50.626986 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:50.626986 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:50.626986 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:50.626986 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:50.626986 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:50.626986 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:50.626986 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:50.626986 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:50.626986 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:50.626986 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:50.626986 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:23:50.626986 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:23:50.626986 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:23:50.626986 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:23:50.627864 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:23:50.627864 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:23:50.627864 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:23:50.627864 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:23:50.627864 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:50.627864 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:50.627864 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:50.627864 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:50.627864 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:50.627864 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:50.627864 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:50.627864 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:50.627864 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:50.627864 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:50.627864 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:50.627864 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:50.628702 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:50.628702 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:50.628702 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:50.628702 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:50.628702 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:23:50.628702 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:23:50.628702 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:23:50.628702 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:23:50.628702 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:23:50.628702 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:23:50.628702 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 07:23:50.628702 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:50.628702 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 397/796] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Nov 2 07:23:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:50.634257 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ecc27-313d-4dc6-9863-cd54e288b018 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:50.694258 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016eae25-af08-4e22-9a30-ea2190d4f0bb None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:50.694531 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016eae25-af08-4e22-9a30-ea2190d4f0bb None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:50.694801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016eae25-af08-4e22-9a30-ea2190d4f0bb None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:50.696701 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 398/797] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:50.702015 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e9777-dad2-4577-ae40-e3cefea8cc4f None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:50.702286 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e9777-dad2-4577-ae40-e3cefea8cc4f None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:50.702551 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e9777-dad2-4577-ae40-e3cefea8cc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:50.721141 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-592e9777-dad2-4577-ae40-e3cefea8cc4f None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:50.722344 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-592e9777-dad2-4577-ae40-e3cefea8cc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:50.732827 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ecc27-313d-4dc6-9863-cd54e288b018 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:50.740057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:50.767177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f64282-4a6f-4802-93c7-dfe008216c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:50.767780 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f64282-4a6f-4802-93c7-dfe008216c87 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:50.768077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f64282-4a6f-4802-93c7-dfe008216c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:50.768356 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f64282-4a6f-4802-93c7-dfe008216c87 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:50.769009 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f64282-4a6f-4802-93c7-dfe008216c87 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:50.769309 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f64282-4a6f-4802-93c7-dfe008216c87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:50.770653 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f64282-4a6f-4802-93c7-dfe008216c87 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:50.779075 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 400/798] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Nov 2 07:23:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:50.784728 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f64282-4a6f-4802-93c7-dfe008216c87 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:50.790879 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 399/799] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:23:50.824953 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:50.878023 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f64282-4a6f-4802-93c7-dfe008216c87 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:50.910730 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7938e3-5181-473d-8dce-721802d6db31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:50.911339 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7938e3-5181-473d-8dce-721802d6db31 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:50.911611 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7938e3-5181-473d-8dce-721802d6db31 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:50.911875 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7938e3-5181-473d-8dce-721802d6db31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:50.921844 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7938e3-5181-473d-8dce-721802d6db31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:50.923260 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7938e3-5181-473d-8dce-721802d6db31 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:50.937075 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-da7938e3-5181-473d-8dce-721802d6db31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:50.937075 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:50.937075 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:50.937075 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:50.937075 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:50.937075 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:50.937075 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:50.937075 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:50.937075 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:50.937075 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:50.937075 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:50.937075 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:50.937075 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:50.937075 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:50.937075 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:50.937075 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:50.938172 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:50.938172 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:50.938172 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:50.938172 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:50.938172 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:50.938172 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:50.938172 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:50.938172 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:50.938172 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:50.938172 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:50.938172 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:50.938172 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:50.938172 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:50.938172 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:50.938172 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:50.938172 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:50.938172 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:50.939235 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:50.939235 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:50.939235 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:50.942166 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 401/800] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:23:50.944265 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e9777-dad2-4577-ae40-e3cefea8cc4f None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:51.041571 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e9777-dad2-4577-ae40-e3cefea8cc4f None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:51.062734 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7938e3-5181-473d-8dce-721802d6db31 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:51.074641 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ff657-40a9-403f-9f7b-0490bdf14712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:51.075307 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ff657-40a9-403f-9f7b-0490bdf14712 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:51.075584 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ff657-40a9-403f-9f7b-0490bdf14712 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:51.075853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ff657-40a9-403f-9f7b-0490bdf14712 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:51.076525 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ff657-40a9-403f-9f7b-0490bdf14712 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:51.076809 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ff657-40a9-403f-9f7b-0490bdf14712 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:51.078181 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ff657-40a9-403f-9f7b-0490bdf14712 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:51.089202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 400/801] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:23:51.095394 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ff657-40a9-403f-9f7b-0490bdf14712 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:51.110790 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:51.158613 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:51.164711 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7938e3-5181-473d-8dce-721802d6db31 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:51.193907 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ff657-40a9-403f-9f7b-0490bdf14712 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:51.199136 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a12e02-f35a-4a1a-8857-bbf96e44449e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:51.200284 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a12e02-f35a-4a1a-8857-bbf96e44449e None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:51.200555 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a12e02-f35a-4a1a-8857-bbf96e44449e None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:51.200820 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a12e02-f35a-4a1a-8857-bbf96e44449e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:51.201901 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a12e02-f35a-4a1a-8857-bbf96e44449e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:51.203300 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a12e02-f35a-4a1a-8857-bbf96e44449e None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:51.204880 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 402/802] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:23:51.210420 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a12e02-f35a-4a1a-8857-bbf96e44449e None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:51.227594 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc4d68-622e-4d8a-8ce0-fcfff3f3fce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:51.228249 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc4d68-622e-4d8a-8ce0-fcfff3f3fce9 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:51.228525 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc4d68-622e-4d8a-8ce0-fcfff3f3fce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:51.228793 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc4d68-622e-4d8a-8ce0-fcfff3f3fce9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:51.236096 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc4d68-622e-4d8a-8ce0-fcfff3f3fce9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:51.237534 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc4d68-622e-4d8a-8ce0-fcfff3f3fce9 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:51.249109 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-27bc4d68-622e-4d8a-8ce0-fcfff3f3fce9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:23:51.249109 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:51.249109 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:51.249109 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:51.249109 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:51.249109 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:51.249109 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:51.249109 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:51.249109 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:51.249109 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:51.249109 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:51.249109 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:51.249109 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:23:51.249109 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:23:51.249109 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:23:51.249109 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:23:51.250179 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:51.250179 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:51.250179 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:23:51.250179 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:51.250179 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:23:51.250179 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:51.250179 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:51.250179 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:51.250179 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:51.250179 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:51.250179 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:51.250179 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:51.250179 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:51.250179 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:51.250179 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:51.250179 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:51.250179 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:51.250179 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:51.251367 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:51.251367 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:51.251367 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:23:51.251367 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:23:51.251367 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:23:51.251367 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:23:51.251367 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:23:51.251367 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:23:51.251367 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:23:51.251367 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:51.254995 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 401/803] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Nov 2 07:23:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:23:51.256074 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc4d68-622e-4d8a-8ce0-fcfff3f3fce9 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:51.311485 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a12e02-f35a-4a1a-8857-bbf96e44449e None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:51.328266 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:51.345558 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a370f9cd-a0ab-49ad-977b-33a83d97e6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:51.346239 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370f9cd-a0ab-49ad-977b-33a83d97e6cb None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:51.346611 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370f9cd-a0ab-49ad-977b-33a83d97e6cb None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:51.346946 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370f9cd-a0ab-49ad-977b-33a83d97e6cb None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:51.347649 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a370f9cd-a0ab-49ad-977b-33a83d97e6cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:51.349160 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a370f9cd-a0ab-49ad-977b-33a83d97e6cb None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:51.351988 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc4d68-622e-4d8a-8ce0-fcfff3f3fce9 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:51.388018 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b199248-56b8-4b1e-8640-7d71f4d69fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:51.388740 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b199248-56b8-4b1e-8640-7d71f4d69fd0 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:51.389114 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b199248-56b8-4b1e-8640-7d71f4d69fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:51.389497 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b199248-56b8-4b1e-8640-7d71f4d69fd0 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:51.390304 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b199248-56b8-4b1e-8640-7d71f4d69fd0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:51.390706 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b199248-56b8-4b1e-8640-7d71f4d69fd0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:51.392238 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b199248-56b8-4b1e-8640-7d71f4d69fd0 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:51.415948 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 402/804] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Nov 2 07:23:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:23:51.417475 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b199248-56b8-4b1e-8640-7d71f4d69fd0 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:51.446256 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 403/805] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Nov 2 07:23:51 2022] POST /identity/v3/users => generated 285 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:23:51.538988 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b199248-56b8-4b1e-8640-7d71f4d69fd0 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:51.573265 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:51.584731 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f5981-c5ff-4d3b-b829-b97513415a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:51.585497 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f5981-c5ff-4d3b-b829-b97513415a3c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:51.585782 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f5981-c5ff-4d3b-b829-b97513415a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:51.586054 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f5981-c5ff-4d3b-b829-b97513415a3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:51.598544 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f5981-c5ff-4d3b-b829-b97513415a3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:51.600036 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f5981-c5ff-4d3b-b829-b97513415a3c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:51.618387 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-a79f5981-c5ff-4d3b-b829-b97513415a3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:51.618387 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:51.618387 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:51.618387 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:51.618387 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:51.618387 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:51.618387 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:51.618387 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:51.618387 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:51.618387 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:51.618387 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:51.618387 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:51.618387 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:51.618387 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:51.618387 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:51.618387 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:51.619487 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:51.619487 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:51.619487 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:51.619487 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:51.619487 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:51.619487 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:51.619487 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:51.619487 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:51.619487 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:51.619487 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:51.619487 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:51.619487 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:51.619487 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:51.619487 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:51.619487 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:51.619487 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:51.619487 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:51.621191 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:51.621191 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:51.621191 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:51.621191 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 403/806] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:51.626984 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a370f9cd-a0ab-49ad-977b-33a83d97e6cb None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:51.650188 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:51.730879 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a370f9cd-a0ab-49ad-977b-33a83d97e6cb None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:51.764268 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b9557-0aec-4207-9173-c233d10f873c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:51.764871 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b9557-0aec-4207-9173-c233d10f873c None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:51.765148 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b9557-0aec-4207-9173-c233d10f873c None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:51.765419 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b9557-0aec-4207-9173-c233d10f873c None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:51.766056 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b9557-0aec-4207-9173-c233d10f873c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:51.766349 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b9557-0aec-4207-9173-c233d10f873c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:51.767697 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b9557-0aec-4207-9173-c233d10f873c None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:51.783833 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 404/807] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:51.785048 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f5981-c5ff-4d3b-b829-b97513415a3c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:51.885054 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f5981-c5ff-4d3b-b829-b97513415a3c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:51.918426 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922393e-3a68-4240-8f46-9916411580ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:51.919052 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922393e-3a68-4240-8f46-9916411580ec None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:51.919329 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922393e-3a68-4240-8f46-9916411580ec None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:51.919598 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922393e-3a68-4240-8f46-9916411580ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:51.928782 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2922393e-3a68-4240-8f46-9916411580ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:51.930231 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2922393e-3a68-4240-8f46-9916411580ec None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:51.942579 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-2922393e-3a68-4240-8f46-9916411580ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:51.942579 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:51.942579 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:51.942579 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:51.942579 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:51.942579 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:51.942579 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:51.942579 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:51.942579 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:51.942579 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:51.942579 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:51.942579 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:51.942579 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:23:51.942579 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:23:51.942579 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:23:51.948786 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:23:51.948786 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:51.948786 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:51.948786 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:51.948786 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:51.948786 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:51.948786 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:51.948786 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:51.948786 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:51.948786 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:51.948786 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:51.948786 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:51.948786 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:51.948786 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:51.948786 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:51.948786 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:51.948786 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:51.951206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:23:51.951206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:23:51.951206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:23:51.951206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:23:51.951206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:23:51.951206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:23:51.951206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:51.951206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:51.951206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 404/808] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Nov 2 07:23:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:51.951842 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b9557-0aec-4207-9173-c233d10f873c None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:52.028578 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:52.049620 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b9557-0aec-4207-9173-c233d10f873c None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:52.083205 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f859efbb-3e80-4139-ae9e-382ae4fd15af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:52.083810 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f859efbb-3e80-4139-ae9e-382ae4fd15af None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:52.084118 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f859efbb-3e80-4139-ae9e-382ae4fd15af None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:52.084393 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f859efbb-3e80-4139-ae9e-382ae4fd15af None admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:52.085060 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f859efbb-3e80-4139-ae9e-382ae4fd15af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:52.085363 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f859efbb-3e80-4139-ae9e-382ae4fd15af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:52.086770 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f859efbb-3e80-4139-ae9e-382ae4fd15af None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:52.098277 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 405/809] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Nov 2 07:23:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:52.104194 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922393e-3a68-4240-8f46-9916411580ec None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:52.150166 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:52.206115 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922393e-3a68-4240-8f46-9916411580ec None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:52.238850 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98661023-17ed-4f2d-8035-102c68848725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:52.239501 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98661023-17ed-4f2d-8035-102c68848725 None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:52.239778 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98661023-17ed-4f2d-8035-102c68848725 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:52.240066 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98661023-17ed-4f2d-8035-102c68848725 None admin] PATH_INFO: `/v3/projects/2c3bf3e930dd407f8401c0487edc8c20/users/232210eabdfd4969a348d7333c50c438/roles/5b5508e17b84483d879dd20ce1aa4723` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:52.242188 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98661023-17ed-4f2d-8035-102c68848725 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c3bf3e930dd407f8401c0487edc8c20, user_id=232210eabdfd4969a348d7333c50c438, role_id=5b5508e17b84483d879dd20ce1aa4723)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:52.243618 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98661023-17ed-4f2d-8035-102c68848725 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:52.297903 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 405/810] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Nov 2 07:23:52 2022] PUT /identity/v3/projects/2c3bf3e930dd407f8401c0487edc8c20/users/232210eabdfd4969a348d7333c50c438/roles/5b5508e17b84483d879dd20ce1aa4723 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:23:53.650342 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74f986-b43e-4952-8041-782b2168d700 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:53.650899 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74f986-b43e-4952-8041-782b2168d700 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:53.650899 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74f986-b43e-4952-8041-782b2168d700 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:53.652871 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 406/811] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:53.657889 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7db4d-6246-4489-a297-3749fc56904a None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:53.658303 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7db4d-6246-4489-a297-3749fc56904a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:53.658431 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7db4d-6246-4489-a297-3749fc56904a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:53.676560 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-7cb7db4d-6246-4489-a297-3749fc56904a None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:53.677722 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7cb7db4d-6246-4489-a297-3749fc56904a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:53.743050 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 406/812] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:54.011258 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74f986-b43e-4952-8041-782b2168d700 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:54.109607 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74f986-b43e-4952-8041-782b2168d700 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:54.142955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb5f33-0c6a-4716-b198-64ebfbdac654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:54.143573 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb5f33-0c6a-4716-b198-64ebfbdac654 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:54.143846 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb5f33-0c6a-4716-b198-64ebfbdac654 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:54.144140 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb5f33-0c6a-4716-b198-64ebfbdac654 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:54.150509 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:54.154200 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb5f33-0c6a-4716-b198-64ebfbdac654 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:23:54.158839 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-20eb5f33-0c6a-4716-b198-64ebfbdac654 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:23:54.158839 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:54.158839 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:54.158839 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:54.158839 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:54.158839 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:54.158839 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:54.158839 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:54.158839 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:54.158839 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:54.158839 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:54.158839 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:54.158839 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:23:54.158839 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:23:54.158839 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:23:54.158839 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:23:54.166046 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:23:54.166046 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:23:54.166046 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:23:54.166046 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:23:54.166046 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:54.166046 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:54.166046 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:54.166046 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:54.166046 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:54.166046 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:54.166046 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:54.166046 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:54.166046 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:54.166046 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:54.166046 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:54.166046 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:54.166960 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:54.166960 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:54.166960 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:54.166960 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:54.166960 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:23:54.166960 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:23:54.166960 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:23:54.166960 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:23:54.166960 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:23:54.166960 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:23:54.166960 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:23:54.166960 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:54.166960 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 407/813] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Nov 2 07:23:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:54.167667 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7db4d-6246-4489-a297-3749fc56904a None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:54.199701 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:54.264184 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7db4d-6246-4489-a297-3749fc56904a None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:54.297658 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d38001-92a8-49b6-b6f4-3b84468a2861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:54.298250 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d38001-92a8-49b6-b6f4-3b84468a2861 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:54.298521 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d38001-92a8-49b6-b6f4-3b84468a2861 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:54.298786 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d38001-92a8-49b6-b6f4-3b84468a2861 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:54.299431 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d38001-92a8-49b6-b6f4-3b84468a2861 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:54.299727 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d38001-92a8-49b6-b6f4-3b84468a2861 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:54.301124 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d38001-92a8-49b6-b6f4-3b84468a2861 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:54.308888 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 407/814] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Nov 2 07:23:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:54.314768 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb5f33-0c6a-4716-b198-64ebfbdac654 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:54.415053 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb5f33-0c6a-4716-b198-64ebfbdac654 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:54.445443 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350d3be-5634-4d38-aeaf-d99a0727a17d None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:54.445726 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350d3be-5634-4d38-aeaf-d99a0727a17d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:54.446005 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350d3be-5634-4d38-aeaf-d99a0727a17d None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:54.447376 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 408/815] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:54.453869 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f18604-8b54-490c-a607-389d202da347 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:54.454055 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f18604-8b54-490c-a607-389d202da347 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:54.454335 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f18604-8b54-490c-a607-389d202da347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:54.473546 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-b6f18604-8b54-490c-a607-389d202da347 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:54.474773 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b6f18604-8b54-490c-a607-389d202da347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:54.545175 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 409/816] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:23:54.562863 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e65387-5f3b-4eeb-849f-1457309aa47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:54.563492 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e65387-5f3b-4eeb-849f-1457309aa47e None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:54.563768 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e65387-5f3b-4eeb-849f-1457309aa47e None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:54.564037 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e65387-5f3b-4eeb-849f-1457309aa47e None admin] PATH_INFO: `/v3/users/57960e7d666840efa715cc7392e3e2d5` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:54.577264 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e65387-5f3b-4eeb-849f-1457309aa47e None admin] RBAC: Authorizing `identity:get_user(user_id=57960e7d666840efa715cc7392e3e2d5)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:54.578683 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e65387-5f3b-4eeb-849f-1457309aa47e None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:54.580302 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 408/817] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Nov 2 07:23:54 2022] GET /identity/v3/users/57960e7d666840efa715cc7392e3e2d5 => generated 285 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:54.586140 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f18604-8b54-490c-a607-389d202da347 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:54.612595 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:54.682268 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f18604-8b54-490c-a607-389d202da347 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:54.715561 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93946aa7-f543-464d-870b-9c034f45882a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:54.716137 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93946aa7-f543-464d-870b-9c034f45882a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:54.716411 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93946aa7-f543-464d-870b-9c034f45882a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:54.716678 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93946aa7-f543-464d-870b-9c034f45882a None admin] PATH_INFO: `/v3/projects/ff801ec988ef4381936095aaf599bb54` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:54.717769 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93946aa7-f543-464d-870b-9c034f45882a None admin] RBAC: Authorizing `identity:get_project(project_id=ff801ec988ef4381936095aaf599bb54)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:54.719177 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93946aa7-f543-464d-870b-9c034f45882a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:54.720811 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 410/818] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Nov 2 07:23:54 2022] GET /identity/v3/projects/ff801ec988ef4381936095aaf599bb54 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:23:54.726625 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e65387-5f3b-4eeb-849f-1457309aa47e None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:54.780412 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:54.817615 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93946aa7-f543-464d-870b-9c034f45882a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:54.821793 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e65387-5f3b-4eeb-849f-1457309aa47e None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:54.855691 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f1c3b-ff4b-4505-b8c0-755839cd2864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:54.856372 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f1c3b-ff4b-4505-b8c0-755839cd2864 None admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:54.856647 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f1c3b-ff4b-4505-b8c0-755839cd2864 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:54.856916 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f1c3b-ff4b-4505-b8c0-755839cd2864 None admin] PATH_INFO: `/v3/projects/ff801ec988ef4381936095aaf599bb54/users/57960e7d666840efa715cc7392e3e2d5/roles/9252c356af254127896f3626d925a88a` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:54.858780 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f1c3b-ff4b-4505-b8c0-755839cd2864 None admin] RBAC: Authorizing `identity:create_grant(project_id=ff801ec988ef4381936095aaf599bb54, user_id=57960e7d666840efa715cc7392e3e2d5, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:54.860236 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f1c3b-ff4b-4505-b8c0-755839cd2864 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:54.910790 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:54.917222 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93946aa7-f543-464d-870b-9c034f45882a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:54.949937 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 409/819] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Nov 2 07:23:54 2022] PUT /identity/v3/projects/ff801ec988ef4381936095aaf599bb54/users/57960e7d666840efa715cc7392e3e2d5/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:23:54.952254 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d93abd-51fb-40a1-92d9-a1547551149b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:54.952907 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d93abd-51fb-40a1-92d9-a1547551149b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:54.953183 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d93abd-51fb-40a1-92d9-a1547551149b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:54.953452 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d93abd-51fb-40a1-92d9-a1547551149b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:54.965810 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d93abd-51fb-40a1-92d9-a1547551149b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:23:54.970839 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-66d93abd-51fb-40a1-92d9-a1547551149b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 07:23:54.970839 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:54.970839 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:54.970839 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:54.970839 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:54.970839 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:54.970839 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:54.970839 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:54.970839 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:54.970839 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:54.970839 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:54.970839 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:54.970839 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:23:54.970839 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:23:54.970839 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:23:54.970839 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:23:54.971899 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:23:54.971899 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:23:54.971899 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:23:54.971899 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:23:54.971899 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:54.971899 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:54.971899 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:54.971899 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:54.971899 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:54.971899 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:54.971899 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:54.971899 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:54.971899 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:54.971899 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:54.971899 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:54.971899 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:54.972766 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:54.972766 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:54.972766 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:54.972766 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:54.972766 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:23:54.972766 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:23:54.972766 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:23:54.972766 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:23:54.972766 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:23:54.972766 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:23:54.972766 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 07:23:54.972766 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:54.973405 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 411/820] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Nov 2 07:23:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:23:54.978608 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f1c3b-ff4b-4505-b8c0-755839cd2864 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:55.082719 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f1c3b-ff4b-4505-b8c0-755839cd2864 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:55.100100 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:55.118017 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52137fb9-a8a9-4b2d-8e54-872178fe8f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:55.118632 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52137fb9-a8a9-4b2d-8e54-872178fe8f35 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:55.118912 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52137fb9-a8a9-4b2d-8e54-872178fe8f35 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:55.119183 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52137fb9-a8a9-4b2d-8e54-872178fe8f35 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:55.119834 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52137fb9-a8a9-4b2d-8e54-872178fe8f35 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:55.120164 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52137fb9-a8a9-4b2d-8e54-872178fe8f35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:55.121614 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52137fb9-a8a9-4b2d-8e54-872178fe8f35 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:55.129947 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 410/821] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Nov 2 07:23:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:55.136252 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d93abd-51fb-40a1-92d9-a1547551149b None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:55.235517 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d93abd-51fb-40a1-92d9-a1547551149b None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:55.270683 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e07951-a599-4816-8141-31941895d2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:55.271303 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e07951-a599-4816-8141-31941895d2b4 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:55.271575 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e07951-a599-4816-8141-31941895d2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:55.271839 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e07951-a599-4816-8141-31941895d2b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:55.281680 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e07951-a599-4816-8141-31941895d2b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:55.283104 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e07951-a599-4816-8141-31941895d2b4 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:55.297579 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-92e07951-a599-4816-8141-31941895d2b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:55.297579 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:55.297579 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:55.297579 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:55.297579 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:55.297579 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:55.297579 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:55.297579 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:55.297579 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:55.297579 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:55.297579 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:55.297579 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:55.297579 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:55.297579 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:55.297579 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:55.297579 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:55.298521 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:55.298521 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:55.298521 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:55.298521 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:55.298521 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:55.298521 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:55.298521 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:55.298521 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:55.298521 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:55.298521 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:55.298521 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:55.298521 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:55.298521 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:55.298521 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:55.298521 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:55.298521 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:55.298521 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:55.299396 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:55.299396 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:55.299396 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:55.299396 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 412/822] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:55.304358 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52137fb9-a8a9-4b2d-8e54-872178fe8f35 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:55.398809 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52137fb9-a8a9-4b2d-8e54-872178fe8f35 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:55.431605 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f405e-c906-43d4-8c86-7315a2cd70d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:55.432224 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f405e-c906-43d4-8c86-7315a2cd70d8 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:55.432498 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f405e-c906-43d4-8c86-7315a2cd70d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:55.432763 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f405e-c906-43d4-8c86-7315a2cd70d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:55.433378 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f405e-c906-43d4-8c86-7315a2cd70d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:55.434330 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f405e-c906-43d4-8c86-7315a2cd70d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:55.435673 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f405e-c906-43d4-8c86-7315a2cd70d8 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:55.446701 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 411/823] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:55.452294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e07951-a599-4816-8141-31941895d2b4 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:55.461387 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:55.549621 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e07951-a599-4816-8141-31941895d2b4 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:55.581881 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb5428-6926-417a-9a3c-43eae055c6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:55.582495 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb5428-6926-417a-9a3c-43eae055c6af None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:55.582772 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb5428-6926-417a-9a3c-43eae055c6af None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:55.583043 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb5428-6926-417a-9a3c-43eae055c6af None admin] PATH_INFO: `/v3/users/nova` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:55.590288 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb5428-6926-417a-9a3c-43eae055c6af None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:55.591711 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb5428-6926-417a-9a3c-43eae055c6af None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:55.602522 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-3ecb5428-6926-417a-9a3c-43eae055c6af None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:23:55.602522 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:55.602522 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:55.602522 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:55.602522 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:55.602522 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:55.602522 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:55.602522 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:55.602522 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:55.602522 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:55.602522 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:55.602522 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:55.602522 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:23:55.602522 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:23:55.602522 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:23:55.602522 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:23:55.603469 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:55.603469 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:55.603469 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:23:55.603469 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:55.603469 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:23:55.603469 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:55.603469 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:55.603469 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:55.603469 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:55.603469 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:55.603469 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:55.603469 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:55.603469 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:55.603469 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:55.603469 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:55.603469 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:55.603469 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:55.603469 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:55.604457 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:55.604457 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:55.604457 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:23:55.604457 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:23:55.604457 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:23:55.604457 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:23:55.604457 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:23:55.604457 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:23:55.604457 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:23:55.604457 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:55.604457 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 413/824] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Nov 2 07:23:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:55.610240 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f405e-c906-43d4-8c86-7315a2cd70d8 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:55.649507 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:55.707373 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f405e-c906-43d4-8c86-7315a2cd70d8 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:55.740120 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31cdddd-59e4-409d-b460-0edfb8909221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:55.740731 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cdddd-59e4-409d-b460-0edfb8909221 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:55.741009 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cdddd-59e4-409d-b460-0edfb8909221 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:55.741278 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cdddd-59e4-409d-b460-0edfb8909221 None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:55.741988 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31cdddd-59e4-409d-b460-0edfb8909221 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:55.742291 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31cdddd-59e4-409d-b460-0edfb8909221 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:55.743693 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31cdddd-59e4-409d-b460-0edfb8909221 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:55.762251 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 412/825] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Nov 2 07:23:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:55.767908 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb5428-6926-417a-9a3c-43eae055c6af None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:55.834808 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:55.868593 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb5428-6926-417a-9a3c-43eae055c6af None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:55.902097 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1346b-9e59-4af8-bc94-addc5e586868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:55.902742 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1346b-9e59-4af8-bc94-addc5e586868 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:55.903018 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1346b-9e59-4af8-bc94-addc5e586868 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:55.903289 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1346b-9e59-4af8-bc94-addc5e586868 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:55.968719 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e1346b-9e59-4af8-bc94-addc5e586868 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:55.970157 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e1346b-9e59-4af8-bc94-addc5e586868 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:56.032135 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:56.066979 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 414/826] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Nov 2 07:23:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Nov 02 07:23:56.072858 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31cdddd-59e4-409d-b460-0edfb8909221 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:56.164233 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:56.170354 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31cdddd-59e4-409d-b460-0edfb8909221 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:56.203448 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d1be9-a078-44ff-954a-780e4aa5a699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:56.204097 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d1be9-a078-44ff-954a-780e4aa5a699 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:56.204371 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d1be9-a078-44ff-954a-780e4aa5a699 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:56.204641 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d1be9-a078-44ff-954a-780e4aa5a699 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:56.214301 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d1be9-a078-44ff-954a-780e4aa5a699 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:56.215736 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d1be9-a078-44ff-954a-780e4aa5a699 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:56.229663 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-369d1be9-a078-44ff-954a-780e4aa5a699 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:56.229663 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:56.229663 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:56.229663 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:56.229663 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:56.229663 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:56.229663 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:56.229663 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:56.229663 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:56.229663 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:56.229663 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:56.229663 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:56.229663 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:56.229663 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:56.229663 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:56.229663 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:56.231293 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:56.231293 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:56.231293 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:56.231293 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:56.231293 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:56.231293 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:56.231293 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:56.231293 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:56.231293 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:56.231293 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:56.231293 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:56.231293 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:56.231293 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:56.231293 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:56.231293 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:56.231293 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:56.231293 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:56.232329 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:56.232329 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:56.232329 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:56.232329 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 413/827] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:56.237049 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1346b-9e59-4af8-bc94-addc5e586868 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:56.331869 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1346b-9e59-4af8-bc94-addc5e586868 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:56.364432 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54bab7e-0149-4b41-bf4c-8df8c470abfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:56.365017 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bab7e-0149-4b41-bf4c-8df8c470abfe None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:56.365290 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bab7e-0149-4b41-bf4c-8df8c470abfe None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:56.365557 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bab7e-0149-4b41-bf4c-8df8c470abfe None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:56.366172 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54bab7e-0149-4b41-bf4c-8df8c470abfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:56.366464 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54bab7e-0149-4b41-bf4c-8df8c470abfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:56.367805 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54bab7e-0149-4b41-bf4c-8df8c470abfe None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:56.378612 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 415/828] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:56.384402 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d1be9-a078-44ff-954a-780e4aa5a699 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:56.478171 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d1be9-a078-44ff-954a-780e4aa5a699 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:56.510223 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f43ca-94ee-4fc5-a61c-33aeecb2f232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:56.510831 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f43ca-94ee-4fc5-a61c-33aeecb2f232 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:56.511103 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f43ca-94ee-4fc5-a61c-33aeecb2f232 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:56.511368 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f43ca-94ee-4fc5-a61c-33aeecb2f232 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:56.518332 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f43ca-94ee-4fc5-a61c-33aeecb2f232 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:56.519746 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f43ca-94ee-4fc5-a61c-33aeecb2f232 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:56.530983 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-6a9f43ca-94ee-4fc5-a61c-33aeecb2f232 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:56.530983 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:56.530983 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:56.530983 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:56.530983 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:56.530983 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:56.530983 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:56.530983 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:56.530983 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:56.530983 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:56.530983 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:56.530983 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:56.530983 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:23:56.530983 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:23:56.530983 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:23:56.531864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:23:56.531864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:56.531864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:56.531864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:56.531864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:56.531864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:56.531864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:56.531864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:56.531864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:56.531864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:56.531864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:56.531864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:56.531864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:56.531864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:56.531864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:56.531864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:56.531864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:56.532830 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:23:56.532830 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:23:56.532830 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:23:56.532830 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:23:56.532830 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:23:56.532830 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:23:56.532830 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:56.532830 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:23:56.532830 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 414/829] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Nov 2 07:23:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:23:56.537920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54bab7e-0149-4b41-bf4c-8df8c470abfe None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:56.565699 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:56.638704 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54bab7e-0149-4b41-bf4c-8df8c470abfe None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:56.671997 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a3af4-9fa8-46f7-ae4b-9afdf489165d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:56.672622 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a3af4-9fa8-46f7-ae4b-9afdf489165d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:56.672901 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a3af4-9fa8-46f7-ae4b-9afdf489165d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:56.673175 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a3af4-9fa8-46f7-ae4b-9afdf489165d None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:56.673884 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800a3af4-9fa8-46f7-ae4b-9afdf489165d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:56.674187 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800a3af4-9fa8-46f7-ae4b-9afdf489165d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:56.675603 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800a3af4-9fa8-46f7-ae4b-9afdf489165d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:56.691225 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 416/830] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Nov 2 07:23:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:56.697067 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f43ca-94ee-4fc5-a61c-33aeecb2f232 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:56.708837 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:56.795864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f43ca-94ee-4fc5-a61c-33aeecb2f232 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:56.828282 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ed004-a943-4bb9-ad58-002724001046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:56.828876 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ed004-a943-4bb9-ad58-002724001046 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:56.829152 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ed004-a943-4bb9-ad58-002724001046 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:56.829418 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ed004-a943-4bb9-ad58-002724001046 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:56.830116 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ed004-a943-4bb9-ad58-002724001046 None admin] RBAC: Adding query filter params (role.id=5b5508e17b84483d879dd20ce1aa4723, scope.project.id=2c3bf3e930dd407f8401c0487edc8c20, user.id=232210eabdfd4969a348d7333c50c438) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:56.830417 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ed004-a943-4bb9-ad58-002724001046 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:56.831814 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ed004-a943-4bb9-ad58-002724001046 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:56.837401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 415/831] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Nov 2 07:23:56 2022] GET /identity/v3/role_assignments?user.id=232210eabdfd4969a348d7333c50c438&scope.project.id=2c3bf3e930dd407f8401c0487edc8c20&role.id=5b5508e17b84483d879dd20ce1aa4723 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:57.094789 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74bff1-f670-4bbd-baaf-c00db369da4a None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:57.095320 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74bff1-f670-4bbd-baaf-c00db369da4a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:57.095443 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74bff1-f670-4bbd-baaf-c00db369da4a None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:57.097001 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 417/832] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:23:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:57.102403 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f046d6-d880-40aa-8af8-b630e9d5fbc0 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:57.102686 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f046d6-d880-40aa-8af8-b630e9d5fbc0 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:57.102954 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f046d6-d880-40aa-8af8-b630e9d5fbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:57.123156 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-a7f046d6-d880-40aa-8af8-b630e9d5fbc0 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:57.124367 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a7f046d6-d880-40aa-8af8-b630e9d5fbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:57.193933 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 416/833] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:23:57.461149 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c74bff1-f670-4bbd-baaf-c00db369da4a None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:57.549322 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:57.565662 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c74bff1-f670-4bbd-baaf-c00db369da4a None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:57.601936 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889c464-be2a-4375-a69c-d48dc25fcc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:57.602567 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889c464-be2a-4375-a69c-d48dc25fcc28 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:57.602844 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889c464-be2a-4375-a69c-d48dc25fcc28 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:57.603113 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889c464-be2a-4375-a69c-d48dc25fcc28 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:57.615561 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d889c464-be2a-4375-a69c-d48dc25fcc28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:23:57.620347 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-d889c464-be2a-4375-a69c-d48dc25fcc28 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:23:57.620347 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:57.620347 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:57.620347 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:57.620347 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:57.620347 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:57.620347 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:57.620347 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:57.620347 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:57.620347 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:57.620347 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:57.620347 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:57.620347 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:23:57.620347 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:23:57.620347 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:23:57.620347 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:23:57.621565 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:23:57.621565 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:23:57.621565 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:23:57.621565 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:23:57.621565 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:57.621565 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:57.621565 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:57.621565 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:57.621565 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:57.621565 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:57.621565 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:57.621565 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:57.621565 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:57.621565 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:57.621565 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:57.621565 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:57.622433 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:57.622433 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:57.622433 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:57.622433 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:57.622433 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:23:57.622433 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:23:57.622433 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:23:57.622433 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:23:57.622433 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:23:57.622433 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:23:57.622433 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:23:57.622433 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:23:57.622433 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 418/834] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Nov 2 07:23:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:57.628986 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f046d6-d880-40aa-8af8-b630e9d5fbc0 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:57.631394 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:57.729238 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f046d6-d880-40aa-8af8-b630e9d5fbc0 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:57.762741 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623997ff-822f-4f14-b239-f509dfcd65f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:57.763325 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623997ff-822f-4f14-b239-f509dfcd65f9 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:57.763603 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623997ff-822f-4f14-b239-f509dfcd65f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:57.763870 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623997ff-822f-4f14-b239-f509dfcd65f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:57.764536 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623997ff-822f-4f14-b239-f509dfcd65f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:57.764835 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623997ff-822f-4f14-b239-f509dfcd65f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:57.766170 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623997ff-822f-4f14-b239-f509dfcd65f9 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:57.774249 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 417/835] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Nov 2 07:23:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:57.780881 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889c464-be2a-4375-a69c-d48dc25fcc28 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:57.878284 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889c464-be2a-4375-a69c-d48dc25fcc28 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:57.911784 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c9c3b-bff9-43a7-8501-66ccc720d637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:57.912434 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c9c3b-bff9-43a7-8501-66ccc720d637 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:57.912709 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c9c3b-bff9-43a7-8501-66ccc720d637 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:57.912979 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c9c3b-bff9-43a7-8501-66ccc720d637 None admin] PATH_INFO: `/v3/users/57960e7d666840efa715cc7392e3e2d5` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:57.914107 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c9c3b-bff9-43a7-8501-66ccc720d637 None admin] RBAC: Authorizing `identity:get_user(user_id=57960e7d666840efa715cc7392e3e2d5)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:57.915529 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c9c3b-bff9-43a7-8501-66ccc720d637 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:57.917110 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 419/836] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Nov 2 07:23:57 2022] GET /identity/v3/users/57960e7d666840efa715cc7392e3e2d5 => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:57.922890 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623997ff-822f-4f14-b239-f509dfcd65f9 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:57.982197 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:58.019567 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623997ff-822f-4f14-b239-f509dfcd65f9 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:58.050925 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a05fb-43cd-455f-8453-53c48e752ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:58.051514 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a05fb-43cd-455f-8453-53c48e752ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:58.051812 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a05fb-43cd-455f-8453-53c48e752ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:58.052103 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a05fb-43cd-455f-8453-53c48e752ee8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:58.115953 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790a05fb-43cd-455f-8453-53c48e752ee8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:58.117395 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790a05fb-43cd-455f-8453-53c48e752ee8 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:58.175696 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:58.213229 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 418/837] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Nov 2 07:23:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 07:23:58.219343 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c9c3b-bff9-43a7-8501-66ccc720d637 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:58.235044 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:58.316017 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c9c3b-bff9-43a7-8501-66ccc720d637 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:58.347528 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0784b-3f55-4869-a1a1-0edcf33fd035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:58.348171 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0784b-3f55-4869-a1a1-0edcf33fd035 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:58.348449 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0784b-3f55-4869-a1a1-0edcf33fd035 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:58.348719 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0784b-3f55-4869-a1a1-0edcf33fd035 None admin] PATH_INFO: `/v3/projects/ff801ec988ef4381936095aaf599bb54` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:58.349802 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed0784b-3f55-4869-a1a1-0edcf33fd035 None admin] RBAC: Authorizing `identity:get_project(project_id=ff801ec988ef4381936095aaf599bb54)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:58.351222 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed0784b-3f55-4869-a1a1-0edcf33fd035 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:58.352878 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 420/838] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Nov 2 07:23:58 2022] GET /identity/v3/projects/ff801ec988ef4381936095aaf599bb54 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:58.359610 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a05fb-43cd-455f-8453-53c48e752ee8 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:58.453369 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a05fb-43cd-455f-8453-53c48e752ee8 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:58.485515 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223fd51-a879-47b6-bdc8-2a88eb3deb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:58.486040 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223fd51-a879-47b6-bdc8-2a88eb3deb9f None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:58.486311 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223fd51-a879-47b6-bdc8-2a88eb3deb9f None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:58.486576 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223fd51-a879-47b6-bdc8-2a88eb3deb9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:58.487268 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223fd51-a879-47b6-bdc8-2a88eb3deb9f None admin] RBAC: Adding query filter params (role.id=9252c356af254127896f3626d925a88a, scope.project.id=ff801ec988ef4381936095aaf599bb54, user.id=57960e7d666840efa715cc7392e3e2d5) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:58.487566 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223fd51-a879-47b6-bdc8-2a88eb3deb9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:58.488985 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223fd51-a879-47b6-bdc8-2a88eb3deb9f None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:58.494398 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 419/839] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Nov 2 07:23:58 2022] GET /identity/v3/role_assignments?user.id=57960e7d666840efa715cc7392e3e2d5&scope.project.id=ff801ec988ef4381936095aaf599bb54&role.id=9252c356af254127896f3626d925a88a => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:00.609076 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f9105-7cd3-4570-9420-6e4202b5078a None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:00.609604 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f9105-7cd3-4570-9420-6e4202b5078a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:00.609604 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f9105-7cd3-4570-9420-6e4202b5078a None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:00.610938 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 421/840] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:00.616266 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3210a1d-d060-48b6-9c3e-783204dd5667 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:00.616670 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3210a1d-d060-48b6-9c3e-783204dd5667 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:00.616803 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3210a1d-d060-48b6-9c3e-783204dd5667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:00.635062 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-f3210a1d-d060-48b6-9c3e-783204dd5667 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:00.636250 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f3210a1d-d060-48b6-9c3e-783204dd5667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:00.657679 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:00.699955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 420/841] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:24:00.965998 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f9105-7cd3-4570-9420-6e4202b5078a None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:01.047799 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:01.066543 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f9105-7cd3-4570-9420-6e4202b5078a None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:01.099754 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d890606-c2fb-4bcd-bdcd-5af2a68aecf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:01.100383 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d890606-c2fb-4bcd-bdcd-5af2a68aecf0 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:01.100659 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d890606-c2fb-4bcd-bdcd-5af2a68aecf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:01.100929 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d890606-c2fb-4bcd-bdcd-5af2a68aecf0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:01.102012 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d890606-c2fb-4bcd-bdcd-5af2a68aecf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:01.103437 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d890606-c2fb-4bcd-bdcd-5af2a68aecf0 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:01.104995 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 422/842] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:24:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:01.110685 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3210a1d-d060-48b6-9c3e-783204dd5667 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:01.205318 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3210a1d-d060-48b6-9c3e-783204dd5667 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:01.236425 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c47e1e-8425-408d-bdc3-411b95c99a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:01.237018 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c47e1e-8425-408d-bdc3-411b95c99a69 None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:01.237292 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c47e1e-8425-408d-bdc3-411b95c99a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:01.237558 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c47e1e-8425-408d-bdc3-411b95c99a69 None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:01.238186 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c47e1e-8425-408d-bdc3-411b95c99a69 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:01.239576 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c47e1e-8425-408d-bdc3-411b95c99a69 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:01.314966 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 421/843] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Nov 2 07:24:01 2022] POST /identity/v3/users => generated 286 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:24:03.457723 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f1c92-c105-4152-b5b6-d0aa2df389ab None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:03.458278 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f1c92-c105-4152-b5b6-d0aa2df389ab None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:03.458278 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f1c92-c105-4152-b5b6-d0aa2df389ab None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:03.459584 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 423/844] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:03.465294 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bf267-6b54-4aa1-8b62-f5e4f10a4b5a None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:03.465717 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bf267-6b54-4aa1-8b62-f5e4f10a4b5a None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:03.465990 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bf267-6b54-4aa1-8b62-f5e4f10a4b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:03.484648 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-6a4bf267-6b54-4aa1-8b62-f5e4f10a4b5a None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:03.485802 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-6a4bf267-6b54-4aa1-8b62-f5e4f10a4b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:03.494525 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:03.549037 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 422/845] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:24:03.815224 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f1c92-c105-4152-b5b6-d0aa2df389ab None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:03.914147 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f1c92-c105-4152-b5b6-d0aa2df389ab None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:03.947760 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9b1b1-4a99-4dab-ad86-ed8e81f2de02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:03.948414 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9b1b1-4a99-4dab-ad86-ed8e81f2de02 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:03.948688 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9b1b1-4a99-4dab-ad86-ed8e81f2de02 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:03.948955 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9b1b1-4a99-4dab-ad86-ed8e81f2de02 None admin] PATH_INFO: `/v3/roles/c2071a72276d475daff2d76d195df6c4` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:03.950994 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af9b1b1-4a99-4dab-ad86-ed8e81f2de02 None admin] RBAC: Authorizing `identity:get_role(role_id=c2071a72276d475daff2d76d195df6c4)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:03.952384 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af9b1b1-4a99-4dab-ad86-ed8e81f2de02 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:03.953699 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 424/846] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Nov 2 07:24:03 2022] GET /identity/v3/roles/c2071a72276d475daff2d76d195df6c4 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:03.959644 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4bf267-6b54-4aa1-8b62-f5e4f10a4b5a None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:04.052416 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4bf267-6b54-4aa1-8b62-f5e4f10a4b5a None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:04.084736 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080c383-c8cb-490d-b13d-4135eabf64e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:04.085344 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080c383-c8cb-490d-b13d-4135eabf64e2 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:04.085615 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080c383-c8cb-490d-b13d-4135eabf64e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:04.085880 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080c383-c8cb-490d-b13d-4135eabf64e2 None admin] PATH_INFO: `/v3/users/96215fdc030740c984affd45889ac651` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:04.098192 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e080c383-c8cb-490d-b13d-4135eabf64e2 None admin] RBAC: Authorizing `identity:get_user(user_id=96215fdc030740c984affd45889ac651)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:04.099601 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e080c383-c8cb-490d-b13d-4135eabf64e2 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:04.101181 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 423/847] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Nov 2 07:24:03 2022] GET /identity/v3/users/96215fdc030740c984affd45889ac651 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:04.107224 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9b1b1-4a99-4dab-ad86-ed8e81f2de02 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:04.126461 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:04.204747 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9b1b1-4a99-4dab-ad86-ed8e81f2de02 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:04.237109 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452feee6-3134-41b6-8d78-96afdb5247d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:04.237717 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452feee6-3134-41b6-8d78-96afdb5247d5 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:04.237991 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452feee6-3134-41b6-8d78-96afdb5247d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:04.238259 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452feee6-3134-41b6-8d78-96afdb5247d5 None admin] PATH_INFO: `/v3/projects/ff801ec988ef4381936095aaf599bb54` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:04.239341 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452feee6-3134-41b6-8d78-96afdb5247d5 None admin] RBAC: Authorizing `identity:get_project(project_id=ff801ec988ef4381936095aaf599bb54)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:04.240791 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452feee6-3134-41b6-8d78-96afdb5247d5 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:04.242389 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 425/848] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Nov 2 07:24:04 2022] GET /identity/v3/projects/ff801ec988ef4381936095aaf599bb54 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:04.249122 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080c383-c8cb-490d-b13d-4135eabf64e2 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:04.251914 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:04.343449 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080c383-c8cb-490d-b13d-4135eabf64e2 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:04.375950 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040c348-66fa-47c4-94e5-05fa2e30bfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:04.376614 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040c348-66fa-47c4-94e5-05fa2e30bfe8 None admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:04.376886 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040c348-66fa-47c4-94e5-05fa2e30bfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:04.377152 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040c348-66fa-47c4-94e5-05fa2e30bfe8 None admin] PATH_INFO: `/v3/projects/ff801ec988ef4381936095aaf599bb54/users/96215fdc030740c984affd45889ac651/roles/c2071a72276d475daff2d76d195df6c4` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:04.379207 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040c348-66fa-47c4-94e5-05fa2e30bfe8 None admin] RBAC: Authorizing `identity:create_grant(project_id=ff801ec988ef4381936095aaf599bb54, user_id=96215fdc030740c984affd45889ac651, role_id=c2071a72276d475daff2d76d195df6c4)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:04.380640 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040c348-66fa-47c4-94e5-05fa2e30bfe8 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:04.439626 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 424/849] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Nov 2 07:24:04 2022] PUT /identity/v3/projects/ff801ec988ef4381936095aaf599bb54/users/96215fdc030740c984affd45889ac651/roles/c2071a72276d475daff2d76d195df6c4 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:24:06.566003 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb060e24-1363-4943-a294-65be7e1fab96 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:06.566854 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb060e24-1363-4943-a294-65be7e1fab96 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:06.567130 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb060e24-1363-4943-a294-65be7e1fab96 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:06.568492 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 426/850] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:24:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:06.573599 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1b290-0245-4aca-8cab-4a7500116c97 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:06.573991 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1b290-0245-4aca-8cab-4a7500116c97 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:06.574675 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1b290-0245-4aca-8cab-4a7500116c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:06.592719 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-d6f1b290-0245-4aca-8cab-4a7500116c97 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:06.593898 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-d6f1b290-0245-4aca-8cab-4a7500116c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:06.648000 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:06.658473 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 425/851] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:24:06.931095 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb060e24-1363-4943-a294-65be7e1fab96 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:07.014429 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:07.029429 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb060e24-1363-4943-a294-65be7e1fab96 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:07.061926 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7b9ef-5d74-44c8-9b17-96f9434fb9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:07.062534 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7b9ef-5d74-44c8-9b17-96f9434fb9ad None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:07.062808 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7b9ef-5d74-44c8-9b17-96f9434fb9ad None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:07.063075 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7b9ef-5d74-44c8-9b17-96f9434fb9ad None admin] PATH_INFO: `/v3/roles/c2071a72276d475daff2d76d195df6c4` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:07.064460 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c7b9ef-5d74-44c8-9b17-96f9434fb9ad None admin] RBAC: Authorizing `identity:get_role(role_id=c2071a72276d475daff2d76d195df6c4)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:07.065815 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c7b9ef-5d74-44c8-9b17-96f9434fb9ad None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:07.067109 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 427/852] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Nov 2 07:24:06 2022] GET /identity/v3/roles/c2071a72276d475daff2d76d195df6c4 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:07.072982 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f1b290-0245-4aca-8cab-4a7500116c97 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:07.166128 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f1b290-0245-4aca-8cab-4a7500116c97 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:07.198296 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3347a-66ed-466d-a98c-ab57e17977cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:07.198850 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3347a-66ed-466d-a98c-ab57e17977cd None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:07.199153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3347a-66ed-466d-a98c-ab57e17977cd None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:07.199424 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3347a-66ed-466d-a98c-ab57e17977cd None admin] PATH_INFO: `/v3/users/96215fdc030740c984affd45889ac651` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:07.200546 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea3347a-66ed-466d-a98c-ab57e17977cd None admin] RBAC: Authorizing `identity:get_user(user_id=96215fdc030740c984affd45889ac651)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:07.201953 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea3347a-66ed-466d-a98c-ab57e17977cd None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:07.203485 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 426/853] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Nov 2 07:24:07 2022] GET /identity/v3/users/96215fdc030740c984affd45889ac651 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:07.209095 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7b9ef-5d74-44c8-9b17-96f9434fb9ad None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:07.314288 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7b9ef-5d74-44c8-9b17-96f9434fb9ad None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:07.347920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66565dcd-7941-43e0-8d6e-68179c399de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:07.348544 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66565dcd-7941-43e0-8d6e-68179c399de0 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:07.348823 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66565dcd-7941-43e0-8d6e-68179c399de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:07.349097 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66565dcd-7941-43e0-8d6e-68179c399de0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:07.371984 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:07.414946 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66565dcd-7941-43e0-8d6e-68179c399de0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:07.416410 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66565dcd-7941-43e0-8d6e-68179c399de0 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:07.510579 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 428/854] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Nov 2 07:24:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 07:24:07.517211 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3347a-66ed-466d-a98c-ab57e17977cd None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:07.573261 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:07.611372 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3347a-66ed-466d-a98c-ab57e17977cd None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:07.645613 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d70469-1ee7-42ff-985b-fdb9c90d93fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:07.646222 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d70469-1ee7-42ff-985b-fdb9c90d93fa None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:07.646496 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d70469-1ee7-42ff-985b-fdb9c90d93fa None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:07.646766 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d70469-1ee7-42ff-985b-fdb9c90d93fa None admin] PATH_INFO: `/v3/projects/ff801ec988ef4381936095aaf599bb54` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:07.647849 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d70469-1ee7-42ff-985b-fdb9c90d93fa None admin] RBAC: Authorizing `identity:get_project(project_id=ff801ec988ef4381936095aaf599bb54)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:07.649273 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d70469-1ee7-42ff-985b-fdb9c90d93fa None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:07.650855 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 427/855] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Nov 2 07:24:07 2022] GET /identity/v3/projects/ff801ec988ef4381936095aaf599bb54 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:07.657143 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66565dcd-7941-43e0-8d6e-68179c399de0 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:07.710442 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:07.753899 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66565dcd-7941-43e0-8d6e-68179c399de0 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:07.787065 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b865d72-8f19-4dd2-b99b-3d0cc0823a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:07.787603 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b865d72-8f19-4dd2-b99b-3d0cc0823a9d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:07.787881 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b865d72-8f19-4dd2-b99b-3d0cc0823a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:07.788187 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b865d72-8f19-4dd2-b99b-3d0cc0823a9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:07.788898 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b865d72-8f19-4dd2-b99b-3d0cc0823a9d None admin] RBAC: Adding query filter params (role.id=c2071a72276d475daff2d76d195df6c4, scope.project.id=ff801ec988ef4381936095aaf599bb54, user.id=96215fdc030740c984affd45889ac651) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:07.789203 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b865d72-8f19-4dd2-b99b-3d0cc0823a9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:07.790628 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b865d72-8f19-4dd2-b99b-3d0cc0823a9d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:07.796600 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 429/856] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Nov 2 07:24:07 2022] GET /identity/v3/role_assignments?user.id=96215fdc030740c984affd45889ac651&scope.project.id=ff801ec988ef4381936095aaf599bb54&role.id=c2071a72276d475daff2d76d195df6c4 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:09.910611 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2720e8a-00e9-4b10-ad3b-329f5808d8ac None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:09.911141 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2720e8a-00e9-4b10-ad3b-329f5808d8ac None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:09.911141 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2720e8a-00e9-4b10-ad3b-329f5808d8ac None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:09.912484 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 428/857] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:09.917570 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a25d7-ac7f-4556-8149-932f10b70191 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:09.918096 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a25d7-ac7f-4556-8149-932f10b70191 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:09.918380 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a25d7-ac7f-4556-8149-932f10b70191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:09.936658 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-733a25d7-ac7f-4556-8149-932f10b70191 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:09.937836 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-733a25d7-ac7f-4556-8149-932f10b70191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:10.002741 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 430/858] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:24:10.269368 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2720e8a-00e9-4b10-ad3b-329f5808d8ac None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:10.367598 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2720e8a-00e9-4b10-ad3b-329f5808d8ac None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:10.392971 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:10.400207 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cdedb-82c1-4c58-80cd-4df1848f9af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:10.400831 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cdedb-82c1-4c58-80cd-4df1848f9af2 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:10.401107 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cdedb-82c1-4c58-80cd-4df1848f9af2 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:10.401376 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cdedb-82c1-4c58-80cd-4df1848f9af2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:10.402528 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39cdedb-82c1-4c58-80cd-4df1848f9af2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:10.404085 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39cdedb-82c1-4c58-80cd-4df1848f9af2 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:10.405634 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 429/859] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:24:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:10.411349 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a25d7-ac7f-4556-8149-932f10b70191 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:10.458855 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:10.509091 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a25d7-ac7f-4556-8149-932f10b70191 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:10.541102 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62de52-610b-4325-b511-44f96fc054e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:10.541637 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62de52-610b-4325-b511-44f96fc054e1 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:10.541912 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62de52-610b-4325-b511-44f96fc054e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:10.542177 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62de52-610b-4325-b511-44f96fc054e1 None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:10.543338 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f62de52-610b-4325-b511-44f96fc054e1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:10.544901 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f62de52-610b-4325-b511-44f96fc054e1 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:10.617643 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 431/860] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Nov 2 07:24:10 2022] POST /identity/v3/projects => generated 311 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:24:12.758569 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f437ec-666d-48d9-b888-d56db9e82958 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:12.759137 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f437ec-666d-48d9-b888-d56db9e82958 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:12.759137 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f437ec-666d-48d9-b888-d56db9e82958 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:12.760453 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 430/861] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:24:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:12.765842 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32543ed2-6c52-4dc1-8954-38cc4403a910 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:12.766246 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32543ed2-6c52-4dc1-8954-38cc4403a910 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:12.766427 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32543ed2-6c52-4dc1-8954-38cc4403a910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:12.784683 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-32543ed2-6c52-4dc1-8954-38cc4403a910 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:12.785866 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-32543ed2-6c52-4dc1-8954-38cc4403a910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:12.851481 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 432/862] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:24:13.122222 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f437ec-666d-48d9-b888-d56db9e82958 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:13.219516 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f437ec-666d-48d9-b888-d56db9e82958 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:13.252113 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e0b4aa-c9e0-4ae6-ab6b-cc36e1ea8f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:13.252722 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0b4aa-c9e0-4ae6-ab6b-cc36e1ea8f40 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:13.252997 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0b4aa-c9e0-4ae6-ab6b-cc36e1ea8f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:13.253265 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0b4aa-c9e0-4ae6-ab6b-cc36e1ea8f40 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:13.254339 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e0b4aa-c9e0-4ae6-ab6b-cc36e1ea8f40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:13.255736 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e0b4aa-c9e0-4ae6-ab6b-cc36e1ea8f40 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:13.257546 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 431/863] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:24:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:13.263805 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32543ed2-6c52-4dc1-8954-38cc4403a910 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:13.291938 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:13.359034 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32543ed2-6c52-4dc1-8954-38cc4403a910 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:13.392015 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db633a-c54a-4de3-9f5a-eab305bd9c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:13.392577 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db633a-c54a-4de3-9f5a-eab305bd9c5a None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:13.392851 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db633a-c54a-4de3-9f5a-eab305bd9c5a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:13.393120 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db633a-c54a-4de3-9f5a-eab305bd9c5a None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:13.393762 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db633a-c54a-4de3-9f5a-eab305bd9c5a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:13.395182 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db633a-c54a-4de3-9f5a-eab305bd9c5a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:13.479686 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 433/864] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Nov 2 07:24:13 2022] POST /identity/v3/users => generated 286 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:24:15.612796 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefae0a-32d0-4ef8-bdb0-b57d954063fc None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:15.613341 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefae0a-32d0-4ef8-bdb0-b57d954063fc None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:15.613341 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefae0a-32d0-4ef8-bdb0-b57d954063fc None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:15.614649 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 432/865] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:15.619936 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842155d3-c2e2-4cf6-b51d-9792994de844 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:15.620367 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842155d3-c2e2-4cf6-b51d-9792994de844 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:15.620514 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842155d3-c2e2-4cf6-b51d-9792994de844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:15.639162 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-842155d3-c2e2-4cf6-b51d-9792994de844 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:15.640379 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-842155d3-c2e2-4cf6-b51d-9792994de844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:15.704511 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 434/866] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:24:15.968834 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefae0a-32d0-4ef8-bdb0-b57d954063fc None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:16.030138 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:16.066109 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefae0a-32d0-4ef8-bdb0-b57d954063fc None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:16.098324 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33427692-9dcc-4ee7-9e0b-35fccbe70521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:16.098930 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33427692-9dcc-4ee7-9e0b-35fccbe70521 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:16.099201 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33427692-9dcc-4ee7-9e0b-35fccbe70521 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:16.099464 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33427692-9dcc-4ee7-9e0b-35fccbe70521 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:16.108977 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33427692-9dcc-4ee7-9e0b-35fccbe70521 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:24:16.113632 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-33427692-9dcc-4ee7-9e0b-35fccbe70521 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:24:16.113632 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:24:16.113632 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:24:16.113632 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:24:16.113632 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:24:16.113632 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:24:16.113632 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:24:16.113632 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:24:16.113632 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:24:16.113632 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:24:16.113632 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:24:16.113632 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:24:16.113632 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:24:16.113632 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:24:16.113632 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:24:16.113632 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:24:16.114709 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:24:16.114709 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:24:16.114709 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:24:16.114709 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:24:16.114709 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:24:16.114709 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:24:16.114709 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:24:16.114709 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:24:16.114709 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:24:16.114709 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:24:16.114709 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:24:16.114709 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:24:16.114709 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:24:16.114709 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:24:16.114709 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:24:16.114709 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:24:16.115904 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:24:16.115904 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:24:16.115904 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:24:16.115904 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:24:16.115904 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:24:16.115904 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:24:16.115904 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:24:16.115904 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:24:16.115904 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:24:16.115904 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:24:16.115904 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:24:16.115904 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:24:16.115904 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 433/867] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Nov 2 07:24:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:24:16.120746 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842155d3-c2e2-4cf6-b51d-9792994de844 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:16.139455 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:16.218361 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842155d3-c2e2-4cf6-b51d-9792994de844 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:16.251256 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d3798-033c-457d-94c0-6b03f3a010d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:16.251844 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d3798-033c-457d-94c0-6b03f3a010d0 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:16.252158 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d3798-033c-457d-94c0-6b03f3a010d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:16.252430 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d3798-033c-457d-94c0-6b03f3a010d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:16.253073 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d3798-033c-457d-94c0-6b03f3a010d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:16.253370 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d3798-033c-457d-94c0-6b03f3a010d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:16.254728 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d3798-033c-457d-94c0-6b03f3a010d0 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:16.263158 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 435/868] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Nov 2 07:24:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:24:16.268917 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33427692-9dcc-4ee7-9e0b-35fccbe70521 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:16.363886 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33427692-9dcc-4ee7-9e0b-35fccbe70521 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:16.386306 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:16.397784 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322378f-3135-478c-aa77-a1ebd24bccd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:16.398394 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322378f-3135-478c-aa77-a1ebd24bccd8 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:16.401131 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322378f-3135-478c-aa77-a1ebd24bccd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:16.401131 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322378f-3135-478c-aa77-a1ebd24bccd8 None admin] PATH_INFO: `/v3/users/7598e14dc21a448481d6dfb777e435dc` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:16.412793 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322378f-3135-478c-aa77-a1ebd24bccd8 None admin] RBAC: Authorizing `identity:get_user(user_id=7598e14dc21a448481d6dfb777e435dc)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:16.414208 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322378f-3135-478c-aa77-a1ebd24bccd8 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:16.415808 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 434/869] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Nov 2 07:24:16 2022] GET /identity/v3/users/7598e14dc21a448481d6dfb777e435dc => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:16.421831 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d3798-033c-457d-94c0-6b03f3a010d0 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:16.499493 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:16.520736 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d3798-033c-457d-94c0-6b03f3a010d0 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:16.553471 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8944068-80d0-4edb-88f2-7147e5ec3cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:16.554081 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8944068-80d0-4edb-88f2-7147e5ec3cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:16.554352 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8944068-80d0-4edb-88f2-7147e5ec3cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:16.554617 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8944068-80d0-4edb-88f2-7147e5ec3cb9 None admin] PATH_INFO: `/v3/projects/0a2d9318b9bd4328a712414ca2f8f854` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:16.555688 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8944068-80d0-4edb-88f2-7147e5ec3cb9 None admin] RBAC: Authorizing `identity:get_project(project_id=0a2d9318b9bd4328a712414ca2f8f854)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:16.557130 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8944068-80d0-4edb-88f2-7147e5ec3cb9 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:16.558734 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 436/870] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Nov 2 07:24:16 2022] GET /identity/v3/projects/0a2d9318b9bd4328a712414ca2f8f854 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:16.564734 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322378f-3135-478c-aa77-a1ebd24bccd8 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:16.660125 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322378f-3135-478c-aa77-a1ebd24bccd8 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:16.692837 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd4905-e757-4a04-b8cf-98e924cfa66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:16.693468 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd4905-e757-4a04-b8cf-98e924cfa66f None admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:16.693741 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd4905-e757-4a04-b8cf-98e924cfa66f None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:16.694007 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd4905-e757-4a04-b8cf-98e924cfa66f None admin] PATH_INFO: `/v3/projects/0a2d9318b9bd4328a712414ca2f8f854/users/7598e14dc21a448481d6dfb777e435dc/roles/9252c356af254127896f3626d925a88a` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:16.695859 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd4905-e757-4a04-b8cf-98e924cfa66f None admin] RBAC: Authorizing `identity:create_grant(project_id=0a2d9318b9bd4328a712414ca2f8f854, user_id=7598e14dc21a448481d6dfb777e435dc, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:16.697283 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd4905-e757-4a04-b8cf-98e924cfa66f None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:16.760202 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 435/871] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Nov 2 07:24:16 2022] PUT /identity/v3/projects/0a2d9318b9bd4328a712414ca2f8f854/users/7598e14dc21a448481d6dfb777e435dc/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:24:18.876686 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a871fa-4312-42cd-acc3-7c602818d398 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:18.877219 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a871fa-4312-42cd-acc3-7c602818d398 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:18.877219 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a871fa-4312-42cd-acc3-7c602818d398 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:18.878552 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 437/872] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:18.883909 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e160a682-5619-4a2e-bb7a-b1ab6ad60e16 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:18.886792 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e160a682-5619-4a2e-bb7a-b1ab6ad60e16 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:18.886792 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e160a682-5619-4a2e-bb7a-b1ab6ad60e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:18.902795 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-e160a682-5619-4a2e-bb7a-b1ab6ad60e16 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:18.904133 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e160a682-5619-4a2e-bb7a-b1ab6ad60e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:18.938628 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:18.969291 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 436/873] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:24:19.235254 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a871fa-4312-42cd-acc3-7c602818d398 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:19.334130 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a871fa-4312-42cd-acc3-7c602818d398 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:19.366735 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d052a0-6471-456e-ac96-35780ee0cc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:19.367350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d052a0-6471-456e-ac96-35780ee0cc97 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:19.367620 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d052a0-6471-456e-ac96-35780ee0cc97 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:19.367886 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d052a0-6471-456e-ac96-35780ee0cc97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:19.378399 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d052a0-6471-456e-ac96-35780ee0cc97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:24:19.383337 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-33d052a0-6471-456e-ac96-35780ee0cc97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:24:19.383337 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:24:19.383337 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:24:19.383337 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:24:19.383337 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:24:19.383337 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:24:19.383337 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:24:19.383337 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:24:19.383337 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:24:19.383337 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:24:19.383337 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:24:19.383337 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:24:19.383337 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:24:19.383337 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:24:19.383337 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:24:19.383337 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:24:19.384453 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:24:19.384453 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:24:19.384453 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:24:19.384453 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:24:19.384453 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:24:19.384453 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:24:19.384453 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:24:19.384453 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:24:19.384453 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:24:19.384453 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:24:19.384453 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:24:19.384453 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:24:19.384453 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:24:19.384453 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:24:19.384453 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:24:19.384453 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:24:19.385509 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:24:19.385509 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:24:19.385509 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:24:19.385509 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:24:19.385509 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:24:19.385509 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:24:19.385509 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:24:19.385509 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:24:19.385509 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:24:19.385509 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:24:19.385509 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:24:19.385509 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:24:19.385509 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 438/874] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Nov 2 07:24:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:24:19.390691 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e160a682-5619-4a2e-bb7a-b1ab6ad60e16 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:19.484988 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e160a682-5619-4a2e-bb7a-b1ab6ad60e16 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:19.518061 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17096358-c668-455c-92de-f370d997799b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:19.518595 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17096358-c668-455c-92de-f370d997799b None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:19.518870 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17096358-c668-455c-92de-f370d997799b None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:19.519140 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17096358-c668-455c-92de-f370d997799b None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:19.519780 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17096358-c668-455c-92de-f370d997799b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:19.520098 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17096358-c668-455c-92de-f370d997799b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:19.521447 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17096358-c668-455c-92de-f370d997799b None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:19.529141 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 437/875] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Nov 2 07:24:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:19.537840 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d052a0-6471-456e-ac96-35780ee0cc97 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:19.544858 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:19.633152 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d052a0-6471-456e-ac96-35780ee0cc97 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:19.666023 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ffca3f-0bb5-4933-9d1b-37c8057e0acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:19.666632 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ffca3f-0bb5-4933-9d1b-37c8057e0acb None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:19.666909 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ffca3f-0bb5-4933-9d1b-37c8057e0acb None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:19.667180 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ffca3f-0bb5-4933-9d1b-37c8057e0acb None admin] PATH_INFO: `/v3/users/7598e14dc21a448481d6dfb777e435dc` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:19.668897 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ffca3f-0bb5-4933-9d1b-37c8057e0acb None admin] RBAC: Authorizing `identity:get_user(user_id=7598e14dc21a448481d6dfb777e435dc)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:19.670323 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ffca3f-0bb5-4933-9d1b-37c8057e0acb None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:19.671861 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 439/876] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Nov 2 07:24:19 2022] GET /identity/v3/users/7598e14dc21a448481d6dfb777e435dc => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:19.677570 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17096358-c668-455c-92de-f370d997799b None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:19.710158 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:19.772300 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17096358-c668-455c-92de-f370d997799b None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:19.804518 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8a20d-7658-4cbc-a82f-d39c530f66f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:19.805103 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8a20d-7658-4cbc-a82f-d39c530f66f9 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:19.805374 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8a20d-7658-4cbc-a82f-d39c530f66f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:19.805640 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8a20d-7658-4cbc-a82f-d39c530f66f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:19.868324 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8a20d-7658-4cbc-a82f-d39c530f66f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:19.869727 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8a20d-7658-4cbc-a82f-d39c530f66f9 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:19.900070 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:19.962492 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 438/877] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Nov 2 07:24:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 07:24:19.968916 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ffca3f-0bb5-4933-9d1b-37c8057e0acb None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:20.041951 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:20.065387 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ffca3f-0bb5-4933-9d1b-37c8057e0acb None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:20.098130 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16444bc-a2ae-4f12-ab0c-9f66a99da83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:20.098741 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16444bc-a2ae-4f12-ab0c-9f66a99da83a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:20.099016 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16444bc-a2ae-4f12-ab0c-9f66a99da83a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:20.099286 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16444bc-a2ae-4f12-ab0c-9f66a99da83a None admin] PATH_INFO: `/v3/projects/0a2d9318b9bd4328a712414ca2f8f854` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:20.100404 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16444bc-a2ae-4f12-ab0c-9f66a99da83a None admin] RBAC: Authorizing `identity:get_project(project_id=0a2d9318b9bd4328a712414ca2f8f854)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:20.101827 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16444bc-a2ae-4f12-ab0c-9f66a99da83a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:20.103415 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 440/878] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Nov 2 07:24:19 2022] GET /identity/v3/projects/0a2d9318b9bd4328a712414ca2f8f854 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:20.109537 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8a20d-7658-4cbc-a82f-d39c530f66f9 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:20.205100 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8a20d-7658-4cbc-a82f-d39c530f66f9 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:20.236939 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a44ac-e5e5-4fd4-8d5c-f818c685c3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:20.237522 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a44ac-e5e5-4fd4-8d5c-f818c685c3cb None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:20.237798 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a44ac-e5e5-4fd4-8d5c-f818c685c3cb None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:20.238067 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a44ac-e5e5-4fd4-8d5c-f818c685c3cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:20.238767 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5a44ac-e5e5-4fd4-8d5c-f818c685c3cb None admin] RBAC: Adding query filter params (role.id=9252c356af254127896f3626d925a88a, scope.project.id=0a2d9318b9bd4328a712414ca2f8f854, user.id=7598e14dc21a448481d6dfb777e435dc) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:20.239070 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5a44ac-e5e5-4fd4-8d5c-f818c685c3cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:20.240500 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5a44ac-e5e5-4fd4-8d5c-f818c685c3cb None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:20.242167 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:20.246761 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 439/879] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Nov 2 07:24:20 2022] GET /identity/v3/role_assignments?user.id=7598e14dc21a448481d6dfb777e435dc&scope.project.id=0a2d9318b9bd4328a712414ca2f8f854&role.id=9252c356af254127896f3626d925a88a => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:22.383414 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278674c4-cfe0-4dc0-9374-9b1c9a471b96 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:22.384034 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278674c4-cfe0-4dc0-9374-9b1c9a471b96 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:22.384034 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278674c4-cfe0-4dc0-9374-9b1c9a471b96 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:22.385332 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 441/880] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:22.391251 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e9aca-b5e8-4cf5-8042-56a939778e7c None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:22.391687 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e9aca-b5e8-4cf5-8042-56a939778e7c None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:22.391794 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e9aca-b5e8-4cf5-8042-56a939778e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:22.410314 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-045e9aca-b5e8-4cf5-8042-56a939778e7c None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:22.411483 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-045e9aca-b5e8-4cf5-8042-56a939778e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:22.475031 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 440/881] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:24:22.741884 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278674c4-cfe0-4dc0-9374-9b1c9a471b96 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:22.840859 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278674c4-cfe0-4dc0-9374-9b1c9a471b96 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:22.873800 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7efdeb-e26d-4492-beac-65357b9ad75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:22.874384 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7efdeb-e26d-4492-beac-65357b9ad75a None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:22.874654 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7efdeb-e26d-4492-beac-65357b9ad75a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:22.874919 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7efdeb-e26d-4492-beac-65357b9ad75a None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:22.875572 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7efdeb-e26d-4492-beac-65357b9ad75a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:22.876937 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7efdeb-e26d-4492-beac-65357b9ad75a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:22.967177 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 442/882] 10.222.0.16 () {60 vars in 1138 bytes} [Wed Nov 2 07:24:22 2022] POST /identity/v3/domains => generated 267 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:24:25.168712 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2569823-7059-41de-8215-995c254997c5 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:25.169250 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2569823-7059-41de-8215-995c254997c5 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:25.169250 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2569823-7059-41de-8215-995c254997c5 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:25.170587 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 441/883] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:24:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:25.175814 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab18776-c5f7-4d17-8d2c-84311004d9be None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:25.176237 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab18776-c5f7-4d17-8d2c-84311004d9be None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:25.176391 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab18776-c5f7-4d17-8d2c-84311004d9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:25.182556 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:25.195026 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-dab18776-c5f7-4d17-8d2c-84311004d9be None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:25.196162 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-dab18776-c5f7-4d17-8d2c-84311004d9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:25.261021 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 443/884] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:24:25.529471 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2569823-7059-41de-8215-995c254997c5 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:25.626113 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2569823-7059-41de-8215-995c254997c5 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:25.650555 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:25.658539 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ed4e2-ae75-4fb0-9638-41dbb9b9a993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:25.668662 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ed4e2-ae75-4fb0-9638-41dbb9b9a993 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:25.668662 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ed4e2-ae75-4fb0-9638-41dbb9b9a993 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:25.668662 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ed4e2-ae75-4fb0-9638-41dbb9b9a993 None admin] PATH_INFO: `/v3/domains/23712465f2fb4a6483cd08b14395b157` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:25.670149 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ed4e2-ae75-4fb0-9638-41dbb9b9a993 None admin] RBAC: Authorizing `identity:get_domain(domain_id=23712465f2fb4a6483cd08b14395b157)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:25.671550 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ed4e2-ae75-4fb0-9638-41dbb9b9a993 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:25.673125 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 442/885] 10.222.0.16 () {56 vars in 1183 bytes} [Wed Nov 2 07:24:25 2022] GET /identity/v3/domains/23712465f2fb4a6483cd08b14395b157 => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:25.678957 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab18776-c5f7-4d17-8d2c-84311004d9be None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:25.773498 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab18776-c5f7-4d17-8d2c-84311004d9be None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:25.802706 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:25.807409 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148a1b0-817a-4a62-b913-e0c62f4a6e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:25.808001 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148a1b0-817a-4a62-b913-e0c62f4a6e85 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:25.811669 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148a1b0-817a-4a62-b913-e0c62f4a6e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:25.811669 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148a1b0-817a-4a62-b913-e0c62f4a6e85 None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:25.811669 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148a1b0-817a-4a62-b913-e0c62f4a6e85 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:25.811669 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148a1b0-817a-4a62-b913-e0c62f4a6e85 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:25.923583 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 444/886] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Nov 2 07:24:25 2022] POST /identity/v3/projects => generated 361 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:24:28.077364 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370ab2b-356d-4f6b-81ed-0223572f33a2 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:28.077896 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370ab2b-356d-4f6b-81ed-0223572f33a2 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:28.077896 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370ab2b-356d-4f6b-81ed-0223572f33a2 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:28.079220 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 443/887] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:28.084409 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d749d4d-7727-4e7b-8cb3-561ba34c4820 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:28.084838 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d749d4d-7727-4e7b-8cb3-561ba34c4820 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:28.084932 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d749d4d-7727-4e7b-8cb3-561ba34c4820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:28.102448 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-2d749d4d-7727-4e7b-8cb3-561ba34c4820 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:28.103645 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2d749d4d-7727-4e7b-8cb3-561ba34c4820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:28.167068 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 445/888] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:24:28.434621 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370ab2b-356d-4f6b-81ed-0223572f33a2 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:28.531921 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370ab2b-356d-4f6b-81ed-0223572f33a2 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:28.564340 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b5cba-e79d-4883-9234-5b3121697751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:28.564945 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b5cba-e79d-4883-9234-5b3121697751 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:28.565222 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b5cba-e79d-4883-9234-5b3121697751 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:28.565493 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b5cba-e79d-4883-9234-5b3121697751 None admin] PATH_INFO: `/v3/domains/23712465f2fb4a6483cd08b14395b157` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:28.566585 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b5cba-e79d-4883-9234-5b3121697751 None admin] RBAC: Authorizing `identity:get_domain(domain_id=23712465f2fb4a6483cd08b14395b157)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:28.567989 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b5cba-e79d-4883-9234-5b3121697751 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:28.569537 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 444/889] 10.222.0.16 () {56 vars in 1183 bytes} [Wed Nov 2 07:24:28 2022] GET /identity/v3/domains/23712465f2fb4a6483cd08b14395b157 => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:28.575890 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d749d4d-7727-4e7b-8cb3-561ba34c4820 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:28.672325 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d749d4d-7727-4e7b-8cb3-561ba34c4820 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:28.686379 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:28.705903 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803a289-7990-4879-b0c9-f46782fdad91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:28.706500 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803a289-7990-4879-b0c9-f46782fdad91 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:28.707975 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803a289-7990-4879-b0c9-f46782fdad91 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:28.707975 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803a289-7990-4879-b0c9-f46782fdad91 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:28.707975 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803a289-7990-4879-b0c9-f46782fdad91 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:28.709172 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803a289-7990-4879-b0c9-f46782fdad91 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:28.793875 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 446/890] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Nov 2 07:24:28 2022] POST /identity/v3/users => generated 311 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:24:30.992507 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386398b-6017-4cf2-9230-e3a565347d3c None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:30.992959 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386398b-6017-4cf2-9230-e3a565347d3c None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:30.992959 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386398b-6017-4cf2-9230-e3a565347d3c None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:30.994314 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 445/891] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:31.000126 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56966a58-ace3-4ffd-bc63-de4d988c6080 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:31.000502 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56966a58-ace3-4ffd-bc63-de4d988c6080 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:31.000670 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56966a58-ace3-4ffd-bc63-de4d988c6080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:31.019087 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-56966a58-ace3-4ffd-bc63-de4d988c6080 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:31.020295 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-56966a58-ace3-4ffd-bc63-de4d988c6080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:31.083987 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 447/892] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:24:31.350861 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386398b-6017-4cf2-9230-e3a565347d3c None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:31.406650 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:31.454011 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386398b-6017-4cf2-9230-e3a565347d3c None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:31.486785 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381589b9-cf26-4020-8b73-ba23632fbb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:31.487397 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381589b9-cf26-4020-8b73-ba23632fbb97 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:31.487669 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381589b9-cf26-4020-8b73-ba23632fbb97 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:31.487933 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381589b9-cf26-4020-8b73-ba23632fbb97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:31.498119 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381589b9-cf26-4020-8b73-ba23632fbb97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:24:31.502785 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-381589b9-cf26-4020-8b73-ba23632fbb97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:24:31.502785 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:24:31.502785 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:24:31.502785 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:24:31.502785 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:24:31.502785 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:24:31.502785 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:24:31.502785 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:24:31.502785 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:24:31.502785 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:24:31.502785 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:24:31.502785 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:24:31.502785 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:24:31.502785 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:24:31.502785 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:24:31.502785 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:24:31.503932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:24:31.503932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:24:31.503932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:24:31.503932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:24:31.503932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:24:31.503932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:24:31.503932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:24:31.503932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:24:31.503932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:24:31.503932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:24:31.503932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:24:31.503932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:24:31.503932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:24:31.503932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:24:31.503932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:24:31.503932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:24:31.505052 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:24:31.505052 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:24:31.505052 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:24:31.505052 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:24:31.505052 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:24:31.505052 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:24:31.505052 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:24:31.505052 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:24:31.505052 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:24:31.505052 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:24:31.505052 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:24:31.505052 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:24:31.505052 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 446/893] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Nov 2 07:24:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:24:31.510180 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56966a58-ace3-4ffd-bc63-de4d988c6080 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:31.603278 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:31.606653 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56966a58-ace3-4ffd-bc63-de4d988c6080 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:31.640246 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee185091-819f-4b65-a77c-572a2f502030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:31.640727 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee185091-819f-4b65-a77c-572a2f502030 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:31.641029 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee185091-819f-4b65-a77c-572a2f502030 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:31.641275 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee185091-819f-4b65-a77c-572a2f502030 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:31.641925 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee185091-819f-4b65-a77c-572a2f502030 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:31.642223 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee185091-819f-4b65-a77c-572a2f502030 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:31.643588 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee185091-819f-4b65-a77c-572a2f502030 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:31.651531 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 448/894] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Nov 2 07:24:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:31.658101 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381589b9-cf26-4020-8b73-ba23632fbb97 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:31.752390 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381589b9-cf26-4020-8b73-ba23632fbb97 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:31.768837 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:31.786127 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49c8cd-988a-4f12-a319-20b6adb0fc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:31.786739 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49c8cd-988a-4f12-a319-20b6adb0fc2c None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:31.787014 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49c8cd-988a-4f12-a319-20b6adb0fc2c None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:31.787281 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49c8cd-988a-4f12-a319-20b6adb0fc2c None admin] PATH_INFO: `/v3/users/cc917226ae67445280cad740154d13b7` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:31.800435 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f49c8cd-988a-4f12-a319-20b6adb0fc2c None admin] RBAC: Authorizing `identity:get_user(user_id=cc917226ae67445280cad740154d13b7)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:31.801845 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f49c8cd-988a-4f12-a319-20b6adb0fc2c None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:31.803429 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 447/895] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Nov 2 07:24:31 2022] GET /identity/v3/users/cc917226ae67445280cad740154d13b7 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:31.809467 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee185091-819f-4b65-a77c-572a2f502030 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:31.904319 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee185091-819f-4b65-a77c-572a2f502030 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:31.936323 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34628aa9-99bb-4ec0-a6fd-5e8e905df888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:31.936932 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34628aa9-99bb-4ec0-a6fd-5e8e905df888 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:31.937205 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34628aa9-99bb-4ec0-a6fd-5e8e905df888 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:31.937471 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34628aa9-99bb-4ec0-a6fd-5e8e905df888 None admin] PATH_INFO: `/v3/projects/7162065dce1a49c7bbb37e0a6a14010b` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:31.938568 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34628aa9-99bb-4ec0-a6fd-5e8e905df888 None admin] RBAC: Authorizing `identity:get_project(project_id=7162065dce1a49c7bbb37e0a6a14010b)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:31.939986 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34628aa9-99bb-4ec0-a6fd-5e8e905df888 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:31.941616 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 449/896] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Nov 2 07:24:31 2022] GET /identity/v3/projects/7162065dce1a49c7bbb37e0a6a14010b => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:31.947425 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49c8cd-988a-4f12-a319-20b6adb0fc2c None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:32.043531 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49c8cd-988a-4f12-a319-20b6adb0fc2c None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:32.075664 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78986891-8783-4c2e-9ea6-a5dd0e1ac688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:32.076323 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78986891-8783-4c2e-9ea6-a5dd0e1ac688 None admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:32.076595 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78986891-8783-4c2e-9ea6-a5dd0e1ac688 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:32.076861 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78986891-8783-4c2e-9ea6-a5dd0e1ac688 None admin] PATH_INFO: `/v3/projects/7162065dce1a49c7bbb37e0a6a14010b/users/cc917226ae67445280cad740154d13b7/roles/9252c356af254127896f3626d925a88a` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:32.078693 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78986891-8783-4c2e-9ea6-a5dd0e1ac688 None admin] RBAC: Authorizing `identity:create_grant(project_id=7162065dce1a49c7bbb37e0a6a14010b, user_id=cc917226ae67445280cad740154d13b7, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:32.080097 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78986891-8783-4c2e-9ea6-a5dd0e1ac688 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:32.171167 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 448/897] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Nov 2 07:24:31 2022] PUT /identity/v3/projects/7162065dce1a49c7bbb37e0a6a14010b/users/cc917226ae67445280cad740154d13b7/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:24:34.283740 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62318e-9603-4b04-a441-5a585fe79296 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:34.284290 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62318e-9603-4b04-a441-5a585fe79296 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:34.284290 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62318e-9603-4b04-a441-5a585fe79296 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:34.285550 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 450/898] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:34.290669 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04911c6d-6e02-4c75-9bef-3aa5b80c82d4 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:34.291041 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04911c6d-6e02-4c75-9bef-3aa5b80c82d4 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:34.291205 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04911c6d-6e02-4c75-9bef-3aa5b80c82d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:34.309843 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-04911c6d-6e02-4c75-9bef-3aa5b80c82d4 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:34.311000 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-04911c6d-6e02-4c75-9bef-3aa5b80c82d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:34.335576 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:34.373741 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 449/899] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:24:34.641155 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62318e-9603-4b04-a441-5a585fe79296 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:34.670683 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:34.738880 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62318e-9603-4b04-a441-5a585fe79296 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:34.772546 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35250099-88d3-42ff-b77b-27f77ce70567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:34.773159 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35250099-88d3-42ff-b77b-27f77ce70567 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:34.773438 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35250099-88d3-42ff-b77b-27f77ce70567 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:34.773710 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35250099-88d3-42ff-b77b-27f77ce70567 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:34.783474 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35250099-88d3-42ff-b77b-27f77ce70567 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:24:34.788203 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-35250099-88d3-42ff-b77b-27f77ce70567 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:24:34.788203 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:24:34.788203 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:24:34.788203 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:24:34.788203 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:24:34.788203 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:24:34.788203 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:24:34.788203 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:24:34.788203 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:24:34.788203 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:24:34.788203 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:24:34.788203 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:24:34.788203 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:24:34.788203 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:24:34.788203 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:24:34.788203 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:24:34.789251 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:24:34.789251 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:24:34.789251 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:24:34.789251 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:24:34.789251 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:24:34.789251 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:24:34.789251 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:24:34.789251 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:24:34.789251 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:24:34.789251 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:24:34.789251 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:24:34.789251 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:24:34.789251 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:24:34.789251 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:24:34.789251 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:24:34.789251 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:24:34.790089 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:24:34.790089 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:24:34.790089 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:24:34.790089 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:24:34.790089 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:24:34.790089 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:24:34.790089 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:24:34.790089 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:24:34.790089 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:24:34.790089 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:24:34.790089 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:24:34.790089 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:24:34.790089 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 451/900] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Nov 2 07:24:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:24:34.798408 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04911c6d-6e02-4c75-9bef-3aa5b80c82d4 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:34.895431 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04911c6d-6e02-4c75-9bef-3aa5b80c82d4 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:34.929035 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558a357-1052-4ae6-bb1b-ef99ced08214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:34.929636 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558a357-1052-4ae6-bb1b-ef99ced08214 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:34.929914 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558a357-1052-4ae6-bb1b-ef99ced08214 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:34.930187 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558a357-1052-4ae6-bb1b-ef99ced08214 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:34.930834 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4558a357-1052-4ae6-bb1b-ef99ced08214 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:34.931140 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4558a357-1052-4ae6-bb1b-ef99ced08214 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:34.932520 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4558a357-1052-4ae6-bb1b-ef99ced08214 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:34.940945 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 450/901] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Nov 2 07:24:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:34.946626 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35250099-88d3-42ff-b77b-27f77ce70567 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:35.034664 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:35.043947 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35250099-88d3-42ff-b77b-27f77ce70567 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:35.076861 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532ecbf-675e-44ab-96fe-2ab08407c229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:35.077475 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532ecbf-675e-44ab-96fe-2ab08407c229 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:35.077751 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532ecbf-675e-44ab-96fe-2ab08407c229 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:35.078020 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532ecbf-675e-44ab-96fe-2ab08407c229 None admin] PATH_INFO: `/v3/users/cc917226ae67445280cad740154d13b7` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:35.079105 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532ecbf-675e-44ab-96fe-2ab08407c229 None admin] RBAC: Authorizing `identity:get_user(user_id=cc917226ae67445280cad740154d13b7)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:35.080562 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532ecbf-675e-44ab-96fe-2ab08407c229 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:35.082113 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 452/902] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Nov 2 07:24:34 2022] GET /identity/v3/users/cc917226ae67445280cad740154d13b7 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:35.087823 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558a357-1052-4ae6-bb1b-ef99ced08214 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:35.114575 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:35.183101 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558a357-1052-4ae6-bb1b-ef99ced08214 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:35.215976 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eadd974-b7b2-45e6-9a1c-6d14d2e5c42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:35.216597 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadd974-b7b2-45e6-9a1c-6d14d2e5c42f None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:35.216873 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadd974-b7b2-45e6-9a1c-6d14d2e5c42f None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:35.217144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadd974-b7b2-45e6-9a1c-6d14d2e5c42f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:35.280102 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eadd974-b7b2-45e6-9a1c-6d14d2e5c42f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:35.281513 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eadd974-b7b2-45e6-9a1c-6d14d2e5c42f None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:35.306531 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:35.375322 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 451/903] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Nov 2 07:24:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 07:24:35.381134 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532ecbf-675e-44ab-96fe-2ab08407c229 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:35.483692 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532ecbf-675e-44ab-96fe-2ab08407c229 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:35.516978 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2102a3-042e-42f3-85c2-4a4244046a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:35.517588 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2102a3-042e-42f3-85c2-4a4244046a89 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:35.517864 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2102a3-042e-42f3-85c2-4a4244046a89 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:35.518133 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2102a3-042e-42f3-85c2-4a4244046a89 None admin] PATH_INFO: `/v3/projects/7162065dce1a49c7bbb37e0a6a14010b` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:35.519212 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2102a3-042e-42f3-85c2-4a4244046a89 None admin] RBAC: Authorizing `identity:get_project(project_id=7162065dce1a49c7bbb37e0a6a14010b)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:35.520671 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2102a3-042e-42f3-85c2-4a4244046a89 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:35.522265 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 453/904] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Nov 2 07:24:35 2022] GET /identity/v3/projects/7162065dce1a49c7bbb37e0a6a14010b => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:35.528458 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eadd974-b7b2-45e6-9a1c-6d14d2e5c42f None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:35.620358 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eadd974-b7b2-45e6-9a1c-6d14d2e5c42f None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:35.645355 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:35.653737 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0e39b-d240-40a7-b0e6-d004daa64c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:35.654334 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0e39b-d240-40a7-b0e6-d004daa64c68 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:35.654608 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0e39b-d240-40a7-b0e6-d004daa64c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:35.656865 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0e39b-d240-40a7-b0e6-d004daa64c68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:35.656865 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a0e39b-d240-40a7-b0e6-d004daa64c68 None admin] RBAC: Adding query filter params (role.id=9252c356af254127896f3626d925a88a, scope.project.id=7162065dce1a49c7bbb37e0a6a14010b, user.id=cc917226ae67445280cad740154d13b7) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:35.656865 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a0e39b-d240-40a7-b0e6-d004daa64c68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:35.657288 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a0e39b-d240-40a7-b0e6-d004daa64c68 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:35.662748 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 452/905] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Nov 2 07:24:35 2022] GET /identity/v3/role_assignments?user.id=cc917226ae67445280cad740154d13b7&scope.project.id=7162065dce1a49c7bbb37e0a6a14010b&role.id=9252c356af254127896f3626d925a88a => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:24:45.512957 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=87 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:45.674409 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=5 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:46.764513 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90810e30-614a-494e-8fe4-177462a868f5 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:46.765223 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90810e30-614a-494e-8fe4-177462a868f5 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:46.765223 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90810e30-614a-494e-8fe4-177462a868f5 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:46.766339 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 454/906] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:25:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:46.771487 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5046453-4799-46f1-b87b-9ce6d0a1d410 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:46.775023 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5046453-4799-46f1-b87b-9ce6d0a1d410 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:46.775023 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5046453-4799-46f1-b87b-9ce6d0a1d410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:46.790244 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-e5046453-4799-46f1-b87b-9ce6d0a1d410 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:46.791422 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e5046453-4799-46f1-b87b-9ce6d0a1d410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:46.856284 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 453/907] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:25:47.130129 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90810e30-614a-494e-8fe4-177462a868f5 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:47.231444 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90810e30-614a-494e-8fe4-177462a868f5 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:47.265219 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94761171-908f-4bda-b779-38b9d16b5ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:47.265852 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94761171-908f-4bda-b779-38b9d16b5ab7 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:47.266123 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94761171-908f-4bda-b779-38b9d16b5ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:47.266388 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94761171-908f-4bda-b779-38b9d16b5ab7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:47.275981 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94761171-908f-4bda-b779-38b9d16b5ab7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:47.277431 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94761171-908f-4bda-b779-38b9d16b5ab7 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:47.291441 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-94761171-908f-4bda-b779-38b9d16b5ab7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:47.291441 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:47.291441 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:47.291441 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:47.291441 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:47.291441 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:47.291441 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:47.291441 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:47.291441 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:47.291441 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:47.291441 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:47.291441 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:47.291441 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:47.291441 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:47.291441 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:47.291441 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:47.292689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:47.292689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:47.292689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:47.292689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:47.292689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:47.292689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:47.292689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:47.292689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:47.292689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:47.292689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:47.292689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:47.292689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:47.292689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:47.292689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:47.292689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:47.292689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:47.292689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:47.293678 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:47.293678 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:47.293678 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:25:47.293678 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 455/908] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:47.299866 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5046453-4799-46f1-b87b-9ce6d0a1d410 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:47.395960 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5046453-4799-46f1-b87b-9ce6d0a1d410 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:47.424152 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:47.429835 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57838319-d5c6-46fd-9db9-7adcdb63f46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:47.430306 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57838319-d5c6-46fd-9db9-7adcdb63f46d None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:47.430585 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57838319-d5c6-46fd-9db9-7adcdb63f46d None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:47.430855 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57838319-d5c6-46fd-9db9-7adcdb63f46d None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:47.431479 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57838319-d5c6-46fd-9db9-7adcdb63f46d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:47.431775 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57838319-d5c6-46fd-9db9-7adcdb63f46d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:47.433150 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57838319-d5c6-46fd-9db9-7adcdb63f46d None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:47.444212 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 454/909] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:47.449908 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94761171-908f-4bda-b779-38b9d16b5ab7 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:47.502025 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:47.548943 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94761171-908f-4bda-b779-38b9d16b5ab7 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:47.582711 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf956c9a-b837-4db7-8eb6-669d5d55a6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:47.583305 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf956c9a-b837-4db7-8eb6-669d5d55a6ce None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:47.583581 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf956c9a-b837-4db7-8eb6-669d5d55a6ce None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:47.583867 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf956c9a-b837-4db7-8eb6-669d5d55a6ce None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:47.584523 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf956c9a-b837-4db7-8eb6-669d5d55a6ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:47.585941 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf956c9a-b837-4db7-8eb6-669d5d55a6ce None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:47.674950 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 456/910] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Nov 2 07:25:47 2022] POST /identity/v3/users => generated 251 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:25:49.890570 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9491972-e2c5-42f7-a4ad-17831537f0d5 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:49.891103 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9491972-e2c5-42f7-a4ad-17831537f0d5 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:49.891103 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9491972-e2c5-42f7-a4ad-17831537f0d5 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:49.892481 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 455/911] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:49.897770 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a6845-f14e-423a-bc2e-2e046c42b9b0 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:49.898535 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a6845-f14e-423a-bc2e-2e046c42b9b0 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:49.898535 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a6845-f14e-423a-bc2e-2e046c42b9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:49.916806 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-e33a6845-f14e-423a-bc2e-2e046c42b9b0 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:49.917976 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e33a6845-f14e-423a-bc2e-2e046c42b9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:49.986133 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 457/912] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:25:50.261456 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9491972-e2c5-42f7-a4ad-17831537f0d5 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:50.362486 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9491972-e2c5-42f7-a4ad-17831537f0d5 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:50.395522 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80eaf0e-b713-4784-bb6a-c8ad6cd64bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:50.396179 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80eaf0e-b713-4784-bb6a-c8ad6cd64bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:50.396457 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80eaf0e-b713-4784-bb6a-c8ad6cd64bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:50.396726 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80eaf0e-b713-4784-bb6a-c8ad6cd64bd3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:50.407071 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80eaf0e-b713-4784-bb6a-c8ad6cd64bd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:25:50.411864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-c80eaf0e-b713-4784-bb6a-c8ad6cd64bd3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:25:50.411864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:50.411864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:50.411864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:50.411864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:50.411864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:50.411864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:50.411864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:50.411864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:50.411864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:50.411864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:50.411864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:50.411864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:25:50.411864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:25:50.411864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:25:50.411864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:25:50.415548 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:25:50.415548 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:25:50.415548 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:25:50.415548 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:25:50.415548 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:50.415548 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:50.415548 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:50.415548 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:50.415548 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:50.415548 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:50.415548 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:50.415548 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:50.415548 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:50.415548 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:50.415548 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:50.415548 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:50.416707 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:50.416707 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:50.416707 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:50.416707 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:50.416707 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:25:50.416707 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:25:50.416707 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:25:50.416707 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:25:50.416707 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:25:50.416707 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:25:50.416707 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:25:50.416707 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:25:50.416707 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 456/913] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Nov 2 07:25:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:50.419057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a6845-f14e-423a-bc2e-2e046c42b9b0 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:50.457740 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:50.515430 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a6845-f14e-423a-bc2e-2e046c42b9b0 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:50.550034 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b45933-69f7-4b3f-ac43-2f81f1625f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:50.550639 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b45933-69f7-4b3f-ac43-2f81f1625f1a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:50.550913 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b45933-69f7-4b3f-ac43-2f81f1625f1a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:50.551180 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b45933-69f7-4b3f-ac43-2f81f1625f1a None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:50.551821 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b45933-69f7-4b3f-ac43-2f81f1625f1a None admin] RBAC: Adding query filter params (name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:50.552144 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b45933-69f7-4b3f-ac43-2f81f1625f1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:50.553500 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b45933-69f7-4b3f-ac43-2f81f1625f1a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:50.561143 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 458/914] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Nov 2 07:25:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:50.566867 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80eaf0e-b713-4784-bb6a-c8ad6cd64bd3 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:50.618455 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:50.666016 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80eaf0e-b713-4784-bb6a-c8ad6cd64bd3 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:50.700560 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2a8cf-0785-4925-af4e-966fa87633f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:50.701211 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2a8cf-0785-4925-af4e-966fa87633f1 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:50.702125 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2a8cf-0785-4925-af4e-966fa87633f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:50.702392 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2a8cf-0785-4925-af4e-966fa87633f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:50.711880 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2a8cf-0785-4925-af4e-966fa87633f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:50.713321 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2a8cf-0785-4925-af4e-966fa87633f1 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:50.730267 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-feb2a8cf-0785-4925-af4e-966fa87633f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:50.730267 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:50.730267 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:50.730267 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:50.730267 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:50.730267 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:50.730267 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:50.730267 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:50.730267 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:50.730267 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:50.730267 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:50.730267 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:50.730267 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:50.730267 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:50.730267 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:50.730267 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:50.731456 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:50.731456 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:50.731456 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:50.731456 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:50.731456 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:50.731456 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:50.731456 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:50.731456 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:50.731456 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:50.731456 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:50.731456 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:50.731456 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:50.731456 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:50.731456 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:50.731456 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:50.731456 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:50.731456 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:50.732615 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:50.732615 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:50.732615 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:25:50.732615 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 457/915] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:50.737295 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b45933-69f7-4b3f-ac43-2f81f1625f1a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:50.833155 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:50.835899 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b45933-69f7-4b3f-ac43-2f81f1625f1a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:50.870100 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2839a1a-16c1-4b9c-8a08-c26a2249c67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:50.870692 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2839a1a-16c1-4b9c-8a08-c26a2249c67c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:50.870969 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2839a1a-16c1-4b9c-8a08-c26a2249c67c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:50.871239 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2839a1a-16c1-4b9c-8a08-c26a2249c67c None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:50.871868 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2839a1a-16c1-4b9c-8a08-c26a2249c67c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:50.872205 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2839a1a-16c1-4b9c-8a08-c26a2249c67c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:50.876317 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2839a1a-16c1-4b9c-8a08-c26a2249c67c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:50.884915 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 459/916] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:50.891242 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2a8cf-0785-4925-af4e-966fa87633f1 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:50.989771 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2a8cf-0785-4925-af4e-966fa87633f1 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:50.991261 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:51.022436 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0cd25-1478-49ad-8c8c-c8857fc241f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:51.023051 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0cd25-1478-49ad-8c8c-c8857fc241f4 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:51.023326 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0cd25-1478-49ad-8c8c-c8857fc241f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:51.023596 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0cd25-1478-49ad-8c8c-c8857fc241f4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:51.031175 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f0cd25-1478-49ad-8c8c-c8857fc241f4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:51.032634 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f0cd25-1478-49ad-8c8c-c8857fc241f4 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:51.043580 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-04f0cd25-1478-49ad-8c8c-c8857fc241f4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 02 07:25:51.043580 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:51.043580 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:51.043580 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:51.043580 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:51.043580 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:51.043580 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:51.043580 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:51.043580 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:51.043580 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:51.043580 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:51.043580 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:51.043580 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:25:51.043580 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:25:51.043580 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:25:51.043580 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:25:51.044698 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:51.044698 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:51.044698 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:25:51.044698 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:51.044698 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:25:51.044698 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:51.044698 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:51.044698 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:51.044698 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:51.044698 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:51.044698 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:51.044698 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:51.044698 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:51.044698 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:51.044698 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:51.044698 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:51.044698 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:51.044698 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:51.045671 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:51.045671 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:51.045671 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:25:51.045671 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:25:51.045671 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:25:51.045671 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:25:51.045671 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:25:51.045671 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:25:51.045671 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Nov 02 07:25:51.045671 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:25:51.045671 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 458/917] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:51.050782 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2839a1a-16c1-4b9c-8a08-c26a2249c67c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:51.156462 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2839a1a-16c1-4b9c-8a08-c26a2249c67c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:51.189424 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4cbf8-e0bf-4836-8dde-a26b5e3cc038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:51.190016 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4cbf8-e0bf-4836-8dde-a26b5e3cc038 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:51.190290 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4cbf8-e0bf-4836-8dde-a26b5e3cc038 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:51.190555 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4cbf8-e0bf-4836-8dde-a26b5e3cc038 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:51.191259 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4cbf8-e0bf-4836-8dde-a26b5e3cc038 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:51.191556 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4cbf8-e0bf-4836-8dde-a26b5e3cc038 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:51.192997 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4cbf8-e0bf-4836-8dde-a26b5e3cc038 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:51.209946 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 460/918] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Nov 2 07:25:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:51.215828 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0cd25-1478-49ad-8c8c-c8857fc241f4 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:51.315337 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0cd25-1478-49ad-8c8c-c8857fc241f4 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:51.348584 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb88a90-b214-4ea2-a67a-45d36a53cd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:51.349208 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb88a90-b214-4ea2-a67a-45d36a53cd3d None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:51.349484 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb88a90-b214-4ea2-a67a-45d36a53cd3d None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:51.349754 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb88a90-b214-4ea2-a67a-45d36a53cd3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:51.360033 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb88a90-b214-4ea2-a67a-45d36a53cd3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:51.361468 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb88a90-b214-4ea2-a67a-45d36a53cd3d None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:51.375835 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-deb88a90-b214-4ea2-a67a-45d36a53cd3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:51.375835 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:51.375835 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:51.375835 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:51.375835 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:51.375835 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:51.375835 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:51.375835 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:51.375835 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:51.375835 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:51.375835 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:51.375835 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:51.375835 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:51.375835 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:51.375835 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:51.375835 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:51.376972 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:51.376972 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:51.376972 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:51.376972 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:51.376972 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:51.376972 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:51.376972 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:51.376972 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:51.376972 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:51.376972 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:51.376972 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:51.376972 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:51.376972 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:51.376972 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:51.376972 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:51.376972 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:51.376972 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:51.377856 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:51.377856 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:51.377856 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:25:51.377856 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 459/919] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:51.382735 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4cbf8-e0bf-4836-8dde-a26b5e3cc038 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:51.402152 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:51.481515 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4cbf8-e0bf-4836-8dde-a26b5e3cc038 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:51.515939 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7f2c7-1fa5-4c57-aa75-98d3ffe080b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:51.516564 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7f2c7-1fa5-4c57-aa75-98d3ffe080b0 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:51.516837 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7f2c7-1fa5-4c57-aa75-98d3ffe080b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:51.517104 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7f2c7-1fa5-4c57-aa75-98d3ffe080b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:51.517723 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7f2c7-1fa5-4c57-aa75-98d3ffe080b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:51.518017 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7f2c7-1fa5-4c57-aa75-98d3ffe080b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:51.519370 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7f2c7-1fa5-4c57-aa75-98d3ffe080b0 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:51.530115 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 461/920] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:51.535909 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb88a90-b214-4ea2-a67a-45d36a53cd3d None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:51.552373 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:51.634172 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb88a90-b214-4ea2-a67a-45d36a53cd3d None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:51.668939 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb74cf-ccb3-41ac-8414-ebed1e210ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:51.669557 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb74cf-ccb3-41ac-8414-ebed1e210ac3 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:51.669834 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb74cf-ccb3-41ac-8414-ebed1e210ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:51.670102 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb74cf-ccb3-41ac-8414-ebed1e210ac3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:51.677197 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb74cf-ccb3-41ac-8414-ebed1e210ac3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:51.678599 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb74cf-ccb3-41ac-8414-ebed1e210ac3 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:51.690006 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-99cb74cf-ccb3-41ac-8414-ebed1e210ac3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:51.690006 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:51.690006 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:51.690006 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:51.690006 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:51.690006 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:51.690006 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:51.690006 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:51.690006 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:51.690006 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:51.690006 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:51.690006 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:51.690006 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:25:51.690006 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:25:51.690006 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:25:51.691070 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:25:51.691070 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:51.691070 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:51.691070 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:51.691070 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:51.691070 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:51.691070 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:51.691070 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:51.691070 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:51.691070 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:51.691070 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:51.691070 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:51.691070 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:51.691070 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:51.691070 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:51.691070 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:51.691070 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:51.692505 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:25:51.692505 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:25:51.692505 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:25:51.692505 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:25:51.692505 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:25:51.692505 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:25:51.692505 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:51.692505 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:25:51.692505 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 460/921] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Nov 2 07:25:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:51.697084 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7f2c7-1fa5-4c57-aa75-98d3ffe080b0 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:51.774438 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:51.794986 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7f2c7-1fa5-4c57-aa75-98d3ffe080b0 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:51.829534 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830f818-54b6-44ca-b882-7d49b3af225f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:51.830133 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830f818-54b6-44ca-b882-7d49b3af225f None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:51.830410 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830f818-54b6-44ca-b882-7d49b3af225f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:51.830679 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830f818-54b6-44ca-b882-7d49b3af225f None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:51.831357 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830f818-54b6-44ca-b882-7d49b3af225f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:51.831656 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830f818-54b6-44ca-b882-7d49b3af225f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:51.833104 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830f818-54b6-44ca-b882-7d49b3af225f None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:51.845934 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 462/922] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Nov 2 07:25:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:51.852328 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb74cf-ccb3-41ac-8414-ebed1e210ac3 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:51.932617 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:51.958853 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb74cf-ccb3-41ac-8414-ebed1e210ac3 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:51.992627 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f95a36-fd3a-4a3a-ae40-35cfb07cf96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:51.993281 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f95a36-fd3a-4a3a-ae40-35cfb07cf96b None admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:51.993604 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f95a36-fd3a-4a3a-ae40-35cfb07cf96b None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:51.993876 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f95a36-fd3a-4a3a-ae40-35cfb07cf96b None admin] PATH_INFO: `/v3/projects/2c3bf3e930dd407f8401c0487edc8c20/users/741c9fc71c80438faa037c85f4997c3e/roles/4d61be0c9e7b454abd3b0a3330428290` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:52.008494 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f95a36-fd3a-4a3a-ae40-35cfb07cf96b None admin] RBAC: Authorizing `identity:create_grant(project_id=2c3bf3e930dd407f8401c0487edc8c20, user_id=741c9fc71c80438faa037c85f4997c3e, role_id=4d61be0c9e7b454abd3b0a3330428290)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:52.010182 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f95a36-fd3a-4a3a-ae40-35cfb07cf96b None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:52.093466 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 461/923] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Nov 2 07:25:51 2022] PUT /identity/v3/projects/2c3bf3e930dd407f8401c0487edc8c20/users/741c9fc71c80438faa037c85f4997c3e/roles/4d61be0c9e7b454abd3b0a3330428290 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:25:54.248875 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1c9f7-eaa0-4362-85e7-510bee6dfc74 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:54.249471 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1c9f7-eaa0-4362-85e7-510bee6dfc74 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:54.249471 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1c9f7-eaa0-4362-85e7-510bee6dfc74 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:54.250707 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 463/924] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:25:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:54.256071 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92e92e-65b9-4802-86f8-77fe14e71b4b None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:54.256536 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92e92e-65b9-4802-86f8-77fe14e71b4b None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:54.256665 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92e92e-65b9-4802-86f8-77fe14e71b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:54.275458 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-8c92e92e-65b9-4802-86f8-77fe14e71b4b None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:54.276680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-8c92e92e-65b9-4802-86f8-77fe14e71b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:54.340824 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 462/925] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:25:54.614107 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1c9f7-eaa0-4362-85e7-510bee6dfc74 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:54.715344 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1c9f7-eaa0-4362-85e7-510bee6dfc74 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:54.748519 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9f39d-6cb6-4688-b4bc-fbde91e82ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:54.749132 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9f39d-6cb6-4688-b4bc-fbde91e82ab4 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:54.749408 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9f39d-6cb6-4688-b4bc-fbde91e82ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:54.749678 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9f39d-6cb6-4688-b4bc-fbde91e82ab4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:54.756162 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:54.760291 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9f39d-6cb6-4688-b4bc-fbde91e82ab4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:25:54.765569 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-72f9f39d-6cb6-4688-b4bc-fbde91e82ab4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:25:54.765569 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:54.765569 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:54.765569 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:54.765569 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:54.765569 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:54.765569 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:54.765569 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:54.765569 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:54.765569 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:54.765569 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:54.765569 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:54.765569 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:25:54.765569 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:25:54.765569 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:25:54.765569 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:25:54.766699 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:25:54.766699 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:25:54.766699 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:25:54.766699 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:25:54.766699 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:54.766699 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:54.766699 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:54.766699 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:54.766699 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:54.766699 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:54.766699 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:54.766699 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:54.766699 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:54.766699 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:54.766699 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:54.766699 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:54.767573 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:54.767573 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:54.767573 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:54.767573 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:54.767573 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:25:54.767573 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:25:54.767573 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:25:54.767573 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:25:54.767573 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:25:54.767573 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:25:54.767573 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:25:54.767573 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:25:54.767573 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 464/926] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Nov 2 07:25:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:54.773038 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92e92e-65b9-4802-86f8-77fe14e71b4b None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:54.826027 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:54.867691 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92e92e-65b9-4802-86f8-77fe14e71b4b None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:54.900842 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e10af-d667-433c-a428-3e1d791022ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:54.901437 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e10af-d667-433c-a428-3e1d791022ad None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:54.901713 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e10af-d667-433c-a428-3e1d791022ad None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:54.902047 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e10af-d667-433c-a428-3e1d791022ad None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:54.902646 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e10af-d667-433c-a428-3e1d791022ad None admin] RBAC: Adding query filter params (name=service) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:54.902946 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e10af-d667-433c-a428-3e1d791022ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:54.904319 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e10af-d667-433c-a428-3e1d791022ad None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:54.912327 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 463/927] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Nov 2 07:25:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:54.918362 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9f39d-6cb6-4688-b4bc-fbde91e82ab4 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:55.019116 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9f39d-6cb6-4688-b4bc-fbde91e82ab4 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:55.052513 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80fba5-a038-41fe-9175-ba81d07decbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:55.053129 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80fba5-a038-41fe-9175-ba81d07decbb None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:55.053424 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80fba5-a038-41fe-9175-ba81d07decbb None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:55.053675 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80fba5-a038-41fe-9175-ba81d07decbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:55.063922 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80fba5-a038-41fe-9175-ba81d07decbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:55.065395 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80fba5-a038-41fe-9175-ba81d07decbb None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:55.080362 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-2b80fba5-a038-41fe-9175-ba81d07decbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:55.080362 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:55.080362 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:55.080362 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:55.080362 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:55.080362 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:55.080362 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:55.080362 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:55.080362 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:55.080362 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:55.080362 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:55.080362 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:55.080362 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:55.080362 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:55.080362 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:55.080362 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:55.081486 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:55.081486 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:55.081486 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:55.081486 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:55.081486 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:55.081486 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:55.081486 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:55.081486 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:55.081486 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:55.081486 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:55.081486 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:55.081486 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:55.081486 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:55.081486 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:55.081486 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:55.081486 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:55.081486 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:55.082585 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:55.082585 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:55.082585 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:25:55.082585 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 465/928] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:25:55.087372 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e10af-d667-433c-a428-3e1d791022ad None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:55.185159 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e10af-d667-433c-a428-3e1d791022ad None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:55.201051 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:55.218363 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5002ac6-2de6-4670-9951-be6e1ed51b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:55.223979 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5002ac6-2de6-4670-9951-be6e1ed51b4d None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:55.223979 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5002ac6-2de6-4670-9951-be6e1ed51b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:55.223979 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5002ac6-2de6-4670-9951-be6e1ed51b4d None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:55.223979 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5002ac6-2de6-4670-9951-be6e1ed51b4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:55.223979 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5002ac6-2de6-4670-9951-be6e1ed51b4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:55.223979 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5002ac6-2de6-4670-9951-be6e1ed51b4d None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:55.233288 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 464/929] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:55.238921 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80fba5-a038-41fe-9175-ba81d07decbb None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:55.288582 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:55.339732 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80fba5-a038-41fe-9175-ba81d07decbb None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:55.373029 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebeaa03-5ef7-4eb4-a36c-9f726d030919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:55.373885 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebeaa03-5ef7-4eb4-a36c-9f726d030919 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:55.374163 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebeaa03-5ef7-4eb4-a36c-9f726d030919 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:55.374444 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebeaa03-5ef7-4eb4-a36c-9f726d030919 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:55.381555 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebeaa03-5ef7-4eb4-a36c-9f726d030919 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:55.383039 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebeaa03-5ef7-4eb4-a36c-9f726d030919 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:55.394617 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-7ebeaa03-5ef7-4eb4-a36c-9f726d030919 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 02 07:25:55.394617 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:55.394617 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:55.394617 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:55.394617 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:55.394617 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:55.394617 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:55.394617 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:55.394617 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:55.394617 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:55.394617 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:55.394617 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:55.394617 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:25:55.394617 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:25:55.394617 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:25:55.394617 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:25:55.397332 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:55.397332 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:55.397332 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:25:55.397332 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:55.397332 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:25:55.397332 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:55.397332 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:55.397332 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:55.397332 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:55.397332 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:55.397332 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:55.397332 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:55.397332 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:55.397332 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:55.397332 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:55.397332 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:55.397332 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:55.397332 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:55.398346 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:55.398346 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:55.398346 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:25:55.398346 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:25:55.398346 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:25:55.398346 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:25:55.398346 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:25:55.398346 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:25:55.398346 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Nov 02 07:25:55.398346 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:25:55.398346 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 466/930] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:55.401637 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5002ac6-2de6-4670-9951-be6e1ed51b4d None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:55.499406 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5002ac6-2de6-4670-9951-be6e1ed51b4d None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:55.532429 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f9ea52-9141-4afa-84cd-5536a046ef1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:55.533018 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9ea52-9141-4afa-84cd-5536a046ef1a None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:55.533291 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9ea52-9141-4afa-84cd-5536a046ef1a None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:55.533554 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9ea52-9141-4afa-84cd-5536a046ef1a None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:55.534251 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f9ea52-9141-4afa-84cd-5536a046ef1a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:55.534548 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f9ea52-9141-4afa-84cd-5536a046ef1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:55.535978 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f9ea52-9141-4afa-84cd-5536a046ef1a None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:55.552627 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 465/931] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Nov 2 07:25:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:55.558387 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebeaa03-5ef7-4eb4-a36c-9f726d030919 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:55.659114 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebeaa03-5ef7-4eb4-a36c-9f726d030919 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:55.669260 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:55.693097 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed10241-3ad6-406f-8813-6dbda54d1da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:55.693697 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed10241-3ad6-406f-8813-6dbda54d1da5 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:55.693974 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed10241-3ad6-406f-8813-6dbda54d1da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:55.694247 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed10241-3ad6-406f-8813-6dbda54d1da5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:55.758973 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed10241-3ad6-406f-8813-6dbda54d1da5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:55.760661 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed10241-3ad6-406f-8813-6dbda54d1da5 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:55.858986 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 467/932] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Nov 2 07:25:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 07:25:55.864900 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f9ea52-9141-4afa-84cd-5536a046ef1a None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:55.898705 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:55.962210 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f9ea52-9141-4afa-84cd-5536a046ef1a None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:55.995979 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814f4fd-fbec-4806-9eda-8af904cf82f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:55.996626 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814f4fd-fbec-4806-9eda-8af904cf82f6 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:55.996897 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814f4fd-fbec-4806-9eda-8af904cf82f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:55.997161 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814f4fd-fbec-4806-9eda-8af904cf82f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:56.007276 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814f4fd-fbec-4806-9eda-8af904cf82f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:56.008719 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814f4fd-fbec-4806-9eda-8af904cf82f6 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:56.023028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-a814f4fd-fbec-4806-9eda-8af904cf82f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:56.023028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:56.023028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:56.023028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:56.023028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:56.023028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:56.023028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:56.023028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:56.023028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:56.023028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:56.023028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:56.023028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:56.023028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:56.023028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:56.023028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:56.023028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:56.023948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:56.023948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:56.023948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:56.023948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:56.023948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:56.023948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:56.023948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:56.023948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:56.023948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:56.023948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:56.023948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:56.023948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:56.023948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:56.023948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:56.023948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:56.023948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:56.023948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:56.024878 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:56.024878 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:56.024878 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:25:56.024878 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 466/933] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:56.029707 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed10241-3ad6-406f-8813-6dbda54d1da5 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:56.041008 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:56.128308 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed10241-3ad6-406f-8813-6dbda54d1da5 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:56.161214 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f81d1-4fa2-4bd4-926c-14ac5152018e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:56.161806 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f81d1-4fa2-4bd4-926c-14ac5152018e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:56.162081 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f81d1-4fa2-4bd4-926c-14ac5152018e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:56.162348 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f81d1-4fa2-4bd4-926c-14ac5152018e None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:56.162969 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f81d1-4fa2-4bd4-926c-14ac5152018e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:56.163266 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f81d1-4fa2-4bd4-926c-14ac5152018e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:56.164654 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f81d1-4fa2-4bd4-926c-14ac5152018e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:56.176005 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 468/934] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:56.181716 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814f4fd-fbec-4806-9eda-8af904cf82f6 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:56.263593 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:56.277784 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814f4fd-fbec-4806-9eda-8af904cf82f6 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:56.309500 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2f39e-3f6f-4d92-a989-e994cdba9e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:56.310108 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2f39e-3f6f-4d92-a989-e994cdba9e6c None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:56.310380 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2f39e-3f6f-4d92-a989-e994cdba9e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:56.310645 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2f39e-3f6f-4d92-a989-e994cdba9e6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:56.317409 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e2f39e-3f6f-4d92-a989-e994cdba9e6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:56.318815 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e2f39e-3f6f-4d92-a989-e994cdba9e6c None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:56.329401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-c4e2f39e-3f6f-4d92-a989-e994cdba9e6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:56.329401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:56.329401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:56.329401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:56.329401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:56.329401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:56.329401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:56.329401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:56.329401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:56.329401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:56.329401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:56.329401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:56.329401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:25:56.329401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:25:56.329401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:25:56.330476 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:25:56.330476 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:56.330476 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:56.330476 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:56.330476 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:56.330476 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:56.330476 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:56.330476 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:56.330476 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:56.330476 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:56.330476 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:56.330476 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:56.330476 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:56.330476 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:56.330476 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:56.330476 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:56.330476 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:56.331458 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:25:56.331458 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:25:56.331458 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:25:56.331458 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:25:56.331458 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:25:56.331458 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:25:56.331458 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:56.331458 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:25:56.331458 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 467/935] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Nov 2 07:25:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:56.336371 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f81d1-4fa2-4bd4-926c-14ac5152018e None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:56.404324 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:56.434436 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f81d1-4fa2-4bd4-926c-14ac5152018e None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:56.467032 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b1982-ee4b-4199-81a6-4af53bc33d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:56.468266 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b1982-ee4b-4199-81a6-4af53bc33d3d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:56.468544 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b1982-ee4b-4199-81a6-4af53bc33d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:56.468814 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b1982-ee4b-4199-81a6-4af53bc33d3d None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:56.469485 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b1982-ee4b-4199-81a6-4af53bc33d3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:56.469784 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b1982-ee4b-4199-81a6-4af53bc33d3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:56.471197 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b1982-ee4b-4199-81a6-4af53bc33d3d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:56.483796 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 469/936] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Nov 2 07:25:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:56.489817 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2f39e-3f6f-4d92-a989-e994cdba9e6c None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:56.584517 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2f39e-3f6f-4d92-a989-e994cdba9e6c None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:56.617847 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9ff7c-02d3-4d9a-8af3-6d568fe801f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:56.618438 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9ff7c-02d3-4d9a-8af3-6d568fe801f1 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:56.618719 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9ff7c-02d3-4d9a-8af3-6d568fe801f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:56.618989 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9ff7c-02d3-4d9a-8af3-6d568fe801f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:56.619691 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c9ff7c-02d3-4d9a-8af3-6d568fe801f1 None admin] RBAC: Adding query filter params (role.id=4d61be0c9e7b454abd3b0a3330428290, scope.project.id=2c3bf3e930dd407f8401c0487edc8c20, user.id=741c9fc71c80438faa037c85f4997c3e) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:56.619995 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c9ff7c-02d3-4d9a-8af3-6d568fe801f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:56.621428 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c9ff7c-02d3-4d9a-8af3-6d568fe801f1 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:56.627318 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 468/937] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Nov 2 07:25:56 2022] GET /identity/v3/role_assignments?user.id=741c9fc71c80438faa037c85f4997c3e&scope.project.id=2c3bf3e930dd407f8401c0487edc8c20&role.id=4d61be0c9e7b454abd3b0a3330428290 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:58.775294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42547b-2db9-4182-b87f-afdc3aca06cc None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:58.775865 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42547b-2db9-4182-b87f-afdc3aca06cc None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:58.775865 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42547b-2db9-4182-b87f-afdc3aca06cc None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:58.777223 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 470/938] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:58.783243 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a4513-b72a-4343-bfcc-29f948c43b2d None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:58.783667 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a4513-b72a-4343-bfcc-29f948c43b2d None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:58.783784 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a4513-b72a-4343-bfcc-29f948c43b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:58.803153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-cd7a4513-b72a-4343-bfcc-29f948c43b2d None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:58.804401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-cd7a4513-b72a-4343-bfcc-29f948c43b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:58.807119 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:58.868334 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 469/939] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:25:59.137438 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42547b-2db9-4182-b87f-afdc3aca06cc None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:59.239357 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42547b-2db9-4182-b87f-afdc3aca06cc None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:59.267276 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:59.272773 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417cc3b-39e7-46bc-a948-b9eab9e5e6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:59.273388 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417cc3b-39e7-46bc-a948-b9eab9e5e6e2 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:59.273662 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417cc3b-39e7-46bc-a948-b9eab9e5e6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:59.273931 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417cc3b-39e7-46bc-a948-b9eab9e5e6e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:59.284222 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a417cc3b-39e7-46bc-a948-b9eab9e5e6e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:25:59.288843 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-a417cc3b-39e7-46bc-a948-b9eab9e5e6e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:25:59.288843 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:59.288843 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:59.288843 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:59.288843 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:59.288843 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:59.288843 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:59.288843 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:59.288843 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:59.288843 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:59.288843 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:59.288843 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:59.288843 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:25:59.288843 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:25:59.288843 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:25:59.288843 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:25:59.289951 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:25:59.289951 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:25:59.289951 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:25:59.289951 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:25:59.289951 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:59.289951 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:59.289951 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:59.289951 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:59.289951 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:59.289951 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:59.289951 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:59.289951 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:59.289951 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:59.289951 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:59.289951 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:59.289951 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:59.290968 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:59.290968 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:59.290968 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:59.290968 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:59.290968 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:25:59.290968 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:25:59.290968 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:25:59.290968 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:25:59.290968 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:25:59.290968 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:25:59.290968 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:25:59.290968 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:25:59.290968 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 471/940] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Nov 2 07:25:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:59.295946 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a4513-b72a-4343-bfcc-29f948c43b2d None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:59.391433 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a4513-b72a-4343-bfcc-29f948c43b2d None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:59.423053 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c48759e-2931-4f0d-aa89-05c87cde695a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:59.423640 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48759e-2931-4f0d-aa89-05c87cde695a None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:59.423912 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48759e-2931-4f0d-aa89-05c87cde695a None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:59.424206 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48759e-2931-4f0d-aa89-05c87cde695a None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:59.424844 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c48759e-2931-4f0d-aa89-05c87cde695a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:59.425140 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c48759e-2931-4f0d-aa89-05c87cde695a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:59.426469 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c48759e-2931-4f0d-aa89-05c87cde695a None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:59.434034 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 470/941] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Nov 2 07:25:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:59.440588 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417cc3b-39e7-46bc-a948-b9eab9e5e6e2 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:59.537962 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417cc3b-39e7-46bc-a948-b9eab9e5e6e2 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:59.573251 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc83832-5f0d-45bb-89a2-e66ce69f4c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:59.581103 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc83832-5f0d-45bb-89a2-e66ce69f4c14 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:59.581103 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc83832-5f0d-45bb-89a2-e66ce69f4c14 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:59.581103 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc83832-5f0d-45bb-89a2-e66ce69f4c14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:59.586849 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc83832-5f0d-45bb-89a2-e66ce69f4c14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:59.588319 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc83832-5f0d-45bb-89a2-e66ce69f4c14 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:59.602846 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-2bc83832-5f0d-45bb-89a2-e66ce69f4c14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:59.602846 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:59.602846 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:59.602846 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:59.602846 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:59.602846 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:59.602846 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:59.602846 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:59.602846 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:59.602846 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:59.602846 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:59.602846 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:59.602846 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:59.602846 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:59.602846 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:59.602846 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:59.603942 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:59.603942 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:59.603942 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:59.603942 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:59.603942 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:59.603942 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:59.603942 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:59.603942 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:59.603942 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:59.603942 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:59.603942 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:59.603942 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:59.603942 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:59.603942 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:59.603942 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:59.603942 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:59.603942 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:59.604853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:59.604853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:59.604853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:25:59.604853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 472/942] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:59.611311 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c48759e-2931-4f0d-aa89-05c87cde695a None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:59.615824 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:59.707512 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c48759e-2931-4f0d-aa89-05c87cde695a None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:59.740895 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879d794-51a5-4863-a7af-102767ec4d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:59.741490 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879d794-51a5-4863-a7af-102767ec4d10 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:59.741763 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879d794-51a5-4863-a7af-102767ec4d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:59.742029 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879d794-51a5-4863-a7af-102767ec4d10 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:59.742730 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879d794-51a5-4863-a7af-102767ec4d10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:59.743029 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879d794-51a5-4863-a7af-102767ec4d10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:59.744742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879d794-51a5-4863-a7af-102767ec4d10 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:59.757382 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 471/943] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:59.763436 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc83832-5f0d-45bb-89a2-e66ce69f4c14 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:59.806316 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:59.863063 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc83832-5f0d-45bb-89a2-e66ce69f4c14 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:59.903297 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03446f84-9936-4ba6-9aa5-26f8e04a8524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:59.903918 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03446f84-9936-4ba6-9aa5-26f8e04a8524 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:59.904228 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03446f84-9936-4ba6-9aa5-26f8e04a8524 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:59.904498 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03446f84-9936-4ba6-9aa5-26f8e04a8524 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:59.911498 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03446f84-9936-4ba6-9aa5-26f8e04a8524 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:59.912954 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03446f84-9936-4ba6-9aa5-26f8e04a8524 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:59.925512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-03446f84-9936-4ba6-9aa5-26f8e04a8524 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 02 07:25:59.925512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:59.925512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:59.925512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:59.925512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:59.925512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:59.925512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:59.925512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:59.925512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:59.925512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:59.925512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:59.925512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:59.925512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:25:59.925512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:25:59.925512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:25:59.925512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:25:59.926661 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:59.926661 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:59.926661 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:25:59.926661 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:59.926661 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:25:59.926661 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:59.926661 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:59.926661 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:59.926661 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:59.926661 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:59.926661 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:59.926661 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:59.926661 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:59.926661 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:59.926661 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:59.926661 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:59.926661 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:59.926661 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:59.927796 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:59.927796 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:59.927796 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:25:59.927796 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:25:59.927796 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:25:59.927796 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:25:59.927796 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:25:59.927796 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:25:59.927796 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Nov 02 07:25:59.927796 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:25:59.927796 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 473/944] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:59.932402 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879d794-51a5-4863-a7af-102767ec4d10 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:59.992736 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:00.030399 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879d794-51a5-4863-a7af-102767ec4d10 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:00.063507 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9cff9-7997-43b7-9fb9-61c863cae935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:00.064153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9cff9-7997-43b7-9fb9-61c863cae935 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:00.064426 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9cff9-7997-43b7-9fb9-61c863cae935 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:00.064689 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9cff9-7997-43b7-9fb9-61c863cae935 None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:00.065392 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9cff9-7997-43b7-9fb9-61c863cae935 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:00.065690 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9cff9-7997-43b7-9fb9-61c863cae935 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:00.067080 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9cff9-7997-43b7-9fb9-61c863cae935 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:00.083281 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 472/945] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Nov 2 07:25:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:00.089182 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03446f84-9936-4ba6-9aa5-26f8e04a8524 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:00.188632 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03446f84-9936-4ba6-9aa5-26f8e04a8524 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:00.190164 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:00.221658 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4362b31-9122-44f4-9014-dede5cfbd6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:00.222583 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4362b31-9122-44f4-9014-dede5cfbd6aa None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:00.222858 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4362b31-9122-44f4-9014-dede5cfbd6aa None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:00.223122 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4362b31-9122-44f4-9014-dede5cfbd6aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:00.232534 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4362b31-9122-44f4-9014-dede5cfbd6aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:00.234569 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4362b31-9122-44f4-9014-dede5cfbd6aa None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:00.248482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-e4362b31-9122-44f4-9014-dede5cfbd6aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:26:00.248482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:00.248482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:26:00.248482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:26:00.248482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:26:00.248482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:26:00.248482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:26:00.248482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:26:00.248482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:26:00.248482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:26:00.248482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:26:00.248482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:26:00.248482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:26:00.248482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:26:00.248482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:26:00.248482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:26:00.249605 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:26:00.249605 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:26:00.249605 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:26:00.249605 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:26:00.249605 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:26:00.249605 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:26:00.249605 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:26:00.249605 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:26:00.249605 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:26:00.249605 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:26:00.249605 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:26:00.249605 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:26:00.249605 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:26:00.249605 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:26:00.249605 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:26:00.249605 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:26:00.249605 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:26:00.250481 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:26:00.250481 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:26:00.250481 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:26:00.250481 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 474/946] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:26:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:26:00.255437 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9cff9-7997-43b7-9fb9-61c863cae935 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:00.355821 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9cff9-7997-43b7-9fb9-61c863cae935 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:00.376433 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:00.391080 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273a073-6b36-44ec-8cab-fb4da71446ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:00.391694 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273a073-6b36-44ec-8cab-fb4da71446ad None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:00.391973 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273a073-6b36-44ec-8cab-fb4da71446ad None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:00.392349 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273a073-6b36-44ec-8cab-fb4da71446ad None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:00.392979 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b273a073-6b36-44ec-8cab-fb4da71446ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:00.393327 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b273a073-6b36-44ec-8cab-fb4da71446ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:00.394673 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b273a073-6b36-44ec-8cab-fb4da71446ad None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:00.406686 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 473/947] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:00.412238 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4362b31-9122-44f4-9014-dede5cfbd6aa None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:00.508925 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4362b31-9122-44f4-9014-dede5cfbd6aa None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:00.542149 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da452e4-9b50-4d83-b264-2782275f1fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:00.542766 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da452e4-9b50-4d83-b264-2782275f1fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:00.543040 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da452e4-9b50-4d83-b264-2782275f1fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:00.543312 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da452e4-9b50-4d83-b264-2782275f1fd7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:00.550010 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da452e4-9b50-4d83-b264-2782275f1fd7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:00.551442 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da452e4-9b50-4d83-b264-2782275f1fd7 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:00.562285 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-9da452e4-9b50-4d83-b264-2782275f1fd7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:26:00.562285 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:00.562285 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:26:00.562285 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:26:00.562285 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:26:00.562285 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:26:00.562285 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:26:00.562285 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:26:00.562285 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:26:00.562285 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:26:00.562285 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:26:00.562285 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:26:00.562285 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:26:00.562285 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:26:00.562285 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:26:00.563218 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:26:00.563218 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:26:00.563218 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:26:00.563218 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:26:00.563218 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:26:00.563218 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:26:00.563218 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:26:00.563218 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:26:00.563218 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:26:00.563218 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:26:00.563218 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:26:00.563218 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:26:00.563218 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:26:00.563218 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:26:00.563218 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:26:00.563218 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:26:00.563218 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:26:00.564492 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:26:00.564492 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:26:00.564492 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:26:00.564492 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:26:00.564492 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:26:00.564492 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:26:00.564492 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:26:00.564492 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:26:00.564492 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 475/948] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Nov 2 07:26:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:26:00.569273 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273a073-6b36-44ec-8cab-fb4da71446ad None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:00.669049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273a073-6b36-44ec-8cab-fb4da71446ad None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:00.702243 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd60934-b512-41f2-8871-7d8862f0f265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:00.702859 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd60934-b512-41f2-8871-7d8862f0f265 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:00.703136 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd60934-b512-41f2-8871-7d8862f0f265 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:00.703427 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd60934-b512-41f2-8871-7d8862f0f265 None admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:00.704145 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd60934-b512-41f2-8871-7d8862f0f265 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:00.704448 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd60934-b512-41f2-8871-7d8862f0f265 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:00.705844 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd60934-b512-41f2-8871-7d8862f0f265 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:00.717927 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 474/949] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Nov 2 07:26:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:00.724167 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da452e4-9b50-4d83-b264-2782275f1fd7 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:00.740678 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:00.822315 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da452e4-9b50-4d83-b264-2782275f1fd7 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:00.855968 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567f378-316b-40d8-8e4d-2bc5b9f28177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:00.856629 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567f378-316b-40d8-8e4d-2bc5b9f28177 None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:00.856902 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567f378-316b-40d8-8e4d-2bc5b9f28177 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:00.857168 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567f378-316b-40d8-8e4d-2bc5b9f28177 None admin] PATH_INFO: `/v3/projects/2c3bf3e930dd407f8401c0487edc8c20/users/741c9fc71c80438faa037c85f4997c3e/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:00.859041 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4567f378-316b-40d8-8e4d-2bc5b9f28177 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c3bf3e930dd407f8401c0487edc8c20, user_id=741c9fc71c80438faa037c85f4997c3e, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:00.860486 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4567f378-316b-40d8-8e4d-2bc5b9f28177 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:00.959671 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 476/950] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Nov 2 07:26:00 2022] PUT /identity/v3/projects/2c3bf3e930dd407f8401c0487edc8c20/users/741c9fc71c80438faa037c85f4997c3e/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:26:03.108711 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78579d5f-6ac6-4da8-9adc-33644221e43d None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:03.109315 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78579d5f-6ac6-4da8-9adc-33644221e43d None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:03.109315 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78579d5f-6ac6-4da8-9adc-33644221e43d None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:03.110558 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 475/951] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:26:03.115839 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56bd1c-9dcc-4c93-acdf-2b1f1498b395 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:03.117549 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56bd1c-9dcc-4c93-acdf-2b1f1498b395 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:03.117549 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56bd1c-9dcc-4c93-acdf-2b1f1498b395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:03.134625 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-5a56bd1c-9dcc-4c93-acdf-2b1f1498b395 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:03.136078 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5a56bd1c-9dcc-4c93-acdf-2b1f1498b395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:03.209680 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 477/952] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:26:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:26:03.485059 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78579d5f-6ac6-4da8-9adc-33644221e43d None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:03.526929 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:03.584531 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78579d5f-6ac6-4da8-9adc-33644221e43d None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:03.618064 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a68b98-3916-465b-b04d-56efdcbcbac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:03.618677 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a68b98-3916-465b-b04d-56efdcbcbac2 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:03.618954 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a68b98-3916-465b-b04d-56efdcbcbac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:03.619222 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a68b98-3916-465b-b04d-56efdcbcbac2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:03.629245 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a68b98-3916-465b-b04d-56efdcbcbac2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:26:03.633967 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-94a68b98-3916-465b-b04d-56efdcbcbac2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:26:03.633967 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:03.633967 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:26:03.633967 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:26:03.633967 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:26:03.633967 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:26:03.633967 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:26:03.633967 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:26:03.633967 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:26:03.633967 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:26:03.633967 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:26:03.633967 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:26:03.633967 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:26:03.633967 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:26:03.633967 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:26:03.633967 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:26:03.635324 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:26:03.635324 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:26:03.635324 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:26:03.635324 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:26:03.635324 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:26:03.635324 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:26:03.635324 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:26:03.635324 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:26:03.635324 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:26:03.635324 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:26:03.635324 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:26:03.635324 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:26:03.635324 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:26:03.635324 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:26:03.635324 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:26:03.635324 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:26:03.636427 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:26:03.636427 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:26:03.636427 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:26:03.636427 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:26:03.636427 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:26:03.636427 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:26:03.636427 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:26:03.636427 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:26:03.636427 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:26:03.636427 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:26:03.636427 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:26:03.636427 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:26:03.636427 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 476/953] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Nov 2 07:26:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:26:03.642300 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56bd1c-9dcc-4c93-acdf-2b1f1498b395 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:03.645342 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:03.736544 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56bd1c-9dcc-4c93-acdf-2b1f1498b395 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:03.770481 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9196e-459a-4f15-9336-7a4b0762738b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:03.771080 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9196e-459a-4f15-9336-7a4b0762738b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:03.771354 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9196e-459a-4f15-9336-7a4b0762738b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:03.771623 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9196e-459a-4f15-9336-7a4b0762738b None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:03.772290 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9196e-459a-4f15-9336-7a4b0762738b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:03.772587 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9196e-459a-4f15-9336-7a4b0762738b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:03.773992 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9196e-459a-4f15-9336-7a4b0762738b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:03.782497 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 478/954] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Nov 2 07:26:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:03.788301 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a68b98-3916-465b-b04d-56efdcbcbac2 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:03.882956 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:03.886084 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a68b98-3916-465b-b04d-56efdcbcbac2 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:03.918250 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8c6c4-39b8-4d5f-8d34-0d7953cc3b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:03.918861 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8c6c4-39b8-4d5f-8d34-0d7953cc3b0f None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:03.919134 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8c6c4-39b8-4d5f-8d34-0d7953cc3b0f None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:03.919399 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8c6c4-39b8-4d5f-8d34-0d7953cc3b0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:03.929076 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8c6c4-39b8-4d5f-8d34-0d7953cc3b0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:03.930482 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8c6c4-39b8-4d5f-8d34-0d7953cc3b0f None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:03.944916 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-aaf8c6c4-39b8-4d5f-8d34-0d7953cc3b0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:26:03.944916 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:03.944916 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:26:03.944916 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:26:03.944916 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:26:03.944916 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:26:03.944916 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:26:03.944916 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:26:03.944916 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:26:03.944916 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:26:03.944916 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:26:03.944916 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:26:03.944916 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:26:03.944916 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:26:03.944916 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:26:03.944916 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:26:03.946077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:26:03.946077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:26:03.946077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:26:03.946077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:26:03.946077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:26:03.946077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:26:03.946077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:26:03.946077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:26:03.946077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:26:03.946077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:26:03.946077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:26:03.946077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:26:03.946077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:26:03.946077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:26:03.946077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:26:03.946077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:26:03.946077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:26:03.947364 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:26:03.947364 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:26:03.947364 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:26:03.947364 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 477/955] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:26:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:26:03.952479 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9196e-459a-4f15-9336-7a4b0762738b None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:04.016106 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:04.049099 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9196e-459a-4f15-9336-7a4b0762738b None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:04.081325 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e6eee-9dfa-4084-ae41-af7c4b075a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:04.081923 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e6eee-9dfa-4084-ae41-af7c4b075a2c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:04.082198 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e6eee-9dfa-4084-ae41-af7c4b075a2c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:04.082469 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e6eee-9dfa-4084-ae41-af7c4b075a2c None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:04.083089 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e6eee-9dfa-4084-ae41-af7c4b075a2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:04.083388 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e6eee-9dfa-4084-ae41-af7c4b075a2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:04.084764 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e6eee-9dfa-4084-ae41-af7c4b075a2c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:04.096816 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 479/956] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:04.102560 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8c6c4-39b8-4d5f-8d34-0d7953cc3b0f None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:04.203319 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8c6c4-39b8-4d5f-8d34-0d7953cc3b0f None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:04.236126 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d5c09-ba31-4a27-b7e8-ffbb54da2332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:04.236750 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d5c09-ba31-4a27-b7e8-ffbb54da2332 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:04.237024 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d5c09-ba31-4a27-b7e8-ffbb54da2332 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:04.237292 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d5c09-ba31-4a27-b7e8-ffbb54da2332 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:04.244525 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d5c09-ba31-4a27-b7e8-ffbb54da2332 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:04.245930 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d5c09-ba31-4a27-b7e8-ffbb54da2332 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:04.256566 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-6e8d5c09-ba31-4a27-b7e8-ffbb54da2332 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 02 07:26:04.256566 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:04.256566 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:26:04.256566 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:26:04.256566 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:26:04.256566 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:26:04.256566 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:26:04.256566 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:26:04.256566 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:26:04.256566 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:26:04.256566 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:26:04.256566 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:26:04.256566 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:26:04.256566 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:26:04.256566 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:26:04.256566 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:26:04.261144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:26:04.261144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:26:04.261144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:26:04.261144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:26:04.261144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:26:04.261144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:26:04.261144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:26:04.261144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:26:04.261144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:26:04.261144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:26:04.261144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:26:04.261144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:26:04.261144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:26:04.261144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:26:04.261144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:26:04.261144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:26:04.261144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:26:04.261144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:26:04.262166 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:26:04.262166 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:26:04.262166 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:26:04.262166 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:26:04.262166 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:26:04.262166 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:26:04.262166 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:26:04.262166 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:26:04.262166 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Nov 02 07:26:04.262166 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:26:04.262166 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 478/957] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:26:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:26:04.263707 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e6eee-9dfa-4084-ae41-af7c4b075a2c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:04.360878 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e6eee-9dfa-4084-ae41-af7c4b075a2c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:04.385627 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:04.394605 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ad5eb-3a7e-4006-b6be-e9f7d6af83ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:04.395201 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ad5eb-3a7e-4006-b6be-e9f7d6af83ab None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:04.395502 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ad5eb-3a7e-4006-b6be-e9f7d6af83ab None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:04.395767 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ad5eb-3a7e-4006-b6be-e9f7d6af83ab None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:04.396504 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ad5eb-3a7e-4006-b6be-e9f7d6af83ab None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:04.396802 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ad5eb-3a7e-4006-b6be-e9f7d6af83ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:04.398268 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ad5eb-3a7e-4006-b6be-e9f7d6af83ab None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:04.415280 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 480/958] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Nov 2 07:26:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:04.421446 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d5c09-ba31-4a27-b7e8-ffbb54da2332 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:04.437003 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:04.517020 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d5c09-ba31-4a27-b7e8-ffbb54da2332 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:04.550974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93674c72-aa92-4941-95c4-7f2bf3b21a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:04.551576 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93674c72-aa92-4941-95c4-7f2bf3b21a2e None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:04.551855 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93674c72-aa92-4941-95c4-7f2bf3b21a2e None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:04.552155 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93674c72-aa92-4941-95c4-7f2bf3b21a2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:04.617595 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93674c72-aa92-4941-95c4-7f2bf3b21a2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:04.618937 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93674c72-aa92-4941-95c4-7f2bf3b21a2e None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:04.632409 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:04.714191 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 479/959] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Nov 2 07:26:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Nov 02 07:26:04.720196 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ad5eb-3a7e-4006-b6be-e9f7d6af83ab None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:04.818912 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ad5eb-3a7e-4006-b6be-e9f7d6af83ab None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:04.852430 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ae861-1ec7-4e69-91cc-8840b9eb136c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:04.853036 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ae861-1ec7-4e69-91cc-8840b9eb136c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:04.853308 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ae861-1ec7-4e69-91cc-8840b9eb136c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:04.853573 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ae861-1ec7-4e69-91cc-8840b9eb136c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:04.863374 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ae861-1ec7-4e69-91cc-8840b9eb136c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:04.864937 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ae861-1ec7-4e69-91cc-8840b9eb136c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:04.879606 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-d53ae861-1ec7-4e69-91cc-8840b9eb136c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:26:04.879606 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:04.879606 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:26:04.879606 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:26:04.879606 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:26:04.879606 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:26:04.879606 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:26:04.879606 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:26:04.879606 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:26:04.879606 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:26:04.879606 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:26:04.879606 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:26:04.879606 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:26:04.879606 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:26:04.879606 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:26:04.879606 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:26:04.880738 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:26:04.880738 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:26:04.880738 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:26:04.880738 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:26:04.880738 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:26:04.880738 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:26:04.880738 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:26:04.880738 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:26:04.880738 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:26:04.880738 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:26:04.880738 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:26:04.880738 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:26:04.880738 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:26:04.880738 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:26:04.880738 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:26:04.880738 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:26:04.880738 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:26:04.881847 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:26:04.881847 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:26:04.881847 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:26:04.881847 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 481/960] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:26:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:26:04.886807 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93674c72-aa92-4941-95c4-7f2bf3b21a2e None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:04.986248 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93674c72-aa92-4941-95c4-7f2bf3b21a2e None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:04.999048 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:05.019004 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119127cd-b0e4-44f3-b855-57627db4fa61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:05.019608 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119127cd-b0e4-44f3-b855-57627db4fa61 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:05.019915 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119127cd-b0e4-44f3-b855-57627db4fa61 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:05.020209 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119127cd-b0e4-44f3-b855-57627db4fa61 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:05.020835 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119127cd-b0e4-44f3-b855-57627db4fa61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:05.021125 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119127cd-b0e4-44f3-b855-57627db4fa61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:05.022460 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119127cd-b0e4-44f3-b855-57627db4fa61 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:05.034136 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 480/961] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Nov 2 07:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:05.039785 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ae861-1ec7-4e69-91cc-8840b9eb136c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:05.075841 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:05.139940 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ae861-1ec7-4e69-91cc-8840b9eb136c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:05.173223 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fcc5e1-35b5-43af-8440-d33518f01abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:05.173835 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fcc5e1-35b5-43af-8440-d33518f01abe None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:05.174110 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fcc5e1-35b5-43af-8440-d33518f01abe None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:05.174377 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fcc5e1-35b5-43af-8440-d33518f01abe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:05.180738 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fcc5e1-35b5-43af-8440-d33518f01abe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:05.182175 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fcc5e1-35b5-43af-8440-d33518f01abe None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:05.193649 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-01fcc5e1-35b5-43af-8440-d33518f01abe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:26:05.193649 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:05.193649 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:26:05.193649 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:26:05.193649 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:26:05.193649 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:26:05.193649 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:26:05.193649 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:26:05.193649 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:26:05.193649 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:26:05.193649 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:26:05.193649 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:26:05.193649 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:26:05.193649 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:26:05.193649 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:26:05.194694 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:26:05.194694 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:26:05.194694 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:26:05.194694 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:26:05.194694 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:26:05.194694 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:26:05.194694 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:26:05.194694 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:26:05.194694 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Nov 02 07:26:05.194694 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:26:05.194694 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:26:05.194694 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:26:05.194694 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:26:05.194694 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:26:05.194694 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:26:05.194694 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:26:05.194694 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:26:05.195941 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:26:05.195941 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:26:05.195941 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:26:05.195941 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:26:05.195941 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:26:05.195941 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:26:05.195941 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:26:05.195941 dv-cinder-804757-31-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Nov 02 07:26:05.195941 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 482/962] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Nov 2 07:26:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:26:05.200673 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119127cd-b0e4-44f3-b855-57627db4fa61 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:05.299234 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119127cd-b0e4-44f3-b855-57627db4fa61 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:05.332114 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea0ee9-f7b3-49f5-9afd-ec6d8993d8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:05.332712 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea0ee9-f7b3-49f5-9afd-ec6d8993d8f4 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:05.332985 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea0ee9-f7b3-49f5-9afd-ec6d8993d8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:05.333251 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea0ee9-f7b3-49f5-9afd-ec6d8993d8f4 None admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:05.333917 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ea0ee9-f7b3-49f5-9afd-ec6d8993d8f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:05.334214 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ea0ee9-f7b3-49f5-9afd-ec6d8993d8f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:05.335604 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ea0ee9-f7b3-49f5-9afd-ec6d8993d8f4 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:05.347028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 481/963] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Nov 2 07:26:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:05.353088 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fcc5e1-35b5-43af-8440-d33518f01abe None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:05.445576 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:05.451126 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fcc5e1-35b5-43af-8440-d33518f01abe None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:05.485169 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b185f6a-8626-43ca-ae44-a7a44397b4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:05.485756 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b185f6a-8626-43ca-ae44-a7a44397b4f2 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:05.486027 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b185f6a-8626-43ca-ae44-a7a44397b4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:05.486294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b185f6a-8626-43ca-ae44-a7a44397b4f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:05.486995 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b185f6a-8626-43ca-ae44-a7a44397b4f2 None admin] RBAC: Adding query filter params (role.id=9252c356af254127896f3626d925a88a, scope.project.id=2c3bf3e930dd407f8401c0487edc8c20, user.id=741c9fc71c80438faa037c85f4997c3e) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:05.487295 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b185f6a-8626-43ca-ae44-a7a44397b4f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:05.488732 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b185f6a-8626-43ca-ae44-a7a44397b4f2 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:05.494246 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 483/964] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Nov 2 07:26:05 2022] GET /identity/v3/role_assignments?user.id=741c9fc71c80438faa037c85f4997c3e&scope.project.id=2c3bf3e930dd407f8401c0487edc8c20&role.id=9252c356af254127896f3626d925a88a => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:26:07.651571 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080668a-d43e-46eb-ac53-698014b798e4 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:07.652158 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080668a-d43e-46eb-ac53-698014b798e4 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:07.652158 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080668a-d43e-46eb-ac53-698014b798e4 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:07.653453 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 482/965] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:26:07.658890 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce5cff-9389-40a2-85e3-9519f754c7dc None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:07.660442 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce5cff-9389-40a2-85e3-9519f754c7dc None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:07.660442 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce5cff-9389-40a2-85e3-9519f754c7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:07.678756 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-17ce5cff-9389-40a2-85e3-9519f754c7dc None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:07.680086 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-17ce5cff-9389-40a2-85e3-9519f754c7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:07.745580 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 484/966] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:26:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:26:08.018473 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080668a-d43e-46eb-ac53-698014b798e4 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:08.050140 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:08.119117 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080668a-d43e-46eb-ac53-698014b798e4 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:08.153263 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8e447-9765-4878-b5c4-8fac31357e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:08.153926 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8e447-9765-4878-b5c4-8fac31357e4e None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:08.154205 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8e447-9765-4878-b5c4-8fac31357e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:08.154477 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8e447-9765-4878-b5c4-8fac31357e4e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:08.155684 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c8e447-9765-4878-b5c4-8fac31357e4e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:08.157054 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c8e447-9765-4878-b5c4-8fac31357e4e None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:08.165497 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-a7c8e447-9765-4878-b5c4-8fac31357e4e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 07:26:08.165497 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:08.165497 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:26:08.165497 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:26:08.165497 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:26:08.165497 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:26:08.165497 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:26:08.165497 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:26:08.165497 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 07:26:08.165497 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:26:08.165497 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:26:08.165497 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:26:08.165497 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:08.165497 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:26:08.165497 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:26:08.165497 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:26:08.165497 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:26:08.166664 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:26:08.166664 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:26:08.166664 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:26:08.166664 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:26:08.166664 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:26:08.166664 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:26:08.166664 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:26:08.166664 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:26:08.166664 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:26:08.166664 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:26:08.166664 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:26:08.166664 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:26:08.166664 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:26:08.166664 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:26:08.166664 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:26:08.166664 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:26:08.167552 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:26:08.167552 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:26:08.167552 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:26:08.167552 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:26:08.167552 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:26:08.167552 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:26:08.167552 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:26:08.167552 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:26:08.167552 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:26:08.167552 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:26:08.167552 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:26:08.167552 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:26:08.167552 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 07:26:08.167552 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:26:08.167552 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 483/967] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Nov 2 07:26:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:26:08.172749 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce5cff-9389-40a2-85e3-9519f754c7dc None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:08.260285 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:08.270289 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce5cff-9389-40a2-85e3-9519f754c7dc None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:08.303446 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b98898-cdc9-4c59-bbbd-75468d2baca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:08.304069 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b98898-cdc9-4c59-bbbd-75468d2baca9 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:08.304349 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b98898-cdc9-4c59-bbbd-75468d2baca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:08.304620 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b98898-cdc9-4c59-bbbd-75468d2baca9 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:08.305234 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b98898-cdc9-4c59-bbbd-75468d2baca9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:08.305533 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b98898-cdc9-4c59-bbbd-75468d2baca9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:08.306902 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b98898-cdc9-4c59-bbbd-75468d2baca9 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:08.312836 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 485/968] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Nov 2 07:26:08 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:08.318677 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8e447-9765-4878-b5c4-8fac31357e4e None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:08.417822 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:08.423406 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8e447-9765-4878-b5c4-8fac31357e4e None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:08.457622 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920de20c-724f-4566-880e-2218ea0192bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:08.458214 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920de20c-724f-4566-880e-2218ea0192bd None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:08.458485 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920de20c-724f-4566-880e-2218ea0192bd None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:08.458750 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920de20c-724f-4566-880e-2218ea0192bd None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:08.459358 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920de20c-724f-4566-880e-2218ea0192bd None admin] RBAC: Adding query filter params (type=placement) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:08.459652 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920de20c-724f-4566-880e-2218ea0192bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:08.461019 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920de20c-724f-4566-880e-2218ea0192bd None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:08.465192 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 484/969] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Nov 2 07:26:08 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:10.618786 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb7977-9d06-43a2-bba3-16dadce52fb8 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:10.619338 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb7977-9d06-43a2-bba3-16dadce52fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:10.619338 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb7977-9d06-43a2-bba3-16dadce52fb8 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:10.620663 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 486/970] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:26:10.626312 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a4ff8-30c6-4365-b2da-7955c473b607 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:10.626750 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a4ff8-30c6-4365-b2da-7955c473b607 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:10.626862 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a4ff8-30c6-4365-b2da-7955c473b607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:10.645432 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-d19a4ff8-30c6-4365-b2da-7955c473b607 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:10.647030 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-d19a4ff8-30c6-4365-b2da-7955c473b607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:10.711183 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 485/971] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:26:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:26:10.979000 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb7977-9d06-43a2-bba3-16dadce52fb8 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:11.078100 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb7977-9d06-43a2-bba3-16dadce52fb8 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:11.112227 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dacd2e-71cb-473c-9f56-62ef44ed23fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:11.112831 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dacd2e-71cb-473c-9f56-62ef44ed23fa None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:11.113101 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dacd2e-71cb-473c-9f56-62ef44ed23fa None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:11.113365 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dacd2e-71cb-473c-9f56-62ef44ed23fa None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:11.114027 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dacd2e-71cb-473c-9f56-62ef44ed23fa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:11.115372 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dacd2e-71cb-473c-9f56-62ef44ed23fa None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:11.184059 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 487/972] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Nov 2 07:26:10 2022] POST /identity/v3/services => generated 246 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:26:13.362377 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda0ae3-30df-459a-ba8b-ecf7c649606c None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:13.362899 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda0ae3-30df-459a-ba8b-ecf7c649606c None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:13.362899 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda0ae3-30df-459a-ba8b-ecf7c649606c None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:13.364342 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 486/973] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:26:13.369621 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d3df5-0b13-43a4-946f-d705f49b29d9 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:13.370065 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d3df5-0b13-43a4-946f-d705f49b29d9 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:13.370212 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d3df5-0b13-43a4-946f-d705f49b29d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:13.389298 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-058d3df5-0b13-43a4-946f-d705f49b29d9 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:13.390574 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-058d3df5-0b13-43a4-946f-d705f49b29d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:13.400295 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:13.465212 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 488/974] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:26:13 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:26:13.734327 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda0ae3-30df-459a-ba8b-ecf7c649606c None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:13.822216 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:13.832435 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda0ae3-30df-459a-ba8b-ecf7c649606c None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:13.865255 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f6424-e2ac-4c02-a567-4d3b66c782fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:13.865869 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f6424-e2ac-4c02-a567-4d3b66c782fd None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:13.866146 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f6424-e2ac-4c02-a567-4d3b66c782fd None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:13.866416 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f6424-e2ac-4c02-a567-4d3b66c782fd None admin] PATH_INFO: `/v3/services/placement` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:13.866980 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f6424-e2ac-4c02-a567-4d3b66c782fd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:13.868390 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f6424-e2ac-4c02-a567-4d3b66c782fd None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:13.876796 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-6f7f6424-e2ac-4c02-a567-4d3b66c782fd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 07:26:13.876796 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:13.876796 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:26:13.876796 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:26:13.876796 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:26:13.876796 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:26:13.876796 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:26:13.876796 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:26:13.876796 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 07:26:13.876796 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:26:13.876796 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:26:13.876796 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:26:13.876796 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:13.876796 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:26:13.876796 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:26:13.876796 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:26:13.876796 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:26:13.877925 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:26:13.877925 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:26:13.877925 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:26:13.877925 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:26:13.877925 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:26:13.877925 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:26:13.877925 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:26:13.877925 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:26:13.877925 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:26:13.877925 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:26:13.877925 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:26:13.877925 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:26:13.877925 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:26:13.877925 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:26:13.877925 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:26:13.877925 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:26:13.878930 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:26:13.878930 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:26:13.878930 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:26:13.878930 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:26:13.878930 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:26:13.878930 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:26:13.878930 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:26:13.878930 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:26:13.878930 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:26:13.878930 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:26:13.878930 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:26:13.878930 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:26:13.878930 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 07:26:13.878930 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:26:13.878930 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 487/975] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Nov 2 07:26:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:26:13.883867 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d3df5-0b13-43a4-946f-d705f49b29d9 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:13.983527 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d3df5-0b13-43a4-946f-d705f49b29d9 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:14.016741 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf64daa-24b0-4e6b-ba9b-e3b27f3797ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:14.017283 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf64daa-24b0-4e6b-ba9b-e3b27f3797ce None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:14.017559 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf64daa-24b0-4e6b-ba9b-e3b27f3797ce None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:14.017829 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf64daa-24b0-4e6b-ba9b-e3b27f3797ce None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:14.018447 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf64daa-24b0-4e6b-ba9b-e3b27f3797ce None admin] RBAC: Adding query filter params (name=placement) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:14.018746 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf64daa-24b0-4e6b-ba9b-e3b27f3797ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:14.020134 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf64daa-24b0-4e6b-ba9b-e3b27f3797ce None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:14.025207 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 489/976] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Nov 2 07:26:13 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:14.031821 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f6424-e2ac-4c02-a567-4d3b66c782fd None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:14.126638 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f6424-e2ac-4c02-a567-4d3b66c782fd None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:14.159613 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a8225-959f-4af8-aa6e-905c45e1de08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:14.160224 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a8225-959f-4af8-aa6e-905c45e1de08 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:14.160500 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a8225-959f-4af8-aa6e-905c45e1de08 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:14.160767 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a8225-959f-4af8-aa6e-905c45e1de08 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:14.161441 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a8225-959f-4af8-aa6e-905c45e1de08 None admin] RBAC: Adding query filter params (interface=public, service_id=e94dc41fa1c545c2a32bdfb1db4d1c7d, region_id=RegionOne) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:14.161743 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a8225-959f-4af8-aa6e-905c45e1de08 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:14.163075 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a8225-959f-4af8-aa6e-905c45e1de08 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:14.167843 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 488/977] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Nov 2 07:26:14 2022] GET /identity/v3/endpoints?service_id=e94dc41fa1c545c2a32bdfb1db4d1c7d&interface=public®ion_id=RegionOne => generated 194 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:14.173502 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf64daa-24b0-4e6b-ba9b-e3b27f3797ce None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:14.177194 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:14.271113 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf64daa-24b0-4e6b-ba9b-e3b27f3797ce None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:14.303338 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a9fbe-88a1-4c9d-9b0b-8d00283bdac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:14.303929 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a9fbe-88a1-4c9d-9b0b-8d00283bdac0 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:14.304231 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a9fbe-88a1-4c9d-9b0b-8d00283bdac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:14.304499 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a9fbe-88a1-4c9d-9b0b-8d00283bdac0 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:14.305083 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a9fbe-88a1-4c9d-9b0b-8d00283bdac0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:14.306431 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a9fbe-88a1-4c9d-9b0b-8d00283bdac0 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:14.313642 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 490/978] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Nov 2 07:26:14 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:26:16.450325 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5013f-83a7-4f60-b169-1bc7ba347199 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:16.450879 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5013f-83a7-4f60-b169-1bc7ba347199 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:16.450879 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5013f-83a7-4f60-b169-1bc7ba347199 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:16.452446 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 489/979] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:26:16.457586 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064161e-979e-494c-8cbc-4723845ee170 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:16.457991 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064161e-979e-494c-8cbc-4723845ee170 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:16.458126 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064161e-979e-494c-8cbc-4723845ee170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:16.475699 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-d064161e-979e-494c-8cbc-4723845ee170 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:16.476893 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d064161e-979e-494c-8cbc-4723845ee170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:16.536144 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:16.541364 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 491/980] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:26:16 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:26:16.807318 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5013f-83a7-4f60-b169-1bc7ba347199 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:16.827375 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:16.906639 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5013f-83a7-4f60-b169-1bc7ba347199 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:16.939202 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ec4d1-5959-4ecb-bcb5-353c355cc90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:16.939820 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ec4d1-5959-4ecb-bcb5-353c355cc90f None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:16.940120 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ec4d1-5959-4ecb-bcb5-353c355cc90f None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:16.940391 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ec4d1-5959-4ecb-bcb5-353c355cc90f None admin] PATH_INFO: `/v3/services/placement` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:16.940956 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ec4d1-5959-4ecb-bcb5-353c355cc90f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:16.942344 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ec4d1-5959-4ecb-bcb5-353c355cc90f None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:16.950804 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-3c9ec4d1-5959-4ecb-bcb5-353c355cc90f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 07:26:16.950804 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:16.950804 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:26:16.950804 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:26:16.950804 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:26:16.950804 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:26:16.950804 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:26:16.950804 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:26:16.950804 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 07:26:16.950804 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:26:16.950804 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:26:16.950804 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:26:16.950804 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:16.950804 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:26:16.950804 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:26:16.950804 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:26:16.950804 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:26:16.952662 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:26:16.952662 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:26:16.952662 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:26:16.952662 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:26:16.952662 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:26:16.952662 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:26:16.952662 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:26:16.952662 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:26:16.952662 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:26:16.952662 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:26:16.952662 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:26:16.952662 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:26:16.952662 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:26:16.952662 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:26:16.952662 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:26:16.952662 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:26:16.953526 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:26:16.953526 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Nov 02 07:26:16.953526 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:26:16.953526 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:26:16.953526 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:26:16.953526 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:26:16.953526 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:26:16.953526 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:26:16.953526 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:26:16.953526 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:26:16.953526 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:26:16.953526 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:26:16.953526 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 07:26:16.953526 dv-cinder-804757-31-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Nov 02 07:26:16.953526 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 490/981] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Nov 2 07:26:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:26:16.958317 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064161e-979e-494c-8cbc-4723845ee170 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:17.052814 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064161e-979e-494c-8cbc-4723845ee170 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:17.085389 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cf21e-b8ac-4ed9-b778-e79e1a33299d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:17.085986 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cf21e-b8ac-4ed9-b778-e79e1a33299d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:17.086257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cf21e-b8ac-4ed9-b778-e79e1a33299d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:17.086526 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cf21e-b8ac-4ed9-b778-e79e1a33299d None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:17.087136 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6cf21e-b8ac-4ed9-b778-e79e1a33299d None admin] RBAC: Adding query filter params (name=placement) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:17.087433 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6cf21e-b8ac-4ed9-b778-e79e1a33299d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:17.088810 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6cf21e-b8ac-4ed9-b778-e79e1a33299d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:17.094387 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 492/982] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Nov 2 07:26:16 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:17.100064 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ec4d1-5959-4ecb-bcb5-353c355cc90f None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:17.180523 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:17.197836 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ec4d1-5959-4ecb-bcb5-353c355cc90f None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:17.229972 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86242cfe-4c3f-4af8-a66a-cc9d0f0ca103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:17.230556 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86242cfe-4c3f-4af8-a66a-cc9d0f0ca103 None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:17.230827 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86242cfe-4c3f-4af8-a66a-cc9d0f0ca103 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:17.231092 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86242cfe-4c3f-4af8-a66a-cc9d0f0ca103 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:17.231738 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86242cfe-4c3f-4af8-a66a-cc9d0f0ca103 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:17.233707 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86242cfe-4c3f-4af8-a66a-cc9d0f0ca103 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:17.303494 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 491/983] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:26:17 2022] POST /identity/v3/endpoints => generated 331 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:26:27.090808 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=69 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:27.298902 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:26.931370 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a1340-5b73-41d3-bffc-cff272d8f5ea None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:26.931912 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a1340-5b73-41d3-bffc-cff272d8f5ea None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:26.931912 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a1340-5b73-41d3-bffc-cff272d8f5ea None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:26.938665 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba13e05-2c17-4b29-8d17-e4b2dd640f3a None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:26.939118 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba13e05-2c17-4b29-8d17-e4b2dd640f3a None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:26.939243 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba13e05-2c17-4b29-8d17-e4b2dd640f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:26.944182 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 493/984] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:32:26 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:32:27.098660 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-dba13e05-2c17-4b29-8d17-e4b2dd640f3a None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:32:27.100768 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-dba13e05-2c17-4b29-8d17-e4b2dd640f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:27.291805 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 492/985] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:32:27.583658 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d01331-7f23-402d-a054-ef57bc72790b None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:27.583938 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d01331-7f23-402d-a054-ef57bc72790b None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:27.584460 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d01331-7f23-402d-a054-ef57bc72790b None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:27.585825 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 494/986] 10.222.0.16 () {54 vars in 965 bytes} [Wed Nov 2 07:32:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:32:27.591698 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc064c9e-c8ae-43ee-ae79-0878f26b3151 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:27.592680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc064c9e-c8ae-43ee-ae79-0878f26b3151 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:27.593311 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc064c9e-c8ae-43ee-ae79-0878f26b3151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:27.676845 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-fc064c9e-c8ae-43ee-ae79-0878f26b3151 None None] MFA Rules not processed for user `c35fe87fc263440980ce70680748e5af`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:32:27.678365 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-fc064c9e-c8ae-43ee-ae79-0878f26b3151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:27.705483 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:27.772865 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 493/987] 10.222.0.16 () {58 vars in 1062 bytes} [Wed Nov 2 07:32:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:32:27.783003 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d01331-7f23-402d-a054-ef57bc72790b None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:27.784885 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-49d01331-7f23-402d-a054-ef57bc72790b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:27.908785 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d01331-7f23-402d-a054-ef57bc72790b None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:27.992647 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9ce1d-7d84-422a-a75f-ed6d78d807b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:27.993283 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9ce1d-7d84-422a-a75f-ed6d78d807b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:27.993581 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9ce1d-7d84-422a-a75f-ed6d78d807b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:27.993781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9ce1d-7d84-422a-a75f-ed6d78d807b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:27.995423 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c7e9ce1d-7d84-422a-a75f-ed6d78d807b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:28.054221 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:28.116852 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9ce1d-7d84-422a-a75f-ed6d78d807b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:28.118595 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9ce1d-7d84-422a-a75f-ed6d78d807b6 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:28.141233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 495/988] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:32:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:32:30.837972 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357a539-b63f-43ea-9a09-5c4cda882b1f None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:30.838438 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357a539-b63f-43ea-9a09-5c4cda882b1f None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:30.838542 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357a539-b63f-43ea-9a09-5c4cda882b1f None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:30.839845 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 494/989] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:32:30.845642 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967124c-c3f8-4fea-b9a4-67b9948ad40a None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:30.846010 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967124c-c3f8-4fea-b9a4-67b9948ad40a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:30.846189 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967124c-c3f8-4fea-b9a4-67b9948ad40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:30.915672 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-d967124c-c3f8-4fea-b9a4-67b9948ad40a None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:32:30.916884 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d967124c-c3f8-4fea-b9a4-67b9948ad40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:31.013678 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 496/990] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:32:31.297626 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357a539-b63f-43ea-9a09-5c4cda882b1f None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:31.299174 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a357a539-b63f-43ea-9a09-5c4cda882b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:31.401671 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357a539-b63f-43ea-9a09-5c4cda882b1f None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:31.470940 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:31.473140 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f6e82a-89ee-4ad7-b73c-2abec6776e3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:31.473733 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6e82a-89ee-4ad7-b73c-2abec6776e3c service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:31.474009 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6e82a-89ee-4ad7-b73c-2abec6776e3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:31.474277 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6e82a-89ee-4ad7-b73c-2abec6776e3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:31.475845 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-55f6e82a-89ee-4ad7-b73c-2abec6776e3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:31.580989 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f6e82a-89ee-4ad7-b73c-2abec6776e3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:31.582404 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f6e82a-89ee-4ad7-b73c-2abec6776e3c service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:31.600553 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 495/991] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:32:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:32:34.180704 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ba083-70fb-42b0-bc71-037500e044ab None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:34.181290 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ba083-70fb-42b0-bc71-037500e044ab None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:34.181290 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ba083-70fb-42b0-bc71-037500e044ab None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:34.182569 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 497/992] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:32:34.187714 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eac242-b19b-4191-bda1-b74c6c32e1b0 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:34.188140 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eac242-b19b-4191-bda1-b74c6c32e1b0 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:34.188297 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eac242-b19b-4191-bda1-b74c6c32e1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:34.253797 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-63eac242-b19b-4191-bda1-b74c6c32e1b0 None None] MFA Rules not processed for user `4df76d036f8b410588df74292bc5a6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:32:34.254931 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-63eac242-b19b-4191-bda1-b74c6c32e1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:34.306146 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:34.350657 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 496/993] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:32:34 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:32:34.637761 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ba083-70fb-42b0-bc71-037500e044ab None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:34.640312 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4a3ba083-70fb-42b0-bc71-037500e044ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:34.651964 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:34.742801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ba083-70fb-42b0-bc71-037500e044ab None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:34.815215 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf020c3-a066-4727-91a5-76fb2fed0e8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:34.815840 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf020c3-a066-4727-91a5-76fb2fed0e8c service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:34.816144 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf020c3-a066-4727-91a5-76fb2fed0e8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:34.816412 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf020c3-a066-4727-91a5-76fb2fed0e8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:34.817966 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4bf020c3-a066-4727-91a5-76fb2fed0e8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:34.878968 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:34.924012 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf020c3-a066-4727-91a5-76fb2fed0e8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:34.925428 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf020c3-a066-4727-91a5-76fb2fed0e8c service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:34.944009 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 498/994] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:32:34 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:32:37.764241 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f2460-240a-429c-9281-6a8a9c1a2e01 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:37.764804 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f2460-240a-429c-9281-6a8a9c1a2e01 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:37.764804 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f2460-240a-429c-9281-6a8a9c1a2e01 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:37.766408 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 497/995] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:32:37.771501 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116f801-c431-4df4-808e-b85b4bd261e6 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:37.771943 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116f801-c431-4df4-808e-b85b4bd261e6 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:37.772071 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116f801-c431-4df4-808e-b85b4bd261e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:37.836801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-5116f801-c431-4df4-808e-b85b4bd261e6 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:32:37.837995 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5116f801-c431-4df4-808e-b85b4bd261e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:37.932594 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 499/996] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:32:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:32:38.218167 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f2460-240a-429c-9281-6a8a9c1a2e01 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:38.219694 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-6a9f2460-240a-429c-9281-6a8a9c1a2e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:38.321440 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f2460-240a-429c-9281-6a8a9c1a2e01 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:38.393051 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa97c9f-2acc-498e-b1d5-95413a26964e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:38.393646 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa97c9f-2acc-498e-b1d5-95413a26964e service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:38.393921 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa97c9f-2acc-498e-b1d5-95413a26964e service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:38.394190 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa97c9f-2acc-498e-b1d5-95413a26964e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:38.395758 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-1fa97c9f-2acc-498e-b1d5-95413a26964e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:38.402451 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:38.501546 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa97c9f-2acc-498e-b1d5-95413a26964e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:38.502910 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa97c9f-2acc-498e-b1d5-95413a26964e service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:38.520298 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 498/997] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:32:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:32:41.589552 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03892e74-c60f-48d4-be50-5fa7ee3fcdd6 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:41.590109 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03892e74-c60f-48d4-be50-5fa7ee3fcdd6 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:41.590207 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03892e74-c60f-48d4-be50-5fa7ee3fcdd6 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:41.591542 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 500/998] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:32:41.597380 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305bfb5-ebad-4f22-bca0-539302e437cd None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:41.597810 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305bfb5-ebad-4f22-bca0-539302e437cd None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:41.598008 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305bfb5-ebad-4f22-bca0-539302e437cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:41.663352 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-a305bfb5-ebad-4f22-bca0-539302e437cd None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:32:41.664574 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a305bfb5-ebad-4f22-bca0-539302e437cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:41.724281 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:41.768408 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 499/999] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:32:42.051655 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03892e74-c60f-48d4-be50-5fa7ee3fcdd6 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:42.053283 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-03892e74-c60f-48d4-be50-5fa7ee3fcdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:42.074318 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:42.159162 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03892e74-c60f-48d4-be50-5fa7ee3fcdd6 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:42.231421 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a57a5-5920-412e-9d6c-16fd8dbc62de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:42.232020 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a57a5-5920-412e-9d6c-16fd8dbc62de service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:42.232321 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a57a5-5920-412e-9d6c-16fd8dbc62de service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:42.232633 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a57a5-5920-412e-9d6c-16fd8dbc62de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:42.234206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b78a57a5-5920-412e-9d6c-16fd8dbc62de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:42.308942 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:42.347615 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a57a5-5920-412e-9d6c-16fd8dbc62de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:42.349210 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a57a5-5920-412e-9d6c-16fd8dbc62de service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:42.366927 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 501/1000] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:32:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:32:44.585258 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb970a-eb7b-4b28-93ab-4f3a9712da8f None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:44.585790 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb970a-eb7b-4b28-93ab-4f3a9712da8f None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:44.585790 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb970a-eb7b-4b28-93ab-4f3a9712da8f None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:44.587132 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 500/1001] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:32:44.592387 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a6807-9afe-4b33-8615-c9ae181d5d14 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:44.592770 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a6807-9afe-4b33-8615-c9ae181d5d14 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:44.592935 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a6807-9afe-4b33-8615-c9ae181d5d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:44.664780 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-ac9a6807-9afe-4b33-8615-c9ae181d5d14 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:32:44.665984 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ac9a6807-9afe-4b33-8615-c9ae181d5d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:44.763169 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 502/1002] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:32:45.073686 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e2cdb-20d5-4f8b-b71f-504a8c58b69c None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:45.073978 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e2cdb-20d5-4f8b-b71f-504a8c58b69c None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:45.074313 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e2cdb-20d5-4f8b-b71f-504a8c58b69c None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:45.075711 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 501/1003] 10.222.0.16 () {54 vars in 965 bytes} [Wed Nov 2 07:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:32:45.081921 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0030633-6b85-4a9b-8f4e-4911b962e486 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:45.082269 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0030633-6b85-4a9b-8f4e-4911b962e486 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:45.082603 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0030633-6b85-4a9b-8f4e-4911b962e486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:45.113719 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:45.161934 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-e0030633-6b85-4a9b-8f4e-4911b962e486 None None] MFA Rules not processed for user `c35fe87fc263440980ce70680748e5af`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:32:45.163069 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e0030633-6b85-4a9b-8f4e-4911b962e486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:45.240558 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 503/1004] 10.222.0.16 () {58 vars in 1062 bytes} [Wed Nov 2 07:32:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:32:45.250043 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e2cdb-20d5-4f8b-b71f-504a8c58b69c None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:45.251560 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c25e2cdb-20d5-4f8b-b71f-504a8c58b69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:45.355477 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e2cdb-20d5-4f8b-b71f-504a8c58b69c None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:45.428691 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4514aa-d0d7-4ee1-a4d9-f46bcf6cceaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:45.429300 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4514aa-d0d7-4ee1-a4d9-f46bcf6cceaf service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:45.429575 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4514aa-d0d7-4ee1-a4d9-f46bcf6cceaf service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:45.429841 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4514aa-d0d7-4ee1-a4d9-f46bcf6cceaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:45.431416 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-6d4514aa-d0d7-4ee1-a4d9-f46bcf6cceaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:45.448659 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:45.541066 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4514aa-d0d7-4ee1-a4d9-f46bcf6cceaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:45.542480 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4514aa-d0d7-4ee1-a4d9-f46bcf6cceaf service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:45.561405 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 502/1005] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:32:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:32:47.985862 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cc8e2-a352-4840-9f7e-3656a4d2b043 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:47.986363 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cc8e2-a352-4840-9f7e-3656a4d2b043 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:47.986453 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cc8e2-a352-4840-9f7e-3656a4d2b043 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:47.987724 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 504/1006] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:32:47.992890 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41532e94-f228-4ca0-9f1c-a6e8f8087f0b None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:47.993280 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41532e94-f228-4ca0-9f1c-a6e8f8087f0b None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:47.993441 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41532e94-f228-4ca0-9f1c-a6e8f8087f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:48.065442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-41532e94-f228-4ca0-9f1c-a6e8f8087f0b None None] MFA Rules not processed for user `4df76d036f8b410588df74292bc5a6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:32:48.066680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-41532e94-f228-4ca0-9f1c-a6e8f8087f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:48.136239 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:48.169710 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 503/1007] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:32:47 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:32:48.453556 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8cc8e2-a352-4840-9f7e-3656a4d2b043 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:48.455147 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-cb8cc8e2-a352-4840-9f7e-3656a4d2b043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:48.557984 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8cc8e2-a352-4840-9f7e-3656a4d2b043 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:48.577911 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:48.632559 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d54738-3f47-46e1-9e6c-edac21af5f12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:48.633163 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d54738-3f47-46e1-9e6c-edac21af5f12 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:48.633441 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d54738-3f47-46e1-9e6c-edac21af5f12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:48.633710 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d54738-3f47-46e1-9e6c-edac21af5f12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:48.635287 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-96d54738-3f47-46e1-9e6c-edac21af5f12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:48.747103 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d54738-3f47-46e1-9e6c-edac21af5f12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:48.748683 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d54738-3f47-46e1-9e6c-edac21af5f12 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:48.768042 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 505/1008] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:32:48 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:32:51.556284 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3b453-ec47-42fb-99e2-08229a02e7ca None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:51.556817 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3b453-ec47-42fb-99e2-08229a02e7ca None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:51.556817 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3b453-ec47-42fb-99e2-08229a02e7ca None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:51.558175 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 504/1009] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:32:51.563527 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9c15e-54c9-4aed-a068-ea18583979c3 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:51.563941 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9c15e-54c9-4aed-a068-ea18583979c3 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:51.564120 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9c15e-54c9-4aed-a068-ea18583979c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:51.627283 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:51.630120 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-75d9c15e-54c9-4aed-a068-ea18583979c3 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:32:51.631324 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-75d9c15e-54c9-4aed-a068-ea18583979c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:51.727237 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 506/1010] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:32:52.009210 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3b453-ec47-42fb-99e2-08229a02e7ca None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:52.010737 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-6ab3b453-ec47-42fb-99e2-08229a02e7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:52.116530 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3b453-ec47-42fb-99e2-08229a02e7ca None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:52.190035 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdcb5d2-c77e-44ae-9a20-d4d5e64c7255 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:52.190639 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcb5d2-c77e-44ae-9a20-d4d5e64c7255 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:52.190917 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcb5d2-c77e-44ae-9a20-d4d5e64c7255 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:52.191186 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcb5d2-c77e-44ae-9a20-d4d5e64c7255 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:52.192848 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-fcdcb5d2-c77e-44ae-9a20-d4d5e64c7255 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:52.219794 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:52.300011 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdcb5d2-c77e-44ae-9a20-d4d5e64c7255 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:52.301476 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdcb5d2-c77e-44ae-9a20-d4d5e64c7255 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:52.319612 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 505/1011] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:32:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:32:54.500820 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9b11d-386f-47ec-8d88-1731ada5423b None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:54.501394 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9b11d-386f-47ec-8d88-1731ada5423b None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:54.501394 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9b11d-386f-47ec-8d88-1731ada5423b None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:54.502671 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 507/1012] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:32:54.509441 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebdb61-584f-4785-a70a-3caa3602a202 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:54.509857 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebdb61-584f-4785-a70a-3caa3602a202 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:54.509966 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebdb61-584f-4785-a70a-3caa3602a202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:54.575029 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-c4ebdb61-584f-4785-a70a-3caa3602a202 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:32:54.576262 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c4ebdb61-584f-4785-a70a-3caa3602a202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:54.648591 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:54.669641 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 506/1013] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:32:54.954374 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9b11d-386f-47ec-8d88-1731ada5423b None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:54.955905 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d3e9b11d-386f-47ec-8d88-1731ada5423b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:55.057274 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9b11d-386f-47ec-8d88-1731ada5423b None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:55.090536 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:55.135885 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1c23b-f490-499a-9ba9-d25cd3791e20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:55.136510 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1c23b-f490-499a-9ba9-d25cd3791e20 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:55.136785 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1c23b-f490-499a-9ba9-d25cd3791e20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:55.137053 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1c23b-f490-499a-9ba9-d25cd3791e20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:55.138787 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4ba1c23b-f490-499a-9ba9-d25cd3791e20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:55.246112 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba1c23b-f490-499a-9ba9-d25cd3791e20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:55.247528 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba1c23b-f490-499a-9ba9-d25cd3791e20 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:55.267279 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 508/1014] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:32:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:32:58.109443 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173056e-f463-4024-a35e-214fe93b5fb9 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:58.109967 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173056e-f463-4024-a35e-214fe93b5fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:58.110075 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173056e-f463-4024-a35e-214fe93b5fb9 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:58.111349 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 507/1015] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:32:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:32:58.116466 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9980646-3a95-49a4-a304-c0826543aa1a None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:58.116911 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9980646-3a95-49a4-a304-c0826543aa1a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:58.117007 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9980646-3a95-49a4-a304-c0826543aa1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:58.181863 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-b9980646-3a95-49a4-a304-c0826543aa1a None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:32:58.183042 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b9980646-3a95-49a4-a304-c0826543aa1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:58.191767 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:58.277314 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 509/1016] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:32:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:32:58.564973 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173056e-f463-4024-a35e-214fe93b5fb9 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:58.566537 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f173056e-f463-4024-a35e-214fe93b5fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:58.666602 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173056e-f463-4024-a35e-214fe93b5fb9 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:58.741052 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59593ca9-6de8-4000-88a4-16b57aae3b91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:58.741676 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59593ca9-6de8-4000-88a4-16b57aae3b91 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:58.741948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59593ca9-6de8-4000-88a4-16b57aae3b91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:58.742209 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59593ca9-6de8-4000-88a4-16b57aae3b91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:58.743781 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-59593ca9-6de8-4000-88a4-16b57aae3b91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:58.778592 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:58.850309 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59593ca9-6de8-4000-88a4-16b57aae3b91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:58.851718 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59593ca9-6de8-4000-88a4-16b57aae3b91 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:58.869444 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 508/1017] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:32:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:03.338454 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af4c4d-c412-4024-a139-96c9a00c4982 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:03.338972 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af4c4d-c412-4024-a139-96c9a00c4982 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:03.339061 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af4c4d-c412-4024-a139-96c9a00c4982 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:03.340370 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 510/1018] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:33:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:33:03.346426 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af9822-6230-46a9-9615-9ae5679fbb4f None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:03.346871 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af9822-6230-46a9-9615-9ae5679fbb4f None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:03.346963 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af9822-6230-46a9-9615-9ae5679fbb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:03.412914 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-10af9822-6230-46a9-9615-9ae5679fbb4f None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:03.414109 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-10af9822-6230-46a9-9615-9ae5679fbb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:03.501124 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:03.511862 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 509/1019] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:33:03.793818 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af4c4d-c412-4024-a139-96c9a00c4982 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:03.795979 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c1af4c4d-c412-4024-a139-96c9a00c4982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:03.900680 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af4c4d-c412-4024-a139-96c9a00c4982 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:03.944069 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:03.980332 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a65ea-76ea-424d-81b2-635ce79ea59a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:03.980934 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a65ea-76ea-424d-81b2-635ce79ea59a service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:03.981204 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a65ea-76ea-424d-81b2-635ce79ea59a service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:03.981470 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a65ea-76ea-424d-81b2-635ce79ea59a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:03.983201 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ce5a65ea-76ea-424d-81b2-635ce79ea59a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:04.091298 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a65ea-76ea-424d-81b2-635ce79ea59a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:04.093589 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a65ea-76ea-424d-81b2-635ce79ea59a service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:04.111673 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 511/1020] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:07.264734 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e83af-5bff-4edb-9eb5-0bdd0e2b8ebe None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:07.265317 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e83af-5bff-4edb-9eb5-0bdd0e2b8ebe None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:07.265317 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e83af-5bff-4edb-9eb5-0bdd0e2b8ebe None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:07.266877 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 510/1021] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:33:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:33:07.272099 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f25b1-93eb-4bfc-886e-7a18162e1833 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:07.272553 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f25b1-93eb-4bfc-886e-7a18162e1833 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:07.272759 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f25b1-93eb-4bfc-886e-7a18162e1833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:07.339746 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-c83f25b1-93eb-4bfc-886e-7a18162e1833 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:07.340967 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c83f25b1-93eb-4bfc-886e-7a18162e1833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:07.359405 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:07.440314 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 512/1022] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:33:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:07.724268 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e83af-5bff-4edb-9eb5-0bdd0e2b8ebe None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:07.725789 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f07e83af-5bff-4edb-9eb5-0bdd0e2b8ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:07.831610 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e83af-5bff-4edb-9eb5-0bdd0e2b8ebe None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:07.921696 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b2eb5-fd6d-458c-9510-d36b81561d55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:07.922674 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b2eb5-fd6d-458c-9510-d36b81561d55 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:07.923169 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b2eb5-fd6d-458c-9510-d36b81561d55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:07.923650 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b2eb5-fd6d-458c-9510-d36b81561d55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:07.925542 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-343b2eb5-fd6d-458c-9510-d36b81561d55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:07.974359 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:08.043305 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b2eb5-fd6d-458c-9510-d36b81561d55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:08.045411 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b2eb5-fd6d-458c-9510-d36b81561d55 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:08.065462 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 511/1023] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:12.390216 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327aa2b3-7448-4e61-8745-4874fbb91387 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:12.390940 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327aa2b3-7448-4e61-8745-4874fbb91387 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:12.391055 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327aa2b3-7448-4e61-8745-4874fbb91387 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:12.392403 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 513/1024] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:33:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:33:12.398027 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f089990-5a78-4af9-93b6-a9bf00a001d9 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:12.398523 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f089990-5a78-4af9-93b6-a9bf00a001d9 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:12.398602 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f089990-5a78-4af9-93b6-a9bf00a001d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:12.465590 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-5f089990-5a78-4af9-93b6-a9bf00a001d9 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:12.466831 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-5f089990-5a78-4af9-93b6-a9bf00a001d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:12.562852 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:12.566034 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 512/1025] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:12.850794 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327aa2b3-7448-4e61-8745-4874fbb91387 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:12.852347 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-327aa2b3-7448-4e61-8745-4874fbb91387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:12.966172 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327aa2b3-7448-4e61-8745-4874fbb91387 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:13.014905 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:13.042270 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9b79b-2066-4836-8651-cc8637d79a62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:13.042883 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9b79b-2066-4836-8651-cc8637d79a62 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:13.043159 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9b79b-2066-4836-8651-cc8637d79a62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:13.043428 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9b79b-2066-4836-8651-cc8637d79a62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:13.045184 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-adc9b79b-2066-4836-8651-cc8637d79a62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:13.157442 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc9b79b-2066-4836-8651-cc8637d79a62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:13.159071 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc9b79b-2066-4836-8651-cc8637d79a62 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:13.178989 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 514/1026] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:18.145013 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899b9a8-7547-4dbb-ba6d-484ec899d094 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:18.145513 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899b9a8-7547-4dbb-ba6d-484ec899d094 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:18.145591 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899b9a8-7547-4dbb-ba6d-484ec899d094 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:18.147036 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 513/1027] 10.222.0.16 () {54 vars in 921 bytes} [Wed Nov 2 07:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:33:18.153654 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985539d-89ba-46b2-a798-cdf70fe9dd6a None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:18.154754 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985539d-89ba-46b2-a798-cdf70fe9dd6a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:18.154754 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985539d-89ba-46b2-a798-cdf70fe9dd6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:18.282990 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-2985539d-89ba-46b2-a798-cdf70fe9dd6a None None] MFA Rules not processed for user `741c9fc71c80438faa037c85f4997c3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:18.284273 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2985539d-89ba-46b2-a798-cdf70fe9dd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:18.328432 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:18.437257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 515/1028] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Nov 2 07:33:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:22.764761 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38d503-c45f-4101-ae74-6965adc4b5ec None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:22.765286 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38d503-c45f-4101-ae74-6965adc4b5ec None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:22.765286 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38d503-c45f-4101-ae74-6965adc4b5ec None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:22.766885 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 514/1029] 10.222.0.16 () {54 vars in 921 bytes} [Wed Nov 2 07:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:33:22.772716 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597dbe5-9052-4b6b-a0c2-31effd7bf651 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:22.777582 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597dbe5-9052-4b6b-a0c2-31effd7bf651 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:22.777582 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597dbe5-9052-4b6b-a0c2-31effd7bf651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:22.858025 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-5597dbe5-9052-4b6b-a0c2-31effd7bf651 None None] MFA Rules not processed for user `741c9fc71c80438faa037c85f4997c3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:22.859258 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5597dbe5-9052-4b6b-a0c2-31effd7bf651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:22.952355 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:22.991177 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 516/1030] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Nov 2 07:33:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:24.111576 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3c701-5665-4b79-a85d-fe40caaef53f None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:24.112156 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3c701-5665-4b79-a85d-fe40caaef53f None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:24.112156 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3c701-5665-4b79-a85d-fe40caaef53f None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:24.113498 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 515/1031] 10.222.0.16 () {54 vars in 921 bytes} [Wed Nov 2 07:33:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:33:24.118581 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08921c4-02b3-4422-b254-59fd13bf191f None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:24.119015 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08921c4-02b3-4422-b254-59fd13bf191f None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:24.119176 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08921c4-02b3-4422-b254-59fd13bf191f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:24.196063 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-a08921c4-02b3-4422-b254-59fd13bf191f None None] MFA Rules not processed for user `741c9fc71c80438faa037c85f4997c3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:24.197293 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a08921c4-02b3-4422-b254-59fd13bf191f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:24.303941 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 517/1032] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Nov 2 07:33:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:27.879348 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e339273-1642-45fd-a294-ad2d629f254a None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:27.880283 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e339273-1642-45fd-a294-ad2d629f254a None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:27.880704 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e339273-1642-45fd-a294-ad2d629f254a None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:27.882205 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 516/1033] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:33:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:33:27.888021 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771b574-d39f-4692-b82d-5b8e2c6b92ac None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:27.889053 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771b574-d39f-4692-b82d-5b8e2c6b92ac None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:27.889224 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771b574-d39f-4692-b82d-5b8e2c6b92ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:27.929401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:27.966002 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-b771b574-d39f-4692-b82d-5b8e2c6b92ac None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:27.968277 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b771b574-d39f-4692-b82d-5b8e2c6b92ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:28.076663 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 518/1034] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:28.379136 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145f31e-79f3-44da-a95a-0aa589dd0b79 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:28.379747 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145f31e-79f3-44da-a95a-0aa589dd0b79 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:28.380540 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145f31e-79f3-44da-a95a-0aa589dd0b79 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:28.382520 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 517/1035] 10.222.0.16 () {54 vars in 961 bytes} [Wed Nov 2 07:33:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:33:28.391949 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125cd4bd-4c39-44ab-9db3-db7db535d79a None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:28.392628 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125cd4bd-4c39-44ab-9db3-db7db535d79a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:28.393121 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125cd4bd-4c39-44ab-9db3-db7db535d79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:28.475492 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-125cd4bd-4c39-44ab-9db3-db7db535d79a None None] MFA Rules not processed for user `232210eabdfd4969a348d7333c50c438`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:28.477925 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-125cd4bd-4c39-44ab-9db3-db7db535d79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:28.533416 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:28.604182 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 519/1036] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Nov 2 07:33:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:28.612885 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145f31e-79f3-44da-a95a-0aa589dd0b79 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:28.614478 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-9145f31e-79f3-44da-a95a-0aa589dd0b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:28.790462 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145f31e-79f3-44da-a95a-0aa589dd0b79 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:28.869396 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:28.912602 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10c88f-a0f3-4739-aee2-f323a0a70b88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:28.913297 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10c88f-a0f3-4739-aee2-f323a0a70b88 service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:28.913607 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10c88f-a0f3-4739-aee2-f323a0a70b88 service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:28.913941 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10c88f-a0f3-4739-aee2-f323a0a70b88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:28.915577 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-3c10c88f-a0f3-4739-aee2-f323a0a70b88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:29.029927 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10c88f-a0f3-4739-aee2-f323a0a70b88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:29.031609 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10c88f-a0f3-4739-aee2-f323a0a70b88 service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:29.055334 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 518/1037] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:31.516569 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de53ba3-b35a-4fc4-b0d3-6a05641f8f55 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:31.517319 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de53ba3-b35a-4fc4-b0d3-6a05641f8f55 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:31.517319 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de53ba3-b35a-4fc4-b0d3-6a05641f8f55 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:31.523494 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694a545-d1d1-48a7-9251-20c9cc5343ea None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:31.524008 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694a545-d1d1-48a7-9251-20c9cc5343ea None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:31.524008 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694a545-d1d1-48a7-9251-20c9cc5343ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:31.528467 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 520/1038] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:33:31 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:33:31.595014 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-c694a545-d1d1-48a7-9251-20c9cc5343ea None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:31.596357 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c694a545-d1d1-48a7-9251-20c9cc5343ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:31.641720 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:31.705017 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 519/1039] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:33:32.006346 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de53ba3-b35a-4fc4-b0d3-6a05641f8f55 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:32.008124 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5de53ba3-b35a-4fc4-b0d3-6a05641f8f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:32.186576 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de53ba3-b35a-4fc4-b0d3-6a05641f8f55 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:32.197832 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:32.324528 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f08ca8-217f-49c9-b852-fc15489eded1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:32.325134 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f08ca8-217f-49c9-b852-fc15489eded1 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:32.325406 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f08ca8-217f-49c9-b852-fc15489eded1 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:32.325703 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f08ca8-217f-49c9-b852-fc15489eded1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:32.327279 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-26f08ca8-217f-49c9-b852-fc15489eded1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:32.423241 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f08ca8-217f-49c9-b852-fc15489eded1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:32.424903 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f08ca8-217f-49c9-b852-fc15489eded1 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:32.443315 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 521/1040] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:35.058478 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21d65f-d1b7-4f79-9e7f-6f28a3e009da None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:35.059023 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21d65f-d1b7-4f79-9e7f-6f28a3e009da None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:35.059023 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21d65f-d1b7-4f79-9e7f-6f28a3e009da None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:35.060858 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 520/1041] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:33:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:33:35.065976 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93067ef1-a9f5-4b59-ac56-0462ca47ef43 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:35.066410 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93067ef1-a9f5-4b59-ac56-0462ca47ef43 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:35.066510 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93067ef1-a9f5-4b59-ac56-0462ca47ef43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:35.082405 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:35.135095 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-93067ef1-a9f5-4b59-ac56-0462ca47ef43 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:35.136393 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-93067ef1-a9f5-4b59-ac56-0462ca47ef43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:35.238054 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 522/1042] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:35.555677 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55254c8c-ce32-4d80-8e00-089646234340 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:35.555677 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55254c8c-ce32-4d80-8e00-089646234340 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:35.555677 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55254c8c-ce32-4d80-8e00-089646234340 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:35.555677 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 521/1043] 10.222.0.16 () {54 vars in 961 bytes} [Wed Nov 2 07:33:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:33:35.556031 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222adc62-1fc4-4b9f-89f9-4d64d25a4914 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:35.556031 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222adc62-1fc4-4b9f-89f9-4d64d25a4914 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:35.556031 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222adc62-1fc4-4b9f-89f9-4d64d25a4914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:35.631723 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-222adc62-1fc4-4b9f-89f9-4d64d25a4914 None None] MFA Rules not processed for user `232210eabdfd4969a348d7333c50c438`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:35.633131 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-222adc62-1fc4-4b9f-89f9-4d64d25a4914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:35.670142 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:35.757323 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 523/1044] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Nov 2 07:33:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:35.766438 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55254c8c-ce32-4d80-8e00-089646234340 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:35.768010 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-55254c8c-ce32-4d80-8e00-089646234340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:35.932145 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55254c8c-ce32-4d80-8e00-089646234340 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:35.955271 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:36.055335 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe388aae-74ce-4ccd-b7d1-cf864b655f2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:36.055952 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe388aae-74ce-4ccd-b7d1-cf864b655f2a service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:36.056263 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe388aae-74ce-4ccd-b7d1-cf864b655f2a service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:36.056536 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe388aae-74ce-4ccd-b7d1-cf864b655f2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:36.058213 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-fe388aae-74ce-4ccd-b7d1-cf864b655f2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:36.157254 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe388aae-74ce-4ccd-b7d1-cf864b655f2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:36.158836 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe388aae-74ce-4ccd-b7d1-cf864b655f2a service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:36.178430 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 522/1045] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:36.186505 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ddac0-696e-425c-a467-32dd2731b882 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:36.186909 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ddac0-696e-425c-a467-32dd2731b882 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:36.187107 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ddac0-696e-425c-a467-32dd2731b882 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:36.188598 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 524/1046] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:33:36.193697 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93588454-7873-423b-9782-e54d3b2c304b None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:36.193986 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93588454-7873-423b-9782-e54d3b2c304b None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:36.194258 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93588454-7873-423b-9782-e54d3b2c304b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:36.227708 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:36.262563 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-93588454-7873-423b-9782-e54d3b2c304b None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:36.264574 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-93588454-7873-423b-9782-e54d3b2c304b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:36.369321 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 523/1047] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:36.711169 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226ee57-0050-4731-bb20-a25d648977eb None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:36.711169 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226ee57-0050-4731-bb20-a25d648977eb None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:36.711481 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226ee57-0050-4731-bb20-a25d648977eb None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:36.716847 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 525/1048] 10.222.0.16 () {54 vars in 963 bytes} [Wed Nov 2 07:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:33:36.719247 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824561b-88f8-45ca-b2c7-095301c632a6 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:36.719564 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824561b-88f8-45ca-b2c7-095301c632a6 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:36.719808 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824561b-88f8-45ca-b2c7-095301c632a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:36.805299 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-6824561b-88f8-45ca-b2c7-095301c632a6 None None] MFA Rules not processed for user `6c09b7eff03645ab9b7252ea96543719`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:36.806687 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-6824561b-88f8-45ca-b2c7-095301c632a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:36.861034 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:36.895657 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 524/1049] 10.222.0.16 () {58 vars in 1060 bytes} [Wed Nov 2 07:33:36 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:33:36.902741 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226ee57-0050-4731-bb20-a25d648977eb None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:36.904938 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2226ee57-0050-4731-bb20-a25d648977eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:37.030342 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226ee57-0050-4731-bb20-a25d648977eb None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:37.076371 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:37.114968 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5361b1-606f-4836-8c78-02e4fd79c7b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:37.115551 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5361b1-606f-4836-8c78-02e4fd79c7b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:37.115826 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5361b1-606f-4836-8c78-02e4fd79c7b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:37.116120 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5361b1-606f-4836-8c78-02e4fd79c7b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:37.117690 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-bc5361b1-606f-4836-8c78-02e4fd79c7b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:37.244642 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5361b1-606f-4836-8c78-02e4fd79c7b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:37.246153 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5361b1-606f-4836-8c78-02e4fd79c7b3 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:37.267932 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 526/1050] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:38.597530 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944cee5-8561-42b7-9964-d095b8cebd99 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:38.598065 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944cee5-8561-42b7-9964-d095b8cebd99 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:38.598065 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944cee5-8561-42b7-9964-d095b8cebd99 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:38.599505 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 525/1051] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:33:38.604875 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab64a75-acd2-46d7-a3a6-2df1dccbbe32 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:38.605281 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab64a75-acd2-46d7-a3a6-2df1dccbbe32 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:38.605421 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab64a75-acd2-46d7-a3a6-2df1dccbbe32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:38.676404 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-dab64a75-acd2-46d7-a3a6-2df1dccbbe32 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:38.677764 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-dab64a75-acd2-46d7-a3a6-2df1dccbbe32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:38.699382 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:38.780214 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 527/1052] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:39.076248 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944cee5-8561-42b7-9964-d095b8cebd99 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:39.077752 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f944cee5-8561-42b7-9964-d095b8cebd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:39.227320 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944cee5-8561-42b7-9964-d095b8cebd99 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:39.281382 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:39.349622 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bfd42-8d97-44af-86f8-b3f8d986a6aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:39.351206 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bfd42-8d97-44af-86f8-b3f8d986a6aa service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:39.351206 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bfd42-8d97-44af-86f8-b3f8d986a6aa service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:39.351206 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bfd42-8d97-44af-86f8-b3f8d986a6aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:39.352525 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-947bfd42-8d97-44af-86f8-b3f8d986a6aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:39.451702 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947bfd42-8d97-44af-86f8-b3f8d986a6aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:39.453388 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947bfd42-8d97-44af-86f8-b3f8d986a6aa service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:39.471617 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 526/1053] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:33:41.838716 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4faf1-51f2-4523-9a7e-eba7036cefbc None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:41.839266 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4faf1-51f2-4523-9a7e-eba7036cefbc None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:41.839266 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4faf1-51f2-4523-9a7e-eba7036cefbc None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:41.840786 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 528/1054] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:33:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:33:41.846029 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a70b55-901f-48dc-ab01-d0e39ed213dd None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:41.846433 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a70b55-901f-48dc-ab01-d0e39ed213dd None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:41.846631 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a70b55-901f-48dc-ab01-d0e39ed213dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:41.914376 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-06a70b55-901f-48dc-ab01-d0e39ed213dd None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:41.915723 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-06a70b55-901f-48dc-ab01-d0e39ed213dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:41.931301 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:42.023364 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 527/1055] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:33:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:42.315487 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4faf1-51f2-4523-9a7e-eba7036cefbc None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:42.317034 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-bab4faf1-51f2-4523-9a7e-eba7036cefbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:42.470418 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4faf1-51f2-4523-9a7e-eba7036cefbc None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:42.474590 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:42.600592 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11593a0-9319-4875-a47f-721abd0e5b58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:42.601384 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11593a0-9319-4875-a47f-721abd0e5b58 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:42.601758 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11593a0-9319-4875-a47f-721abd0e5b58 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:42.602128 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11593a0-9319-4875-a47f-721abd0e5b58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:42.603799 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e11593a0-9319-4875-a47f-721abd0e5b58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:42.701102 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11593a0-9319-4875-a47f-721abd0e5b58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:42.702928 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11593a0-9319-4875-a47f-721abd0e5b58 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:42.723839 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 529/1056] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:45.117201 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568583c-dda4-4a6e-8cdb-300c9e5b1a30 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:45.117723 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568583c-dda4-4a6e-8cdb-300c9e5b1a30 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:45.117723 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568583c-dda4-4a6e-8cdb-300c9e5b1a30 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:45.119073 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 528/1057] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:33:45.124518 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dbf94-6df1-4d84-be15-3d8a0ce058f0 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:45.124994 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dbf94-6df1-4d84-be15-3d8a0ce058f0 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:45.125151 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dbf94-6df1-4d84-be15-3d8a0ce058f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:45.136511 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:45.195929 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-0a1dbf94-6df1-4d84-be15-3d8a0ce058f0 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:45.197174 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0a1dbf94-6df1-4d84-be15-3d8a0ce058f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:45.296190 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 530/1058] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:33:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:45.594846 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568583c-dda4-4a6e-8cdb-300c9e5b1a30 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:45.597894 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c568583c-dda4-4a6e-8cdb-300c9e5b1a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:45.793573 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:45.804691 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568583c-dda4-4a6e-8cdb-300c9e5b1a30 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:45.922116 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca94dae-4d7c-474b-8a00-748eb4393cdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:45.922655 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca94dae-4d7c-474b-8a00-748eb4393cdc service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:45.922930 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca94dae-4d7c-474b-8a00-748eb4393cdc service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:45.923195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca94dae-4d7c-474b-8a00-748eb4393cdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:45.924851 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-eca94dae-4d7c-474b-8a00-748eb4393cdc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:46.033954 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca94dae-4d7c-474b-8a00-748eb4393cdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:46.035546 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca94dae-4d7c-474b-8a00-748eb4393cdc service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:46.046436 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:46.055273 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 529/1059] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:48.477105 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ef785-a574-4d27-a5db-2d720fac2a61 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:48.477782 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ef785-a574-4d27-a5db-2d720fac2a61 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:48.477782 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ef785-a574-4d27-a5db-2d720fac2a61 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:48.479063 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 531/1060] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:33:48.485412 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709525e-a392-4886-b4f2-ebc1b8d16b25 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:48.485838 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709525e-a392-4886-b4f2-ebc1b8d16b25 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:48.485987 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709525e-a392-4886-b4f2-ebc1b8d16b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:48.557731 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-a709525e-a392-4886-b4f2-ebc1b8d16b25 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:48.558953 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a709525e-a392-4886-b4f2-ebc1b8d16b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:48.676219 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 530/1061] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:48.967388 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ef785-a574-4d27-a5db-2d720fac2a61 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:48.968958 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f76ef785-a574-4d27-a5db-2d720fac2a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:49.062210 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:49.125726 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ef785-a574-4d27-a5db-2d720fac2a61 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:49.260457 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c3964e-2fe0-4033-b901-09172ed257b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:49.261088 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3964e-2fe0-4033-b901-09172ed257b8 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:49.261366 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3964e-2fe0-4033-b901-09172ed257b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:49.261637 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3964e-2fe0-4033-b901-09172ed257b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:49.264556 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-69c3964e-2fe0-4033-b901-09172ed257b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:49.317406 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:49.358799 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c3964e-2fe0-4033-b901-09172ed257b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:49.360526 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c3964e-2fe0-4033-b901-09172ed257b8 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:49.380344 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 532/1062] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:51.572407 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ea397-1ac7-4e4f-96b9-a383743f1248 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:51.572981 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ea397-1ac7-4e4f-96b9-a383743f1248 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:51.572981 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ea397-1ac7-4e4f-96b9-a383743f1248 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:51.574290 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 531/1063] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:33:51.580430 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f465d-6a93-4fe6-85e9-875402ca862b None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:51.580835 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f465d-6a93-4fe6-85e9-875402ca862b None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:51.580986 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f465d-6a93-4fe6-85e9-875402ca862b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:51.650254 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-e05f465d-6a93-4fe6-85e9-875402ca862b None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:51.651470 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e05f465d-6a93-4fe6-85e9-875402ca862b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:51.750196 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 533/1064] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:33:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:52.042626 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ea397-1ac7-4e4f-96b9-a383743f1248 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:52.044789 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-b62ea397-1ac7-4e4f-96b9-a383743f1248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:52.121853 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:52.190224 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ea397-1ac7-4e4f-96b9-a383743f1248 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:52.303142 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5936a17f-141a-42c3-abb6-e6d2a315c490 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:52.303661 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936a17f-141a-42c3-abb6-e6d2a315c490 service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:52.303937 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936a17f-141a-42c3-abb6-e6d2a315c490 service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:52.304232 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936a17f-141a-42c3-abb6-e6d2a315c490 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:52.305784 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-5936a17f-141a-42c3-abb6-e6d2a315c490 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:52.346194 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:52.397441 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5936a17f-141a-42c3-abb6-e6d2a315c490 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:52.399003 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5936a17f-141a-42c3-abb6-e6d2a315c490 service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:52.417392 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 532/1065] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:52.889209 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab56f5-4b71-41f6-899d-5d08d00327a2 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:52.889778 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab56f5-4b71-41f6-899d-5d08d00327a2 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:52.889778 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab56f5-4b71-41f6-899d-5d08d00327a2 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:52.891086 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 534/1066] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:33:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:33:52.896782 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab90d24-31bf-4f42-8133-19af268c3bbf None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:52.897239 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab90d24-31bf-4f42-8133-19af268c3bbf None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:52.897343 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab90d24-31bf-4f42-8133-19af268c3bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:52.967948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-dab90d24-31bf-4f42-8133-19af268c3bbf None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:52.970653 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-dab90d24-31bf-4f42-8133-19af268c3bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:53.066694 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 533/1067] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:33:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:53.373339 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b70e07-395f-48ad-87a7-b8ce12f7f67c None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:53.373740 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b70e07-395f-48ad-87a7-b8ce12f7f67c None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:53.374079 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b70e07-395f-48ad-87a7-b8ce12f7f67c None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:53.375576 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 535/1068] 10.222.0.16 () {54 vars in 962 bytes} [Wed Nov 2 07:33:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:33:53.380968 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a32b83-cf99-4686-8483-138e899b704c None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:53.381255 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a32b83-cf99-4686-8483-138e899b704c None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:53.381528 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a32b83-cf99-4686-8483-138e899b704c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:53.397918 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:53.462169 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-d6a32b83-cf99-4686-8483-138e899b704c None None] MFA Rules not processed for user `475f6e94957a4ae2b1248c8035231ebd`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:53.463407 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-d6a32b83-cf99-4686-8483-138e899b704c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:53.540120 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 534/1069] 10.222.0.16 () {58 vars in 1059 bytes} [Wed Nov 2 07:33:53 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:33:53.549642 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b70e07-395f-48ad-87a7-b8ce12f7f67c None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:53.551212 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-79b70e07-395f-48ad-87a7-b8ce12f7f67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:53.582540 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:53.655882 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b70e07-395f-48ad-87a7-b8ce12f7f67c None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:53.733224 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9986303-de4e-42dc-bfd6-5b851bbe9176 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '475f6e94957a4ae2b1248c8035231ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:53.733839 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9986303-de4e-42dc-bfd6-5b851bbe9176 service glance] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:53.734113 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9986303-de4e-42dc-bfd6-5b851bbe9176 service glance] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:53.734381 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9986303-de4e-42dc-bfd6-5b851bbe9176 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:53.735970 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f9986303-de4e-42dc-bfd6-5b851bbe9176 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:53.835244 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:53.871762 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9986303-de4e-42dc-bfd6-5b851bbe9176 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:53.873930 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9986303-de4e-42dc-bfd6-5b851bbe9176 service glance] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:53.894924 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 536/1070] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:54.741752 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326e9c5-d38e-4002-bb37-d4a900bd1eba None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:54.742300 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326e9c5-d38e-4002-bb37-d4a900bd1eba None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:54.742394 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326e9c5-d38e-4002-bb37-d4a900bd1eba None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:54.743669 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 535/1071] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:33:54.749089 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7b322-207b-4c6d-ab93-c8a2def800f9 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:54.749417 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7b322-207b-4c6d-ab93-c8a2def800f9 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:54.749734 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7b322-207b-4c6d-ab93-c8a2def800f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:54.818620 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-2ce7b322-207b-4c6d-ab93-c8a2def800f9 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:54.820143 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2ce7b322-207b-4c6d-ab93-c8a2def800f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:54.829718 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddb54b-ba9a-4e8e-b37c-ed1f3f769447 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:54.830003 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddb54b-ba9a-4e8e-b37c-ed1f3f769447 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:54.830278 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddb54b-ba9a-4e8e-b37c-ed1f3f769447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:54.903108 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-ceddb54b-ba9a-4e8e-b37c-ed1f3f769447 None None] MFA Rules not processed for user `0c65f5001a224e0b92e94dc6df9f8f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:54.904628 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-ceddb54b-ba9a-4e8e-b37c-ed1f3f769447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:54.924261 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 537/1072] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:33:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:54.963713 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:54.996351 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 536/1073] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Nov 2 07:33:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:33:55.042559 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6d013-655f-4fe7-be48-7e6e92cea980 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:55.042842 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6d013-655f-4fe7-be48-7e6e92cea980 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:55.043110 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6d013-655f-4fe7-be48-7e6e92cea980 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:55.045188 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 538/1074] 10.222.0.16 () {54 vars in 943 bytes} [Wed Nov 2 07:33:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:33:55.051109 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167fbe3-d5b9-4eae-98a8-82ac7a05cb68 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:55.051396 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167fbe3-d5b9-4eae-98a8-82ac7a05cb68 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:55.051669 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167fbe3-d5b9-4eae-98a8-82ac7a05cb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:55.128084 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-f167fbe3-d5b9-4eae-98a8-82ac7a05cb68 None None] MFA Rules not processed for user `68d63a04c2d74c90b95a4f48c49ddb29`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:55.129542 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f167fbe3-d5b9-4eae-98a8-82ac7a05cb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:55.216287 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6d013-655f-4fe7-be48-7e6e92cea980 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:55.217772 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-cfb6d013-655f-4fe7-be48-7e6e92cea980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:55.238785 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 537/1075] 10.222.0.16 () {58 vars in 1040 bytes} [Wed Nov 2 07:33:55 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:33:55.249202 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167fbe3-d5b9-4eae-98a8-82ac7a05cb68 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:55.258499 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167fbe3-d5b9-4eae-98a8-82ac7a05cb68 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:55.258978 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:55.284774 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:55.365633 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d8582-6ea2-46cc-bc03-4ce30ba5f885 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d63a04c2d74c90b95a4f48c49ddb29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:55.366498 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d8582-6ea2-46cc-bc03-4ce30ba5f885 service swift] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:55.366833 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d8582-6ea2-46cc-bc03-4ce30ba5f885 service swift] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:55.367160 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d8582-6ea2-46cc-bc03-4ce30ba5f885 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:55.369029 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-245d8582-6ea2-46cc-bc03-4ce30ba5f885 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:55.370793 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6d013-655f-4fe7-be48-7e6e92cea980 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:55.453172 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d8582-6ea2-46cc-bc03-4ce30ba5f885 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:55.454812 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d8582-6ea2-46cc-bc03-4ce30ba5f885 service swift] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:55.462715 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 538/1076] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Nov 2 07:33:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:33:55.486619 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:55.489170 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37543350-98e9-4674-8738-4bc247ed1b71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:55.489781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37543350-98e9-4674-8738-4bc247ed1b71 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:55.490057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37543350-98e9-4674-8738-4bc247ed1b71 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:55.490325 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37543350-98e9-4674-8738-4bc247ed1b71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:55.491945 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-37543350-98e9-4674-8738-4bc247ed1b71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:55.582760 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37543350-98e9-4674-8738-4bc247ed1b71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:55.584399 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37543350-98e9-4674-8738-4bc247ed1b71 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:55.602271 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 539/1077] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:57.993845 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d099c2-ee7a-4a8d-ba8f-9c3a7a02fcdf None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:57.994429 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d099c2-ee7a-4a8d-ba8f-9c3a7a02fcdf None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:57.994429 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d099c2-ee7a-4a8d-ba8f-9c3a7a02fcdf None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:57.996190 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 539/1078] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:33:58.002111 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acd6b3-84ff-4032-8a9a-6849b7bcba03 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:58.002671 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acd6b3-84ff-4032-8a9a-6849b7bcba03 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:58.002671 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acd6b3-84ff-4032-8a9a-6849b7bcba03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:58.080965 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-48acd6b3-84ff-4032-8a9a-6849b7bcba03 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:58.082305 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-48acd6b3-84ff-4032-8a9a-6849b7bcba03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:58.161518 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:58.192106 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 540/1079] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:58.487221 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d099c2-ee7a-4a8d-ba8f-9c3a7a02fcdf None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:58.488762 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-88d099c2-ee7a-4a8d-ba8f-9c3a7a02fcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:58.559601 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:58.669000 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d099c2-ee7a-4a8d-ba8f-9c3a7a02fcdf None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:58.817218 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1fe6c2-37a6-4e40-894f-df460cee3915 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:58.817831 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fe6c2-37a6-4e40-894f-df460cee3915 service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:58.818106 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fe6c2-37a6-4e40-894f-df460cee3915 service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:58.818377 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fe6c2-37a6-4e40-894f-df460cee3915 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:58.820025 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-7e1fe6c2-37a6-4e40-894f-df460cee3915 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:58.842122 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:58.920456 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1fe6c2-37a6-4e40-894f-df460cee3915 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:58.922415 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1fe6c2-37a6-4e40-894f-df460cee3915 service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:58.943885 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 540/1080] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:34:01.288358 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65ddea-e8e0-487a-b42a-176dfa0bbfd5 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:01.288885 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65ddea-e8e0-487a-b42a-176dfa0bbfd5 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:01.288885 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65ddea-e8e0-487a-b42a-176dfa0bbfd5 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:01.290139 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 541/1081] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:01.296138 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a78b6-aa89-4cff-8fd1-c68139a2ccfe None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:01.296630 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a78b6-aa89-4cff-8fd1-c68139a2ccfe None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:01.296720 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a78b6-aa89-4cff-8fd1-c68139a2ccfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:01.395254 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-c50a78b6-aa89-4cff-8fd1-c68139a2ccfe None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:01.396536 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c50a78b6-aa89-4cff-8fd1-c68139a2ccfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:01.504506 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:01.518811 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 541/1082] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:34:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:01.847417 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c65ddea-e8e0-487a-b42a-176dfa0bbfd5 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:01.848981 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6c65ddea-e8e0-487a-b42a-176dfa0bbfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:02.040585 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c65ddea-e8e0-487a-b42a-176dfa0bbfd5 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:02.101210 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:02.166792 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eca516-31b4-4eb4-872a-f29a428b9154 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:02.167482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eca516-31b4-4eb4-872a-f29a428b9154 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:02.167758 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eca516-31b4-4eb4-872a-f29a428b9154 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:02.168043 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eca516-31b4-4eb4-872a-f29a428b9154 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:02.169667 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-77eca516-31b4-4eb4-872a-f29a428b9154 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:02.272075 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eca516-31b4-4eb4-872a-f29a428b9154 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:02.273694 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eca516-31b4-4eb4-872a-f29a428b9154 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:02.308239 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 542/1083] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:34:04.624895 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb73224-adc8-4ce0-b9a6-38d9afb3514e None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:04.625426 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb73224-adc8-4ce0-b9a6-38d9afb3514e None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:04.625426 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb73224-adc8-4ce0-b9a6-38d9afb3514e None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:04.626990 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 542/1084] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:34:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:34:04.631993 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bc82e-c6ef-40ba-9e89-b0f53e0321b5 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:04.632444 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bc82e-c6ef-40ba-9e89-b0f53e0321b5 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:04.632589 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bc82e-c6ef-40ba-9e89-b0f53e0321b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:04.711311 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-3b6bc82e-c6ef-40ba-9e89-b0f53e0321b5 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:04.712567 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3b6bc82e-c6ef-40ba-9e89-b0f53e0321b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:04.726027 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:04.827047 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 543/1085] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:34:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:05.123648 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb73224-adc8-4ce0-b9a6-38d9afb3514e None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:05.125190 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-ceb73224-adc8-4ce0-b9a6-38d9afb3514e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:05.285918 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb73224-adc8-4ce0-b9a6-38d9afb3514e None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:05.357844 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:05.411111 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090d731-4f7a-4e50-8614-8eb066c0202f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:05.411727 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090d731-4f7a-4e50-8614-8eb066c0202f service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:05.412000 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090d731-4f7a-4e50-8614-8eb066c0202f service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:05.412317 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090d731-4f7a-4e50-8614-8eb066c0202f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:05.414120 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-b090d731-4f7a-4e50-8614-8eb066c0202f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:05.517367 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b090d731-4f7a-4e50-8614-8eb066c0202f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:05.518952 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b090d731-4f7a-4e50-8614-8eb066c0202f service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:05.540464 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 543/1086] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:34:14.825614 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=38 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:15.535382 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=64 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:19.583152 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f8ed0-f994-44a8-94df-48d8d5f63dd7 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:19.583724 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f8ed0-f994-44a8-94df-48d8d5f63dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:19.583724 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f8ed0-f994-44a8-94df-48d8d5f63dd7 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:19.585139 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 544/1087] 10.222.0.16 () {54 vars in 918 bytes} [Wed Nov 2 07:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:19.590313 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e7b2b-eef4-42ef-8d9b-5224f3386c7c None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:19.590752 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e7b2b-eef4-42ef-8d9b-5224f3386c7c None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:19.590857 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e7b2b-eef4-42ef-8d9b-5224f3386c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:19.664429 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-a32e7b2b-eef4-42ef-8d9b-5224f3386c7c None None] MFA Rules not processed for user `741c9fc71c80438faa037c85f4997c3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:19.665616 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a32e7b2b-eef4-42ef-8d9b-5224f3386c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:19.771973 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 544/1088] 10.222.0.16 () {58 vars in 1015 bytes} [Wed Nov 2 07:34:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:19.786853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6e10f-2ff1-461a-b92c-498afd413907 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:19.787136 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6e10f-2ff1-461a-b92c-498afd413907 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:19.787406 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6e10f-2ff1-461a-b92c-498afd413907 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:19.788784 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 545/1089] 10.222.0.16 () {54 vars in 918 bytes} [Wed Nov 2 07:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:19.793463 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6932140-c236-4af4-9793-a63b0653522e None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:19.793819 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6932140-c236-4af4-9793-a63b0653522e None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:19.794118 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6932140-c236-4af4-9793-a63b0653522e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:19.867348 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:19.869827 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-e6932140-c236-4af4-9793-a63b0653522e None None] MFA Rules not processed for user `232210eabdfd4969a348d7333c50c438`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:19.871019 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e6932140-c236-4af4-9793-a63b0653522e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:19.983341 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 545/1090] 10.222.0.16 () {58 vars in 1015 bytes} [Wed Nov 2 07:34:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:22.544124 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879d588-66f9-4d41-a2aa-3fe2521e87d8 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:22.544691 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879d588-66f9-4d41-a2aa-3fe2521e87d8 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:22.544691 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879d588-66f9-4d41-a2aa-3fe2521e87d8 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:22.546176 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 546/1091] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:22.551533 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac5ff6-0232-4e33-9fec-69533c267898 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:22.551962 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac5ff6-0232-4e33-9fec-69533c267898 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:22.552133 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac5ff6-0232-4e33-9fec-69533c267898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:22.616550 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-69ac5ff6-0232-4e33-9fec-69533c267898 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:22.617747 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-69ac5ff6-0232-4e33-9fec-69533c267898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:22.672667 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:22.713934 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 546/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:23.006631 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1879d588-66f9-4d41-a2aa-3fe2521e87d8 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:23.008211 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-1879d588-66f9-4d41-a2aa-3fe2521e87d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:23.154761 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1879d588-66f9-4d41-a2aa-3fe2521e87d8 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:23.226427 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:23.265981 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8415b9d7-0d34-452d-b1ee-6160653aa40d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:23.266579 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415b9d7-0d34-452d-b1ee-6160653aa40d service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:23.266856 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415b9d7-0d34-452d-b1ee-6160653aa40d service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:23.267390 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415b9d7-0d34-452d-b1ee-6160653aa40d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:23.269024 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8415b9d7-0d34-452d-b1ee-6160653aa40d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:23.358886 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8415b9d7-0d34-452d-b1ee-6160653aa40d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:23.360511 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8415b9d7-0d34-452d-b1ee-6160653aa40d service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:23.378250 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 547/1093] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:34:24.499625 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04bdc7f-853e-49ad-a5c9-d76c679342ea None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:24.500247 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04bdc7f-853e-49ad-a5c9-d76c679342ea None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:24.500247 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04bdc7f-853e-49ad-a5c9-d76c679342ea None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:24.501532 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 547/1094] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:34:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:24.506390 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437bab7-d741-4a7b-8d20-f1d2acc2fbbb None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:24.506806 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437bab7-d741-4a7b-8d20-f1d2acc2fbbb None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:24.506942 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437bab7-d741-4a7b-8d20-f1d2acc2fbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:24.582123 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-e437bab7-d741-4a7b-8d20-f1d2acc2fbbb None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:24.583332 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e437bab7-d741-4a7b-8d20-f1d2acc2fbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:24.610256 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:24.678712 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 548/1095] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:24.847874 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04bdc7f-853e-49ad-a5c9-d76c679342ea None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:24.849399 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-d04bdc7f-853e-49ad-a5c9-d76c679342ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:24.992563 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04bdc7f-853e-49ad-a5c9-d76c679342ea None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:25.033536 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:25.104942 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69401f9f-21fb-4b5c-a967-db6e7aab4372 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:25.105459 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69401f9f-21fb-4b5c-a967-db6e7aab4372 service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:25.105732 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69401f9f-21fb-4b5c-a967-db6e7aab4372 service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:25.105997 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69401f9f-21fb-4b5c-a967-db6e7aab4372 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:25.107638 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-69401f9f-21fb-4b5c-a967-db6e7aab4372 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:25.196071 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69401f9f-21fb-4b5c-a967-db6e7aab4372 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:25.197639 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69401f9f-21fb-4b5c-a967-db6e7aab4372 service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:25.215810 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 548/1096] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:34:26.333980 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85f12a-d8d8-4733-8da4-275e920d1c1e None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:26.334502 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85f12a-d8d8-4733-8da4-275e920d1c1e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:26.334502 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85f12a-d8d8-4733-8da4-275e920d1c1e None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:26.335859 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 549/1097] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:26.340721 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be2aec-9004-4fbd-a314-2c9afefd12ad None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:26.341152 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be2aec-9004-4fbd-a314-2c9afefd12ad None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:26.341289 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be2aec-9004-4fbd-a314-2c9afefd12ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:26.395480 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:26.416289 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-08be2aec-9004-4fbd-a314-2c9afefd12ad None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:26.417462 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-08be2aec-9004-4fbd-a314-2c9afefd12ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:26.511790 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 549/1098] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:26.665101 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85f12a-d8d8-4733-8da4-275e920d1c1e None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:26.666523 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9b85f12a-d8d8-4733-8da4-275e920d1c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:26.813091 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85f12a-d8d8-4733-8da4-275e920d1c1e None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:26.825276 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:26.925999 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3558fce-a123-4988-8a2c-57b1a7064347 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:26.926538 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3558fce-a123-4988-8a2c-57b1a7064347 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:26.926814 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3558fce-a123-4988-8a2c-57b1a7064347 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:26.927083 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3558fce-a123-4988-8a2c-57b1a7064347 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:26.928711 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f3558fce-a123-4988-8a2c-57b1a7064347 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:27.018187 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3558fce-a123-4988-8a2c-57b1a7064347 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:27.019796 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3558fce-a123-4988-8a2c-57b1a7064347 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:27.037921 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 550/1099] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:34:28.130548 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ba363-73ff-4a8f-a320-de3da0c19e15 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:28.131009 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ba363-73ff-4a8f-a320-de3da0c19e15 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:28.131107 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ba363-73ff-4a8f-a320-de3da0c19e15 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:28.132441 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 550/1100] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:28.137184 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31af6e2-b4dc-49eb-bdeb-cc0979e9473d None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:28.137586 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31af6e2-b4dc-49eb-bdeb-cc0979e9473d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:28.137762 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31af6e2-b4dc-49eb-bdeb-cc0979e9473d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:28.158384 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:28.215270 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-a31af6e2-b4dc-49eb-bdeb-cc0979e9473d None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:28.216439 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a31af6e2-b4dc-49eb-bdeb-cc0979e9473d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:28.313400 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 551/1101] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:34:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:28.460746 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ba363-73ff-4a8f-a320-de3da0c19e15 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:28.462238 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-7a2ba363-73ff-4a8f-a320-de3da0c19e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:28.571399 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:28.606576 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ba363-73ff-4a8f-a320-de3da0c19e15 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:28.717303 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f20f8e-5896-47e7-b627-479ddf86dcf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:28.717877 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f20f8e-5896-47e7-b627-479ddf86dcf9 service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:28.718148 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f20f8e-5896-47e7-b627-479ddf86dcf9 service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:28.718415 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f20f8e-5896-47e7-b627-479ddf86dcf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:28.720002 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-18f20f8e-5896-47e7-b627-479ddf86dcf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:28.799768 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:28.813057 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f20f8e-5896-47e7-b627-479ddf86dcf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:28.815157 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f20f8e-5896-47e7-b627-479ddf86dcf9 service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:28.833048 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 551/1102] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:34:29.940367 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172aa20-0034-49ac-8b18-5e8ad726425d None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:29.940927 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172aa20-0034-49ac-8b18-5e8ad726425d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:29.940927 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172aa20-0034-49ac-8b18-5e8ad726425d None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:29.942255 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 552/1103] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:29.947275 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22753e8f-82dd-4557-8380-864b4662b47d None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:29.947698 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22753e8f-82dd-4557-8380-864b4662b47d None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:29.947854 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22753e8f-82dd-4557-8380-864b4662b47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:30.022838 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-22753e8f-82dd-4557-8380-864b4662b47d None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:30.024073 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-22753e8f-82dd-4557-8380-864b4662b47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:30.123375 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 552/1104] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:34:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:30.274643 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3172aa20-0034-49ac-8b18-5e8ad726425d None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:30.276109 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3172aa20-0034-49ac-8b18-5e8ad726425d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:30.359463 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:30.422011 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3172aa20-0034-49ac-8b18-5e8ad726425d None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:30.532482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e666f4-964e-4f0b-b62b-19c89a6a3002 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:30.532981 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e666f4-964e-4f0b-b62b-19c89a6a3002 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:30.533252 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e666f4-964e-4f0b-b62b-19c89a6a3002 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:30.533515 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e666f4-964e-4f0b-b62b-19c89a6a3002 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:30.535068 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f2e666f4-964e-4f0b-b62b-19c89a6a3002 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:30.581761 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:30.621249 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e666f4-964e-4f0b-b62b-19c89a6a3002 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:30.622947 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e666f4-964e-4f0b-b62b-19c89a6a3002 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:30.641448 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 553/1105] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:34:31.827605 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552578b-c4c8-4620-9f50-4c83d44964bf None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:31.828267 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552578b-c4c8-4620-9f50-4c83d44964bf None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:31.828267 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552578b-c4c8-4620-9f50-4c83d44964bf None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:31.829527 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 553/1106] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:34:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:31.834836 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5feed0-4c62-4eb4-beb1-a8fab69743e6 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:31.835309 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5feed0-4c62-4eb4-beb1-a8fab69743e6 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:31.835505 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5feed0-4c62-4eb4-beb1-a8fab69743e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:31.917575 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-bd5feed0-4c62-4eb4-beb1-a8fab69743e6 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:31.918922 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-bd5feed0-4c62-4eb4-beb1-a8fab69743e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:32.026188 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 554/1107] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:34:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:32.176964 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552578b-c4c8-4620-9f50-4c83d44964bf None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:32.178458 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-2552578b-c4c8-4620-9f50-4c83d44964bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:32.227110 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:32.324817 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552578b-c4c8-4620-9f50-4c83d44964bf None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:32.435154 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263eea4-9aa8-45d7-8fa0-bee74cea2464 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:32.435766 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263eea4-9aa8-45d7-8fa0-bee74cea2464 service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:32.436043 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263eea4-9aa8-45d7-8fa0-bee74cea2464 service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:32.436342 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263eea4-9aa8-45d7-8fa0-bee74cea2464 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:32.437928 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-6263eea4-9aa8-45d7-8fa0-bee74cea2464 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:32.444628 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:32.525072 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263eea4-9aa8-45d7-8fa0-bee74cea2464 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:32.526636 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263eea4-9aa8-45d7-8fa0-bee74cea2464 service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:32.544455 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 554/1108] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:34:33.645650 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f24df-85b9-47ff-80c0-544e073061f8 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:33.646217 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f24df-85b9-47ff-80c0-544e073061f8 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:33.646217 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f24df-85b9-47ff-80c0-544e073061f8 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:33.647574 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 555/1109] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:33.652697 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f32745-0b65-4290-8a4a-7b1275fb7354 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:33.653117 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f32745-0b65-4290-8a4a-7b1275fb7354 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:33.653232 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f32745-0b65-4290-8a4a-7b1275fb7354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:33.726476 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-73f32745-0b65-4290-8a4a-7b1275fb7354 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:33.727661 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-73f32745-0b65-4290-8a4a-7b1275fb7354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:33.795235 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:33.823623 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 555/1110] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:34:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:34:33.975507 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f24df-85b9-47ff-80c0-544e073061f8 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:33.977060 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7d8f24df-85b9-47ff-80c0-544e073061f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:33.994429 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:34.125957 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f24df-85b9-47ff-80c0-544e073061f8 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:34.214492 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:34.240761 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d972f4e-311c-4a6f-9d68-7009a301cf3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:34.241363 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d972f4e-311c-4a6f-9d68-7009a301cf3f service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:34.241634 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d972f4e-311c-4a6f-9d68-7009a301cf3f service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:34.241900 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d972f4e-311c-4a6f-9d68-7009a301cf3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:34.243465 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3d972f4e-311c-4a6f-9d68-7009a301cf3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:34.331070 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d972f4e-311c-4a6f-9d68-7009a301cf3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:34.332688 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d972f4e-311c-4a6f-9d68-7009a301cf3f service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:34.350111 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 556/1111] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:34:35.470680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831dfeed-9c56-40a2-a67f-a000add85675 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:35.471261 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831dfeed-9c56-40a2-a67f-a000add85675 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:35.471261 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831dfeed-9c56-40a2-a67f-a000add85675 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:35.472646 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 556/1112] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:34:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:35.477576 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb797ff-3325-4e9f-af03-d509a1758900 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:35.478010 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb797ff-3325-4e9f-af03-d509a1758900 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:35.478129 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb797ff-3325-4e9f-af03-d509a1758900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:35.553511 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-ebb797ff-3325-4e9f-af03-d509a1758900 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:35.554705 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ebb797ff-3325-4e9f-af03-d509a1758900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:35.596067 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:35.649779 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 557/1113] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:35.800238 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831dfeed-9c56-40a2-a67f-a000add85675 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:35.801689 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-831dfeed-9c56-40a2-a67f-a000add85675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:35.945343 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831dfeed-9c56-40a2-a67f-a000add85675 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:35.999313 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:36.057384 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9ad62-bc45-46cd-8ba2-6e979817f6d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:36.057909 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9ad62-bc45-46cd-8ba2-6e979817f6d7 service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:36.058184 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9ad62-bc45-46cd-8ba2-6e979817f6d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:36.058449 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9ad62-bc45-46cd-8ba2-6e979817f6d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:36.060160 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-7cf9ad62-bc45-46cd-8ba2-6e979817f6d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:36.149730 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf9ad62-bc45-46cd-8ba2-6e979817f6d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:36.151284 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf9ad62-bc45-46cd-8ba2-6e979817f6d7 service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:36.169045 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 557/1114] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:34:37.269418 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aac71e-9ca3-46eb-8fa1-c3e9bd5c7730 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:37.269932 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aac71e-9ca3-46eb-8fa1-c3e9bd5c7730 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:37.269932 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aac71e-9ca3-46eb-8fa1-c3e9bd5c7730 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:37.271230 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 558/1115] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:37.276019 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361656bb-fe51-4a16-86a0-4cbc8727ea1a None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:37.276461 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361656bb-fe51-4a16-86a0-4cbc8727ea1a None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:37.276574 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361656bb-fe51-4a16-86a0-4cbc8727ea1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:37.351321 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-361656bb-fe51-4a16-86a0-4cbc8727ea1a None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:37.352555 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-361656bb-fe51-4a16-86a0-4cbc8727ea1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:37.354530 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:37.447048 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 558/1116] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:34:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:37.596975 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aac71e-9ca3-46eb-8fa1-c3e9bd5c7730 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:37.598536 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-94aac71e-9ca3-46eb-8fa1-c3e9bd5c7730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:37.744962 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aac71e-9ca3-46eb-8fa1-c3e9bd5c7730 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:37.773158 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:37.858233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b993dc6-86ee-4679-86af-8037fba7b934 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:37.858756 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b993dc6-86ee-4679-86af-8037fba7b934 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:37.859031 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b993dc6-86ee-4679-86af-8037fba7b934 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:37.859300 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b993dc6-86ee-4679-86af-8037fba7b934 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:37.860927 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2b993dc6-86ee-4679-86af-8037fba7b934 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:37.949392 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b993dc6-86ee-4679-86af-8037fba7b934 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:37.951649 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b993dc6-86ee-4679-86af-8037fba7b934 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:37.970436 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 559/1117] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:34:40.024206 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318340d1-262c-4dc8-b623-f569086d8a7d None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:40.024768 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318340d1-262c-4dc8-b623-f569086d8a7d None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:40.024768 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318340d1-262c-4dc8-b623-f569086d8a7d None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:40.026137 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 559/1118] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:40.031856 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257c6c8-bb4e-4fd3-8a60-765ad6a60082 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:40.032345 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257c6c8-bb4e-4fd3-8a60-765ad6a60082 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:40.032475 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257c6c8-bb4e-4fd3-8a60-765ad6a60082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:40.073310 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:40.098883 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-0257c6c8-bb4e-4fd3-8a60-765ad6a60082 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:40.100134 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0257c6c8-bb4e-4fd3-8a60-765ad6a60082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:40.195248 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 560/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:34:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:40.476180 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318340d1-262c-4dc8-b623-f569086d8a7d None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:40.477713 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-318340d1-262c-4dc8-b623-f569086d8a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:40.579260 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318340d1-262c-4dc8-b623-f569086d8a7d None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:40.611775 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:40.652151 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca5cfc-cb13-4a4e-ac0b-091f115f9c2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:40.652753 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca5cfc-cb13-4a4e-ac0b-091f115f9c2e service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:40.653031 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca5cfc-cb13-4a4e-ac0b-091f115f9c2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:40.653301 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca5cfc-cb13-4a4e-ac0b-091f115f9c2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:40.655382 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-15ca5cfc-cb13-4a4e-ac0b-091f115f9c2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:40.765234 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca5cfc-cb13-4a4e-ac0b-091f115f9c2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:40.766577 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca5cfc-cb13-4a4e-ac0b-091f115f9c2e service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:40.784394 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 560/1120] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:34:43.120257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16a760-34f3-45ad-8b2d-19ba45b39277 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:43.120788 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16a760-34f3-45ad-8b2d-19ba45b39277 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:43.120788 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16a760-34f3-45ad-8b2d-19ba45b39277 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:43.122104 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 561/1121] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:43.127434 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04570bbf-9226-474f-ada9-9f3a93ed92da None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:43.127983 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04570bbf-9226-474f-ada9-9f3a93ed92da None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:43.128115 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04570bbf-9226-474f-ada9-9f3a93ed92da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:43.193261 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-04570bbf-9226-474f-ada9-9f3a93ed92da None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:43.194372 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-04570bbf-9226-474f-ada9-9f3a93ed92da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:43.207374 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:43.289847 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 561/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:34:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:43.571733 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16a760-34f3-45ad-8b2d-19ba45b39277 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:43.573327 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ff16a760-34f3-45ad-8b2d-19ba45b39277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:43.680838 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16a760-34f3-45ad-8b2d-19ba45b39277 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:43.693881 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:43.756906 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feed063-47c4-4b10-9bfb-47afb55c6343 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:43.757508 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feed063-47c4-4b10-9bfb-47afb55c6343 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:43.757785 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feed063-47c4-4b10-9bfb-47afb55c6343 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:43.758056 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feed063-47c4-4b10-9bfb-47afb55c6343 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:43.759698 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8feed063-47c4-4b10-9bfb-47afb55c6343 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:43.870303 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feed063-47c4-4b10-9bfb-47afb55c6343 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:43.871733 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feed063-47c4-4b10-9bfb-47afb55c6343 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:43.891004 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 562/1123] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:34:46.425425 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d2482-674c-45ff-932c-050f951bb3ac None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:46.425959 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d2482-674c-45ff-932c-050f951bb3ac None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:46.426068 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d2482-674c-45ff-932c-050f951bb3ac None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:46.427378 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 562/1124] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:46.432717 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aab615-c210-4ceb-84a9-d1794741fe05 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:46.433156 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aab615-c210-4ceb-84a9-d1794741fe05 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:46.433266 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aab615-c210-4ceb-84a9-d1794741fe05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:46.480293 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:46.498926 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-62aab615-c210-4ceb-84a9-d1794741fe05 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:46.501532 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-62aab615-c210-4ceb-84a9-d1794741fe05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:46.594391 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 563/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:34:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:46.883441 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d2482-674c-45ff-932c-050f951bb3ac None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:46.884822 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-6e5d2482-674c-45ff-932c-050f951bb3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:46.986486 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d2482-674c-45ff-932c-050f951bb3ac None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:47.025793 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:47.059648 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb8e14-6bc5-4829-a56d-10c09dd7b1c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:47.060651 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb8e14-6bc5-4829-a56d-10c09dd7b1c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:47.060840 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb8e14-6bc5-4829-a56d-10c09dd7b1c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:47.061052 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb8e14-6bc5-4829-a56d-10c09dd7b1c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:47.062618 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-99fb8e14-6bc5-4829-a56d-10c09dd7b1c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:47.173252 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fb8e14-6bc5-4829-a56d-10c09dd7b1c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:47.174607 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fb8e14-6bc5-4829-a56d-10c09dd7b1c9 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:47.192864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 563/1126] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:34:49.499800 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5330c-9e15-450c-984a-7605c7d2e15f None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:49.500406 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5330c-9e15-450c-984a-7605c7d2e15f None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:49.500406 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5330c-9e15-450c-984a-7605c7d2e15f None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:49.501718 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 564/1127] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:49.507148 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c5fc6-1f4e-4b10-a1ea-ce42c7928ed9 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:49.507584 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c5fc6-1f4e-4b10-a1ea-ce42c7928ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:49.507721 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c5fc6-1f4e-4b10-a1ea-ce42c7928ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:49.572785 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-e54c5fc6-1f4e-4b10-a1ea-ce42c7928ed9 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:49.573955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e54c5fc6-1f4e-4b10-a1ea-ce42c7928ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:49.594488 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:49.669020 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 564/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:49.957847 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5330c-9e15-450c-984a-7605c7d2e15f None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:49.959374 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4aa5330c-9e15-450c-984a-7605c7d2e15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:50.061230 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5330c-9e15-450c-984a-7605c7d2e15f None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:50.082129 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:50.137180 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155a934-d893-42bb-81c3-a51e618cdc78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:50.137782 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155a934-d893-42bb-81c3-a51e618cdc78 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:50.138057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155a934-d893-42bb-81c3-a51e618cdc78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:50.139155 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155a934-d893-42bb-81c3-a51e618cdc78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:50.140813 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b155a934-d893-42bb-81c3-a51e618cdc78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:50.250761 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155a934-d893-42bb-81c3-a51e618cdc78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:50.252270 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155a934-d893-42bb-81c3-a51e618cdc78 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:50.270880 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 565/1129] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:34:52.533111 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6dc091-701d-4051-9505-8b2505184e9d None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:52.533649 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6dc091-701d-4051-9505-8b2505184e9d None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:52.533649 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6dc091-701d-4051-9505-8b2505184e9d None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:52.534977 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 565/1130] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:52.540439 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65b6ad-539b-4f29-b377-b0634c000def None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:52.540845 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65b6ad-539b-4f29-b377-b0634c000def None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:52.540987 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65b6ad-539b-4f29-b377-b0634c000def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:52.604116 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:52.607195 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-bb65b6ad-539b-4f29-b377-b0634c000def None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:52.608427 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-bb65b6ad-539b-4f29-b377-b0634c000def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:52.703791 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 566/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:34:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:52.998973 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6dc091-701d-4051-9505-8b2505184e9d None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:53.000549 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-6c6dc091-701d-4051-9505-8b2505184e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:53.103387 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6dc091-701d-4051-9505-8b2505184e9d None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:53.153298 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:53.177125 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd90e2b-b93b-44da-9d87-b2accf0e1c65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:53.177729 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd90e2b-b93b-44da-9d87-b2accf0e1c65 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:53.178004 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd90e2b-b93b-44da-9d87-b2accf0e1c65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:53.178275 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd90e2b-b93b-44da-9d87-b2accf0e1c65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:53.179852 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-2fd90e2b-b93b-44da-9d87-b2accf0e1c65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:53.287238 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd90e2b-b93b-44da-9d87-b2accf0e1c65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:53.288684 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd90e2b-b93b-44da-9d87-b2accf0e1c65 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:53.308066 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 566/1132] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:34:55.549431 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431e513-2ff0-4a6e-9f93-d5e1be142b5d None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:55.550002 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431e513-2ff0-4a6e-9f93-d5e1be142b5d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:55.550002 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431e513-2ff0-4a6e-9f93-d5e1be142b5d None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:55.551311 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 567/1133] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:55.556480 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a98c6-88f9-4f56-94f9-66de47ef2311 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:55.556922 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a98c6-88f9-4f56-94f9-66de47ef2311 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:55.557059 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a98c6-88f9-4f56-94f9-66de47ef2311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:55.621931 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-f55a98c6-88f9-4f56-94f9-66de47ef2311 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:55.623788 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f55a98c6-88f9-4f56-94f9-66de47ef2311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:55.661326 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:55.728410 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 567/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:56.011781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431e513-2ff0-4a6e-9f93-d5e1be142b5d None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:56.013965 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8431e513-2ff0-4a6e-9f93-d5e1be142b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:56.118751 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431e513-2ff0-4a6e-9f93-d5e1be142b5d None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:56.148559 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:56.198278 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7635ea-cec7-4b5d-a068-34195b8922f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:56.198798 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7635ea-cec7-4b5d-a068-34195b8922f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:56.199104 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7635ea-cec7-4b5d-a068-34195b8922f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:56.199377 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7635ea-cec7-4b5d-a068-34195b8922f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:56.202884 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-fc7635ea-cec7-4b5d-a068-34195b8922f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:56.313963 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7635ea-cec7-4b5d-a068-34195b8922f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:56.315422 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7635ea-cec7-4b5d-a068-34195b8922f9 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:56.333507 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 568/1135] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:34:58.537273 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac4c7e-efda-4026-9dea-2e45c528e971 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:58.537818 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac4c7e-efda-4026-9dea-2e45c528e971 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:58.537818 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac4c7e-efda-4026-9dea-2e45c528e971 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:58.539437 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 568/1136] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:34:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:58.545278 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042aa10-8fe2-4fe5-bc4a-9b5add2d8681 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:58.545692 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042aa10-8fe2-4fe5-bc4a-9b5add2d8681 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:58.545905 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042aa10-8fe2-4fe5-bc4a-9b5add2d8681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:58.612743 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-d042aa10-8fe2-4fe5-bc4a-9b5add2d8681 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:58.613983 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d042aa10-8fe2-4fe5-bc4a-9b5add2d8681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:58.622364 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:58.711455 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 569/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:34:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:59.002333 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac4c7e-efda-4026-9dea-2e45c528e971 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:59.005903 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-01ac4c7e-efda-4026-9dea-2e45c528e971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:59.106099 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac4c7e-efda-4026-9dea-2e45c528e971 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:59.160974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:59.178562 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe6374-05b9-4afe-afc8-a0c2c64c75cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:59.179158 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe6374-05b9-4afe-afc8-a0c2c64c75cf service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:59.179458 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe6374-05b9-4afe-afc8-a0c2c64c75cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:59.179726 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe6374-05b9-4afe-afc8-a0c2c64c75cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:59.181356 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-46fe6374-05b9-4afe-afc8-a0c2c64c75cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:59.288264 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe6374-05b9-4afe-afc8-a0c2c64c75cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:59.289687 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe6374-05b9-4afe-afc8-a0c2c64c75cf service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:59.308332 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 569/1138] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:35:01.501185 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b078d-6edc-45ef-ac69-1d34cc73db40 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:01.501753 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b078d-6edc-45ef-ac69-1d34cc73db40 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:01.501753 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b078d-6edc-45ef-ac69-1d34cc73db40 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:01.503047 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 570/1139] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:35:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:35:01.508388 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb7c99-85e6-43e4-a6b0-909d92eaaa63 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:01.508807 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb7c99-85e6-43e4-a6b0-909d92eaaa63 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:01.508918 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb7c99-85e6-43e4-a6b0-909d92eaaa63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:01.575140 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-5ccb7c99-85e6-43e4-a6b0-909d92eaaa63 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:35:01.576929 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-5ccb7c99-85e6-43e4-a6b0-909d92eaaa63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:01.613796 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:01.670762 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 570/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:35:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:35:01.953296 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b078d-6edc-45ef-ac69-1d34cc73db40 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:35:01.954812 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-aa0b078d-6edc-45ef-ac69-1d34cc73db40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:02.055983 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b078d-6edc-45ef-ac69-1d34cc73db40 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:35:02.093259 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:02.129835 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de232c7-18d7-4353-a86c-06bca1ed0aab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:35:02.130430 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de232c7-18d7-4353-a86c-06bca1ed0aab service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:02.130701 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de232c7-18d7-4353-a86c-06bca1ed0aab service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:02.130966 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de232c7-18d7-4353-a86c-06bca1ed0aab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:02.132560 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3de232c7-18d7-4353-a86c-06bca1ed0aab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:02.238146 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de232c7-18d7-4353-a86c-06bca1ed0aab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:35:02.239491 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de232c7-18d7-4353-a86c-06bca1ed0aab service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:35:02.257331 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 571/1141] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:35:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:35:04.446985 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64746e-bfef-4dbd-b40c-3ab92c406c0b None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:04.447563 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64746e-bfef-4dbd-b40c-3ab92c406c0b None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:04.447563 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64746e-bfef-4dbd-b40c-3ab92c406c0b None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:04.448953 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 571/1142] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:35:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:35:04.455240 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5c39f-6b6d-4e77-a390-395a83125c5e None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:04.455635 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5c39f-6b6d-4e77-a390-395a83125c5e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:04.455785 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5c39f-6b6d-4e77-a390-395a83125c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:04.521566 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-09d5c39f-6b6d-4e77-a390-395a83125c5e None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:35:04.522753 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-09d5c39f-6b6d-4e77-a390-395a83125c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:04.540772 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:04.618518 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 572/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:35:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:35:04.902464 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64746e-bfef-4dbd-b40c-3ab92c406c0b None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:35:04.904787 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-7b64746e-bfef-4dbd-b40c-3ab92c406c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:05.009858 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64746e-bfef-4dbd-b40c-3ab92c406c0b None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:35:05.074836 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:05.081773 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2c1e3-353c-425d-8e09-6f7344960be2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:35:05.082375 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2c1e3-353c-425d-8e09-6f7344960be2 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:05.084128 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2c1e3-353c-425d-8e09-6f7344960be2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:05.084128 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2c1e3-353c-425d-8e09-6f7344960be2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:05.084551 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-95b2c1e3-353c-425d-8e09-6f7344960be2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:05.191267 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b2c1e3-353c-425d-8e09-6f7344960be2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:35:05.192660 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b2c1e3-353c-425d-8e09-6f7344960be2 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:35:05.210508 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 572/1144] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:35:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:35:07.390345 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20269a-7b09-4416-9450-76e77df67ad2 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:07.391106 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20269a-7b09-4416-9450-76e77df67ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:07.391106 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20269a-7b09-4416-9450-76e77df67ad2 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:07.392240 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 573/1145] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:35:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:35:07.397656 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0db157-b6c5-442b-8632-c0974b674e13 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:07.398054 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0db157-b6c5-442b-8632-c0974b674e13 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:07.398204 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0db157-b6c5-442b-8632-c0974b674e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:07.464866 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-bc0db157-b6c5-442b-8632-c0974b674e13 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:35:07.466076 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-bc0db157-b6c5-442b-8632-c0974b674e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:07.513225 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:07.561396 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 573/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:35:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:35:07.843048 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20269a-7b09-4416-9450-76e77df67ad2 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:35:07.844769 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9e20269a-7b09-4416-9450-76e77df67ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:07.949211 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20269a-7b09-4416-9450-76e77df67ad2 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:35:07.998568 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:08.024733 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d52925-866c-4522-8de4-b4525b2d6ba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:35:08.025337 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d52925-866c-4522-8de4-b4525b2d6ba2 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:08.025612 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d52925-866c-4522-8de4-b4525b2d6ba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:08.025879 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d52925-866c-4522-8de4-b4525b2d6ba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:08.027533 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-02d52925-866c-4522-8de4-b4525b2d6ba2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:08.135805 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d52925-866c-4522-8de4-b4525b2d6ba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:35:08.137276 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d52925-866c-4522-8de4-b4525b2d6ba2 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:35:08.156499 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 574/1147] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:35:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:35:17.562421 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=22 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:18.154069 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=66 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:28.149829 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d998d4d-1159-45a8-baf6-e16007e34fcc None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:28.150391 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d998d4d-1159-45a8-baf6-e16007e34fcc None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:28.150502 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d998d4d-1159-45a8-baf6-e16007e34fcc None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:28.151800 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 574/1148] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:35:28.157073 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb930f17-b570-49c5-b001-d5f4d611fb16 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:28.157470 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb930f17-b570-49c5-b001-d5f4d611fb16 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:28.157614 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb930f17-b570-49c5-b001-d5f4d611fb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:28.223274 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-cb930f17-b570-49c5-b001-d5f4d611fb16 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:35:28.224438 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-cb930f17-b570-49c5-b001-d5f4d611fb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:28.320485 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 575/1149] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:35:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:35:28.620405 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39a39b-e9e1-45af-8e75-e516f668615d None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:28.620688 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39a39b-e9e1-45af-8e75-e516f668615d None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:28.620959 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39a39b-e9e1-45af-8e75-e516f668615d None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:28.622266 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 575/1150] 10.222.0.16 () {54 vars in 962 bytes} [Wed Nov 2 07:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:35:28.627432 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e83567-94b9-4327-afab-614fea7f2b7f None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:28.627713 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e83567-94b9-4327-afab-614fea7f2b7f None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:28.627986 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e83567-94b9-4327-afab-614fea7f2b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:28.703357 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-b9e83567-94b9-4327-afab-614fea7f2b7f None None] MFA Rules not processed for user `475f6e94957a4ae2b1248c8035231ebd`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:35:28.704605 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b9e83567-94b9-4327-afab-614fea7f2b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:28.726352 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:28.783693 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 576/1151] 10.222.0.16 () {58 vars in 1059 bytes} [Wed Nov 2 07:35:28 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:35:28.791738 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39a39b-e9e1-45af-8e75-e516f668615d None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:35:28.793369 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-4a39a39b-e9e1-45af-8e75-e516f668615d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:28.896009 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39a39b-e9e1-45af-8e75-e516f668615d None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:35:28.971200 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f527c-e5b9-43b7-93a9-52144fbd9573 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '475f6e94957a4ae2b1248c8035231ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:35:28.971801 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f527c-e5b9-43b7-93a9-52144fbd9573 service glance] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:28.972108 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f527c-e5b9-43b7-93a9-52144fbd9573 service glance] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:28.972379 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f527c-e5b9-43b7-93a9-52144fbd9573 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:28.973968 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-499f527c-e5b9-43b7-93a9-52144fbd9573 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:29.028029 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:29.082195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f527c-e5b9-43b7-93a9-52144fbd9573 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:35:29.083612 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f527c-e5b9-43b7-93a9-52144fbd9573 service glance] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:35:29.102535 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 576/1152] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:35:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:35:31.450707 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5aa660-486e-4c2f-a192-94af1e9a8785 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:31.451279 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5aa660-486e-4c2f-a192-94af1e9a8785 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:31.451279 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5aa660-486e-4c2f-a192-94af1e9a8785 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:31.453326 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 577/1153] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:35:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:35:31.459124 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4e5e6-e52c-493f-a3a0-484f3eb9d168 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:31.459635 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4e5e6-e52c-493f-a3a0-484f3eb9d168 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:31.459736 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4e5e6-e52c-493f-a3a0-484f3eb9d168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:31.537721 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-5ea4e5e6-e52c-493f-a3a0-484f3eb9d168 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:35:31.538946 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-5ea4e5e6-e52c-493f-a3a0-484f3eb9d168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:31.664911 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 577/1154] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:35:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:35:31.973024 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5aa660-486e-4c2f-a192-94af1e9a8785 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:35:31.974551 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2a5aa660-486e-4c2f-a192-94af1e9a8785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:32.105635 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5aa660-486e-4c2f-a192-94af1e9a8785 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:35:32.155597 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:32.199619 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1bf5e0-f3c1-46a6-bc19-6a7f17fb757e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:35:32.200166 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bf5e0-f3c1-46a6-bc19-6a7f17fb757e admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:32.200443 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bf5e0-f3c1-46a6-bc19-6a7f17fb757e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:32.200711 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bf5e0-f3c1-46a6-bc19-6a7f17fb757e admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:32.201336 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1bf5e0-f3c1-46a6-bc19-6a7f17fb757e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:35:32.203310 dv-cinder-804757-31-smb devstack@keystone.service[81611]: WARNING py.warnings [None req-ab1bf5e0-f3c1-46a6-bc19-6a7f17fb757e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:35:32.203310 dv-cinder-804757-31-smb devstack@keystone.service[81611]: warnings.warn(msg) Nov 02 07:35:32.203310 dv-cinder-804757-31-smb devstack@keystone.service[81611]: Nov 02 07:35:32.204479 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1bf5e0-f3c1-46a6-bc19-6a7f17fb757e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:35:32.223149 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 578/1155] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Nov 2 07:35:31 2022] GET /identity/v3/projects => generated 2553 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:35:34.469067 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566c330-eb89-40ee-92dd-fb3bd7fb9741 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:34.469646 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566c330-eb89-40ee-92dd-fb3bd7fb9741 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:34.469646 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566c330-eb89-40ee-92dd-fb3bd7fb9741 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:34.470925 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 578/1156] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:35:34.476157 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc4a01-5af7-4e21-981d-fe151584bd79 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:34.476602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc4a01-5af7-4e21-981d-fe151584bd79 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:34.476725 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc4a01-5af7-4e21-981d-fe151584bd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:34.543119 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-1ecc4a01-5af7-4e21-981d-fe151584bd79 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:35:34.544348 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-1ecc4a01-5af7-4e21-981d-fe151584bd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:34.653583 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 579/1157] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:35:34.957446 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566c330-eb89-40ee-92dd-fb3bd7fb9741 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:35:34.958998 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-8566c330-eb89-40ee-92dd-fb3bd7fb9741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:34.969118 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:35.118361 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566c330-eb89-40ee-92dd-fb3bd7fb9741 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:35:35.199147 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:35.232822 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b595410-e024-483d-8a5c-db1a887b998f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:35:35.233502 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b595410-e024-483d-8a5c-db1a887b998f service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:35.233844 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b595410-e024-483d-8a5c-db1a887b998f service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:35.234043 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b595410-e024-483d-8a5c-db1a887b998f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:35.235618 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-1b595410-e024-483d-8a5c-db1a887b998f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:35.324274 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b595410-e024-483d-8a5c-db1a887b998f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:35:35.325847 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b595410-e024-483d-8a5c-db1a887b998f service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:35:35.343971 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 579/1158] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:35:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:35:37.716013 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7d21d-31f7-485a-a6ff-34fd95eac619 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:37.716598 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7d21d-31f7-485a-a6ff-34fd95eac619 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:37.716598 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7d21d-31f7-485a-a6ff-34fd95eac619 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:37.717942 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 580/1159] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:35:37.723321 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e88aa-9a87-4821-a207-5e02707b41ae None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:37.723740 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e88aa-9a87-4821-a207-5e02707b41ae None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:37.723846 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e88aa-9a87-4821-a207-5e02707b41ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:37.790518 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-442e88aa-9a87-4821-a207-5e02707b41ae None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:35:37.791698 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-442e88aa-9a87-4821-a207-5e02707b41ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:37.843037 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:37.891859 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 580/1160] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:35:38.192307 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7d21d-31f7-485a-a6ff-34fd95eac619 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:35:38.193849 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ffc7d21d-31f7-485a-a6ff-34fd95eac619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:38.218791 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:38.303866 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7d21d-31f7-485a-a6ff-34fd95eac619 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:35:38.375765 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfafd0-f449-4f7f-8a9c-8852cf1dda25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:35:38.376388 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfafd0-f449-4f7f-8a9c-8852cf1dda25 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:38.376663 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfafd0-f449-4f7f-8a9c-8852cf1dda25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:38.376928 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfafd0-f449-4f7f-8a9c-8852cf1dda25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:38.378509 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-dccfafd0-f449-4f7f-8a9c-8852cf1dda25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:38.452278 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:38.487138 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccfafd0-f449-4f7f-8a9c-8852cf1dda25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:35:38.488643 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccfafd0-f449-4f7f-8a9c-8852cf1dda25 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:35:38.506258 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 581/1161] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:35:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:35:40.707646 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ad033-ecde-4e92-b1d0-2748aac125cf None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:40.708296 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ad033-ecde-4e92-b1d0-2748aac125cf None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:40.708296 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ad033-ecde-4e92-b1d0-2748aac125cf None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:40.709540 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 581/1162] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:35:40.714812 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5df144-d9aa-4538-9a5c-d94b11b32bff None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:40.715300 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5df144-d9aa-4538-9a5c-d94b11b32bff None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:40.715416 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5df144-d9aa-4538-9a5c-d94b11b32bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:40.785420 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-9a5df144-d9aa-4538-9a5c-d94b11b32bff None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:35:40.786627 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9a5df144-d9aa-4538-9a5c-d94b11b32bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:40.881861 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 582/1163] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:35:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:35:41.189883 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ad033-ecde-4e92-b1d0-2748aac125cf None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:35:41.191411 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f25ad033-ecde-4e92-b1d0-2748aac125cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:41.303208 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ad033-ecde-4e92-b1d0-2748aac125cf None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:35:41.403673 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:41.405097 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069ecd5-f7bf-470a-8506-265fe7136124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:35:41.405846 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069ecd5-f7bf-470a-8506-265fe7136124 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:41.406093 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069ecd5-f7bf-470a-8506-265fe7136124 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:41.406359 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069ecd5-f7bf-470a-8506-265fe7136124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:41.407963 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e069ecd5-f7bf-470a-8506-265fe7136124 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:41.525451 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069ecd5-f7bf-470a-8506-265fe7136124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:35:41.526786 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069ecd5-f7bf-470a-8506-265fe7136124 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:35:41.544547 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 582/1164] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:35:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:35:43.890602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082834bf-174e-4f34-b881-0832affb1f17 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:43.891137 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082834bf-174e-4f34-b881-0832affb1f17 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:43.891137 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082834bf-174e-4f34-b881-0832affb1f17 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:43.892510 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 583/1165] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:35:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:35:43.898004 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf418b6-dfb9-41b3-857e-691a7043f32d None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:43.898446 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf418b6-dfb9-41b3-857e-691a7043f32d None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:43.898556 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf418b6-dfb9-41b3-857e-691a7043f32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:43.965653 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-7bf418b6-dfb9-41b3-857e-691a7043f32d None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:35:43.966845 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-7bf418b6-dfb9-41b3-857e-691a7043f32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:44.019809 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:44.063484 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 583/1166] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:35:44.352624 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082834bf-174e-4f34-b881-0832affb1f17 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:35:44.354268 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-082834bf-174e-4f34-b881-0832affb1f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:44.390755 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:44.457197 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082834bf-174e-4f34-b881-0832affb1f17 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:35:44.529143 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429c27f-2fdc-49f8-87ad-56bc30f5cca2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:35:44.529738 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429c27f-2fdc-49f8-87ad-56bc30f5cca2 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:44.530565 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429c27f-2fdc-49f8-87ad-56bc30f5cca2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:44.531002 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429c27f-2fdc-49f8-87ad-56bc30f5cca2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:44.532660 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2429c27f-2fdc-49f8-87ad-56bc30f5cca2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:44.611256 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:44.639199 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429c27f-2fdc-49f8-87ad-56bc30f5cca2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:35:44.641539 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429c27f-2fdc-49f8-87ad-56bc30f5cca2 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:35:44.659710 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 584/1167] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:35:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:35:47.413058 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7d872-f290-4e55-a078-f560f5354b12 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:47.413621 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7d872-f290-4e55-a078-f560f5354b12 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:47.413621 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7d872-f290-4e55-a078-f560f5354b12 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:47.414956 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 584/1168] 10.222.0.16 () {54 vars in 927 bytes} [Wed Nov 2 07:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:35:47.420212 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a096d9-fdb0-452a-a783-bb96b8edc744 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:47.420721 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a096d9-fdb0-452a-a783-bb96b8edc744 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:47.420874 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a096d9-fdb0-452a-a783-bb96b8edc744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:47.487186 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-c8a096d9-fdb0-452a-a783-bb96b8edc744 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:35:47.488758 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c8a096d9-fdb0-452a-a783-bb96b8edc744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:47.584288 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 585/1169] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Nov 2 07:35:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:35:47.877363 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7d872-f290-4e55-a078-f560f5354b12 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:35:47.878887 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-cee7d872-f290-4e55-a078-f560f5354b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:47.987963 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7d872-f290-4e55-a078-f560f5354b12 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:35:48.061234 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca66cc47-b8cd-4b3a-8804-8989e0396898 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:35:48.061931 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66cc47-b8cd-4b3a-8804-8989e0396898 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:48.062220 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66cc47-b8cd-4b3a-8804-8989e0396898 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:48.062501 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66cc47-b8cd-4b3a-8804-8989e0396898 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:48.064133 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-ca66cc47-b8cd-4b3a-8804-8989e0396898 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:48.072672 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:48.173079 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca66cc47-b8cd-4b3a-8804-8989e0396898 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:35:48.174406 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca66cc47-b8cd-4b3a-8804-8989e0396898 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:35:48.191731 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 585/1170] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:35:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:35:57.582768 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=82 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:58.189517 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=50 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:22.009747 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7dc30-7faa-491b-997c-101db4dd8740 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:22.010291 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7dc30-7faa-491b-997c-101db4dd8740 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:22.010291 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7dc30-7faa-491b-997c-101db4dd8740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:22.085228 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-04b7dc30-7faa-491b-997c-101db4dd8740 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:22.086422 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-04b7dc30-7faa-491b-997c-101db4dd8740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:22.182439 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 586/1171] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:37:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:22.190714 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47365600-9cb9-411b-9e80-7f088200c0c0 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:22.191221 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47365600-9cb9-411b-9e80-7f088200c0c0 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:22.191324 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47365600-9cb9-411b-9e80-7f088200c0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:22.267320 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-47365600-9cb9-411b-9e80-7f088200c0c0 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:22.268470 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-47365600-9cb9-411b-9e80-7f088200c0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:22.364247 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 586/1172] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:37:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:22.369027 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7dc30-7faa-491b-997c-101db4dd8740 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:22.370240 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-04b7dc30-7faa-491b-997c-101db4dd8740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:22.381388 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7dc30-7faa-491b-997c-101db4dd8740 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:22.441820 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:22.474491 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44003c02-49cc-4bc3-b713-cc809b9ce3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:22.475085 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44003c02-49cc-4bc3-b713-cc809b9ce3b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:22.475356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44003c02-49cc-4bc3-b713-cc809b9ce3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:22.475619 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44003c02-49cc-4bc3-b713-cc809b9ce3b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:22.476272 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44003c02-49cc-4bc3-b713-cc809b9ce3b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:37:22.476567 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44003c02-49cc-4bc3-b713-cc809b9ce3b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:22.477573 dv-cinder-804757-31-smb devstack@keystone.service[81611]: WARNING py.warnings [None req-44003c02-49cc-4bc3-b713-cc809b9ce3b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:37:22.477573 dv-cinder-804757-31-smb devstack@keystone.service[81611]: warnings.warn(msg) Nov 02 07:37:22.477573 dv-cinder-804757-31-smb devstack@keystone.service[81611]: Nov 02 07:37:22.478462 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44003c02-49cc-4bc3-b713-cc809b9ce3b6 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:22.489331 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 587/1173] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:37:22.498711 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47365600-9cb9-411b-9e80-7f088200c0c0 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:22.508198 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47365600-9cb9-411b-9e80-7f088200c0c0 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:22.569340 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:22.608621 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01cd1a-f54e-4141-82fc-b1c852e570a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:22.609222 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01cd1a-f54e-4141-82fc-b1c852e570a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:22.609494 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01cd1a-f54e-4141-82fc-b1c852e570a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:22.609758 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01cd1a-f54e-4141-82fc-b1c852e570a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:22.610423 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c01cd1a-f54e-4141-82fc-b1c852e570a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:22.611509 dv-cinder-804757-31-smb devstack@keystone.service[81610]: WARNING py.warnings [None req-8c01cd1a-f54e-4141-82fc-b1c852e570a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:37:22.611509 dv-cinder-804757-31-smb devstack@keystone.service[81610]: warnings.warn(msg) Nov 02 07:37:22.611509 dv-cinder-804757-31-smb devstack@keystone.service[81610]: Nov 02 07:37:22.612724 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c01cd1a-f54e-4141-82fc-b1c852e570a2 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:22.718576 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 587/1174] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:37:22 2022] POST /identity/v3/projects => generated 379 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:37:22.722771 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44003c02-49cc-4bc3-b713-cc809b9ce3b6 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:22.724641 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-44003c02-49cc-4bc3-b713-cc809b9ce3b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:22.758411 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44003c02-49cc-4bc3-b713-cc809b9ce3b6 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:22.852221 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddebb45-049e-4cd4-8783-ac831ba4106e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:22.852819 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddebb45-049e-4cd4-8783-ac831ba4106e admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:22.853090 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddebb45-049e-4cd4-8783-ac831ba4106e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:22.853356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddebb45-049e-4cd4-8783-ac831ba4106e admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:22.853973 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddebb45-049e-4cd4-8783-ac831ba4106e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:22.855117 dv-cinder-804757-31-smb devstack@keystone.service[81611]: WARNING py.warnings [None req-bddebb45-049e-4cd4-8783-ac831ba4106e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:37:22.855117 dv-cinder-804757-31-smb devstack@keystone.service[81611]: warnings.warn(msg) Nov 02 07:37:22.855117 dv-cinder-804757-31-smb devstack@keystone.service[81611]: Nov 02 07:37:22.856427 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddebb45-049e-4cd4-8783-ac831ba4106e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:22.984373 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 588/1175] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:37:22 2022] POST /identity/v3/users => generated 290 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:37:22.988871 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01cd1a-f54e-4141-82fc-b1c852e570a2 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:22.990397 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-8c01cd1a-f54e-4141-82fc-b1c852e570a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:23.052452 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01cd1a-f54e-4141-82fc-b1c852e570a2 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:23.134782 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:23.144940 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8edb4-7a5b-44ae-9ad1-2243f174e25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:23.147469 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8edb4-7a5b-44ae-9ad1-2243f174e25b admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:23.147469 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8edb4-7a5b-44ae-9ad1-2243f174e25b admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:23.147469 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8edb4-7a5b-44ae-9ad1-2243f174e25b admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:23.147469 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8edb4-7a5b-44ae-9ad1-2243f174e25b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:23.148622 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8edb4-7a5b-44ae-9ad1-2243f174e25b admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:23.161571 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 588/1176] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:37:23.165532 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddebb45-049e-4cd4-8783-ac831ba4106e admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:23.167133 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-bddebb45-049e-4cd4-8783-ac831ba4106e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:23.179155 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddebb45-049e-4cd4-8783-ac831ba4106e admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:23.204422 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:23.274066 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab18a6-ddd8-46ea-8166-7edfd8e170e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:23.274650 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab18a6-ddd8-46ea-8166-7edfd8e170e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:23.274923 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab18a6-ddd8-46ea-8166-7edfd8e170e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:23.275189 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab18a6-ddd8-46ea-8166-7edfd8e170e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:23.275812 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab18a6-ddd8-46ea-8166-7edfd8e170e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:23.277434 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab18a6-ddd8-46ea-8166-7edfd8e170e3 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:23.291313 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 589/1177] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:37:23.295510 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8edb4-7a5b-44ae-9ad1-2243f174e25b admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:23.297071 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-ead8edb4-7a5b-44ae-9ad1-2243f174e25b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:23.329888 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8edb4-7a5b-44ae-9ad1-2243f174e25b admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:23.422549 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fcde4c-7cf5-4538-a981-2e675f646efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:23.423673 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fcde4c-7cf5-4538-a981-2e675f646efd admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:23.423941 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fcde4c-7cf5-4538-a981-2e675f646efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:23.424237 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fcde4c-7cf5-4538-a981-2e675f646efd admin admin] PATH_INFO: `/v3/projects/b55e0ebe77c244c28bf82017c2e1eb12/users/e346f5f06d494066b6c32ec00e54195a/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:23.446042 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fcde4c-7cf5-4538-a981-2e675f646efd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b55e0ebe77c244c28bf82017c2e1eb12, user_id=e346f5f06d494066b6c32ec00e54195a, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:23.448958 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fcde4c-7cf5-4538-a981-2e675f646efd admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:23.581722 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 589/1178] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:37:23 2022] PUT /identity/v3/projects/b55e0ebe77c244c28bf82017c2e1eb12/users/e346f5f06d494066b6c32ec00e54195a/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:23.593167 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababaa57-a9b5-4e3d-80c4-8f128cd3cb11 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:23.593472 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababaa57-a9b5-4e3d-80c4-8f128cd3cb11 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:23.593769 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababaa57-a9b5-4e3d-80c4-8f128cd3cb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:23.651166 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-ababaa57-a9b5-4e3d-80c4-8f128cd3cb11 None None] MFA Rules not processed for user `e346f5f06d494066b6c32ec00e54195a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:23.652435 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ababaa57-a9b5-4e3d-80c4-8f128cd3cb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:23.734664 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 590/1179] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:37:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:23.747782 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d06bf8-c735-49e7-b1ee-24382537c720 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:23.748091 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d06bf8-c735-49e7-b1ee-24382537c720 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:23.748373 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d06bf8-c735-49e7-b1ee-24382537c720 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:23.749701 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 590/1180] 10.222.0.16 () {54 vars in 963 bytes} [Wed Nov 2 07:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:37:23.755642 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4bdc8-7b11-45d4-8618-46e5470af529 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:23.755952 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4bdc8-7b11-45d4-8618-46e5470af529 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:23.756261 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4bdc8-7b11-45d4-8618-46e5470af529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:23.791002 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:23.834670 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-5db4bdc8-7b11-45d4-8618-46e5470af529 None None] MFA Rules not processed for user `6c09b7eff03645ab9b7252ea96543719`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:23.835895 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5db4bdc8-7b11-45d4-8618-46e5470af529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:23.936365 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 591/1181] 10.222.0.16 () {58 vars in 1060 bytes} [Wed Nov 2 07:37:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:23.945042 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d06bf8-c735-49e7-b1ee-24382537c720 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:23.946591 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c0d06bf8-c735-49e7-b1ee-24382537c720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:23.996096 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:24.048892 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d06bf8-c735-49e7-b1ee-24382537c720 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:24.121856 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2816178-0e4c-47b1-b8b7-55bde3681c94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:24.122464 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2816178-0e4c-47b1-b8b7-55bde3681c94 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:24.122744 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2816178-0e4c-47b1-b8b7-55bde3681c94 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:24.123016 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2816178-0e4c-47b1-b8b7-55bde3681c94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:24.124705 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-b2816178-0e4c-47b1-b8b7-55bde3681c94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:24.225305 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2816178-0e4c-47b1-b8b7-55bde3681c94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:24.226644 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2816178-0e4c-47b1-b8b7-55bde3681c94 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:24.230077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:24.243822 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 591/1182] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:37:23 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:37:24.290324 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a51de-ec04-4819-94d9-f12a105b1001 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:24.290748 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a51de-ec04-4819-94d9-f12a105b1001 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:24.290889 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a51de-ec04-4819-94d9-f12a105b1001 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:24.294515 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 592/1183] 10.222.0.16 () {52 vars in 830 bytes} [Wed Nov 2 07:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:37:24.295663 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2816178-0e4c-47b1-b8b7-55bde3681c94 service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:24.296898 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-b2816178-0e4c-47b1-b8b7-55bde3681c94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:24.394904 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2816178-0e4c-47b1-b8b7-55bde3681c94 service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:24.486250 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12554e0-7d32-460b-95f3-503311d2d854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:24.486789 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12554e0-7d32-460b-95f3-503311d2d854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:24.487057 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12554e0-7d32-460b-95f3-503311d2d854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:24.487320 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12554e0-7d32-460b-95f3-503311d2d854 admin admin] PATH_INFO: `/v3/users/e346f5f06d494066b6c32ec00e54195a` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:24.499722 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12554e0-7d32-460b-95f3-503311d2d854 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e346f5f06d494066b6c32ec00e54195a)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:24.500749 dv-cinder-804757-31-smb devstack@keystone.service[81610]: WARNING py.warnings [None req-e12554e0-7d32-460b-95f3-503311d2d854 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:37:24.500749 dv-cinder-804757-31-smb devstack@keystone.service[81610]: warnings.warn(msg) Nov 02 07:37:24.500749 dv-cinder-804757-31-smb devstack@keystone.service[81610]: Nov 02 07:37:24.502619 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12554e0-7d32-460b-95f3-503311d2d854 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:24.511916 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:24.717210 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e12554e0-7d32-460b-95f3-503311d2d854 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e346f5f06d494066b6c32ec00e54195a'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:24.740939 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e12554e0-7d32-460b-95f3-503311d2d854 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e346f5f06d494066b6c32ec00e54195a'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:24.754964 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e12554e0-7d32-460b-95f3-503311d2d854 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e346f5f06d494066b6c32ec00e54195a'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:24.755436 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e12554e0-7d32-460b-95f3-503311d2d854 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e346f5f06d494066b6c32ec00e54195a'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:24.755954 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e12554e0-7d32-460b-95f3-503311d2d854 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e346f5f06d494066b6c32ec00e54195a'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:24.846165 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 592/1184] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:37:24 2022] DELETE /identity/v3/users/e346f5f06d494066b6c32ec00e54195a => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:24.850760 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdbf5c3-e6f6-4eb6-ab12-661bffc97cab None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:24.861459 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdbf5c3-e6f6-4eb6-ab12-661bffc97cab None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:24.861459 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdbf5c3-e6f6-4eb6-ab12-661bffc97cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:24.908146 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-5fdbf5c3-e6f6-4eb6-ab12-661bffc97cab None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:24.909330 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5fdbf5c3-e6f6-4eb6-ab12-661bffc97cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:24.984649 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:24.998757 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 593/1185] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:25.007640 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12554e0-7d32-460b-95f3-503311d2d854 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:25.008888 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e12554e0-7d32-460b-95f3-503311d2d854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:25.106651 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12554e0-7d32-460b-95f3-503311d2d854 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:25.163116 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:25.182598 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e03fc6-f1e7-4164-8e06-af527fb27f37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:25.183233 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e03fc6-f1e7-4164-8e06-af527fb27f37 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:25.183503 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e03fc6-f1e7-4164-8e06-af527fb27f37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:25.183767 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e03fc6-f1e7-4164-8e06-af527fb27f37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:25.185385 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-71e03fc6-f1e7-4164-8e06-af527fb27f37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:25.294339 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e03fc6-f1e7-4164-8e06-af527fb27f37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:25.295685 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e03fc6-f1e7-4164-8e06-af527fb27f37 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:25.313457 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 593/1186] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:37:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:37:25.876610 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdbf5c3-e6f6-4eb6-ab12-661bffc97cab None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:25.877982 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5fdbf5c3-e6f6-4eb6-ab12-661bffc97cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:25.889455 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdbf5c3-e6f6-4eb6-ab12-661bffc97cab None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:25.991161 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4058777a-1209-4397-a36b-ce5aa0c975a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:25.991785 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058777a-1209-4397-a36b-ce5aa0c975a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:25.992072 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058777a-1209-4397-a36b-ce5aa0c975a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:25.992350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058777a-1209-4397-a36b-ce5aa0c975a3 admin admin] PATH_INFO: `/v3/projects/b55e0ebe77c244c28bf82017c2e1eb12` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:26.003224 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4058777a-1209-4397-a36b-ce5aa0c975a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b55e0ebe77c244c28bf82017c2e1eb12)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:26.004269 dv-cinder-804757-31-smb devstack@keystone.service[81611]: WARNING py.warnings [None req-4058777a-1209-4397-a36b-ce5aa0c975a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:37:26.004269 dv-cinder-804757-31-smb devstack@keystone.service[81611]: warnings.warn(msg) Nov 02 07:37:26.004269 dv-cinder-804757-31-smb devstack@keystone.service[81611]: Nov 02 07:37:26.005570 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4058777a-1209-4397-a36b-ce5aa0c975a3 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:26.136284 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4058777a-1209-4397-a36b-ce5aa0c975a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b55e0ebe77c244c28bf82017c2e1eb12', 'request_id': 'req-4058777a-1209-4397-a36b-ce5aa0c975a3'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:26.142611 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4058777a-1209-4397-a36b-ce5aa0c975a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b55e0ebe77c244c28bf82017c2e1eb12', 'request_id': 'req-4058777a-1209-4397-a36b-ce5aa0c975a3'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:26.156103 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4058777a-1209-4397-a36b-ce5aa0c975a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b55e0ebe77c244c28bf82017c2e1eb12', 'request_id': 'req-4058777a-1209-4397-a36b-ce5aa0c975a3'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:26.274209 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4058777a-1209-4397-a36b-ce5aa0c975a3 admin admin] The token cache is being invalidate because project b55e0ebe77c244c28bf82017c2e1eb12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:37:26.274507 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4058777a-1209-4397-a36b-ce5aa0c975a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:26.275012 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4058777a-1209-4397-a36b-ce5aa0c975a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:26.276357 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 594/1187] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:37:25 2022] DELETE /identity/v3/projects/b55e0ebe77c244c28bf82017c2e1eb12 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:35.311285 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=62 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:36.272791 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:39:02.519446 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f09c6e-8a97-4037-99dd-ff82591f957b None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:02.520094 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f09c6e-8a97-4037-99dd-ff82591f957b None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:02.520094 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f09c6e-8a97-4037-99dd-ff82591f957b None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:02.521436 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 594/1188] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:39:02.526780 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733af0b-2c36-4db4-ab2a-39f06d7d9f1d None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:02.527221 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733af0b-2c36-4db4-ab2a-39f06d7d9f1d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:02.527329 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733af0b-2c36-4db4-ab2a-39f06d7d9f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:02.606925 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-b733af0b-2c36-4db4-ab2a-39f06d7d9f1d None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:39:02.608161 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b733af0b-2c36-4db4-ab2a-39f06d7d9f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:39:02.711042 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 595/1189] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:39:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:39:02.865990 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f09c6e-8a97-4037-99dd-ff82591f957b None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:39:02.877248 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-14f09c6e-8a97-4037-99dd-ff82591f957b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:39:02.987393 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f09c6e-8a97-4037-99dd-ff82591f957b None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:39:02.993813 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849b65c-e8bf-4335-ae63-5814c6865c5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:39:02.994410 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849b65c-e8bf-4335-ae63-5814c6865c5b service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:02.994684 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849b65c-e8bf-4335-ae63-5814c6865c5b service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:02.994954 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849b65c-e8bf-4335-ae63-5814c6865c5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:03.004670 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849b65c-e8bf-4335-ae63-5814c6865c5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:39:03.006246 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849b65c-e8bf-4335-ae63-5814c6865c5b service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:39:03.015466 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 595/1190] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:39:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:39:04.085359 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e60cd-4602-433f-84f3-3e443e25df71 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:04.085914 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e60cd-4602-433f-84f3-3e443e25df71 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:04.085914 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e60cd-4602-433f-84f3-3e443e25df71 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:04.087245 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 596/1191] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:39:04.091946 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8eab33-c83b-44f6-b80c-2783bb782f86 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:04.092394 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8eab33-c83b-44f6-b80c-2783bb782f86 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:04.092522 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8eab33-c83b-44f6-b80c-2783bb782f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:04.112253 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-9d8eab33-c83b-44f6-b80c-2783bb782f86 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:39:04.113435 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-9d8eab33-c83b-44f6-b80c-2783bb782f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:39:04.121182 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 596/1192] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:39:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:39:04.225662 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9286e8-be64-45a0-9bb6-d6e0d8cfae82 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:04.225866 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9286e8-be64-45a0-9bb6-d6e0d8cfae82 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:04.226147 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9286e8-be64-45a0-9bb6-d6e0d8cfae82 None None] PATH_INFO: `/v3` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:04.227450 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 597/1193] 10.222.0.45 () {54 vars in 925 bytes} [Wed Nov 2 07:39:04 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:39:04.233288 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db570df-059d-4838-bf4c-f7462eda7c27 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:04.233594 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db570df-059d-4838-bf4c-f7462eda7c27 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:04.233865 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db570df-059d-4838-bf4c-f7462eda7c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:04.276185 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9286e8-be64-45a0-9bb6-d6e0d8cfae82 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:39:04.290924 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9286e8-be64-45a0-9bb6-d6e0d8cfae82 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:39:04.294049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-1db570df-059d-4838-bf4c-f7462eda7c27 None None] MFA Rules not processed for user `741c9fc71c80438faa037c85f4997c3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:39:04.295236 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-1db570df-059d-4838-bf4c-f7462eda7c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:39:04.296618 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f21f9f-94d1-4cd1-9a97-5ab57e088771 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:39:04.297222 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f21f9f-94d1-4cd1-9a97-5ab57e088771 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:04.297499 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f21f9f-94d1-4cd1-9a97-5ab57e088771 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:04.297805 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f21f9f-94d1-4cd1-9a97-5ab57e088771 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:04.306107 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f21f9f-94d1-4cd1-9a97-5ab57e088771 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:39:04.307895 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f21f9f-94d1-4cd1-9a97-5ab57e088771 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:39:04.317859 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 598/1194] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:39:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:39:04.350174 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:39:04.370721 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 597/1195] 10.222.0.45 () {58 vars in 1015 bytes} [Wed Nov 2 07:39:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:39:13.430031 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac6412-1fbe-4f3a-8c71-e35d49ad8093 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:13.430475 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac6412-1fbe-4f3a-8c71-e35d49ad8093 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:13.430598 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac6412-1fbe-4f3a-8c71-e35d49ad8093 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:13.431873 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 599/1196] 10.222.0.16 () {54 vars in 961 bytes} [Wed Nov 2 07:39:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:39:13.436706 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1b8a2-790b-4212-b05a-fea4ba227c11 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:13.437136 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1b8a2-790b-4212-b05a-fea4ba227c11 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:13.437247 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1b8a2-790b-4212-b05a-fea4ba227c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:13.456492 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-a9c1b8a2-790b-4212-b05a-fea4ba227c11 None None] MFA Rules not processed for user `741c9fc71c80438faa037c85f4997c3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:39:13.457676 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a9c1b8a2-790b-4212-b05a-fea4ba227c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:39:13.466629 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 598/1197] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Nov 2 07:39:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:39:13.474130 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac6412-1fbe-4f3a-8c71-e35d49ad8093 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:39:13.487227 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac6412-1fbe-4f3a-8c71-e35d49ad8093 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:39:13.492404 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48160a-9178-4500-9eb5-e2f2ade148f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '741c9fc71c80438faa037c85f4997c3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:39:13.492998 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48160a-9178-4500-9eb5-e2f2ade148f5 service placement] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:13.493298 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48160a-9178-4500-9eb5-e2f2ade148f5 service placement] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:13.493566 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48160a-9178-4500-9eb5-e2f2ade148f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:13.501721 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d48160a-9178-4500-9eb5-e2f2ade148f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:39:13.503277 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d48160a-9178-4500-9eb5-e2f2ade148f5 service placement] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:39:13.513205 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 600/1198] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:39:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:39:15.800735 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b0e7c-f658-45b8-bb18-fcc0ca8eebaa None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:15.801297 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b0e7c-f658-45b8-bb18-fcc0ca8eebaa None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:15.801297 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b0e7c-f658-45b8-bb18-fcc0ca8eebaa None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:15.802591 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 599/1199] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:39:15.807316 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf830c94-7e52-4c45-ac04-7056912172ed None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:15.807734 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf830c94-7e52-4c45-ac04-7056912172ed None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:15.807868 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf830c94-7e52-4c45-ac04-7056912172ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:15.827942 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-bf830c94-7e52-4c45-ac04-7056912172ed None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:39:15.829208 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-bf830c94-7e52-4c45-ac04-7056912172ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:39:15.837881 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 601/1200] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:39:15.992881 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b0e7c-f658-45b8-bb18-fcc0ca8eebaa None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:39:16.007605 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b0e7c-f658-45b8-bb18-fcc0ca8eebaa None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:39:16.013048 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52308194-0baa-4da9-80ca-9a0641b32cf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:39:16.013635 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52308194-0baa-4da9-80ca-9a0641b32cf0 service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:16.013907 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52308194-0baa-4da9-80ca-9a0641b32cf0 service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:16.014173 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52308194-0baa-4da9-80ca-9a0641b32cf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:16.022169 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52308194-0baa-4da9-80ca-9a0641b32cf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:39:16.023730 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52308194-0baa-4da9-80ca-9a0641b32cf0 service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:39:16.033062 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 600/1201] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:39:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:39:17.097356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b84d31-353f-483c-b0b6-8332474a93f7 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:17.097894 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b84d31-353f-483c-b0b6-8332474a93f7 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:17.097894 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b84d31-353f-483c-b0b6-8332474a93f7 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:17.099240 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 602/1202] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:39:17.103968 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c0aec2-fe17-452c-bf91-33ccfdbcaa27 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:17.104378 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c0aec2-fe17-452c-bf91-33ccfdbcaa27 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:17.104554 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c0aec2-fe17-452c-bf91-33ccfdbcaa27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:17.123659 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-c8c0aec2-fe17-452c-bf91-33ccfdbcaa27 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:39:17.124890 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c8c0aec2-fe17-452c-bf91-33ccfdbcaa27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:39:17.133327 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 601/1203] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:39:17.284558 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b84d31-353f-483c-b0b6-8332474a93f7 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:39:17.299225 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b84d31-353f-483c-b0b6-8332474a93f7 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:39:17.305566 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355f307-3719-4058-8621-608311b3fd83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:39:17.306160 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355f307-3719-4058-8621-608311b3fd83 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:17.306438 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355f307-3719-4058-8621-608311b3fd83 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:17.306709 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355f307-3719-4058-8621-608311b3fd83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:17.314539 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2355f307-3719-4058-8621-608311b3fd83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:39:17.316129 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2355f307-3719-4058-8621-608311b3fd83 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:39:17.325401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 603/1204] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:39:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:39:21.448929 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e737698-42f0-4a92-8feb-aa28c04a34fa None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:21.449495 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e737698-42f0-4a92-8feb-aa28c04a34fa None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:21.449495 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e737698-42f0-4a92-8feb-aa28c04a34fa None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:21.450794 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 602/1205] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:39:21.455853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321dc886-7b73-447d-a257-8e825d081fc1 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:21.456329 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321dc886-7b73-447d-a257-8e825d081fc1 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:21.456425 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321dc886-7b73-447d-a257-8e825d081fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:21.477262 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-321dc886-7b73-447d-a257-8e825d081fc1 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:39:21.478447 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-321dc886-7b73-447d-a257-8e825d081fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:39:21.486165 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 604/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:39:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:39:21.771013 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e737698-42f0-4a92-8feb-aa28c04a34fa None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:39:21.773313 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-7e737698-42f0-4a92-8feb-aa28c04a34fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:39:21.850968 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e737698-42f0-4a92-8feb-aa28c04a34fa None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:39:21.854504 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946da45-bf01-40c8-8651-ca5035255120 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:39:21.855102 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946da45-bf01-40c8-8651-ca5035255120 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:21.855376 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946da45-bf01-40c8-8651-ca5035255120 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:21.855645 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946da45-bf01-40c8-8651-ca5035255120 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:21.864356 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946da45-bf01-40c8-8651-ca5035255120 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:39:21.865927 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946da45-bf01-40c8-8651-ca5035255120 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:39:21.875027 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 603/1207] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:39:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:39:24.094540 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020bb9f1-b519-4eed-80f2-6d8e8a93c558 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:24.095108 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020bb9f1-b519-4eed-80f2-6d8e8a93c558 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:24.095108 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020bb9f1-b519-4eed-80f2-6d8e8a93c558 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:24.096478 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 605/1208] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:39:24.102523 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86786129-8229-4f90-b100-5cf02d7ef57e None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:24.102939 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86786129-8229-4f90-b100-5cf02d7ef57e None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:24.103060 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86786129-8229-4f90-b100-5cf02d7ef57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:24.124229 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-86786129-8229-4f90-b100-5cf02d7ef57e None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:39:24.125418 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-86786129-8229-4f90-b100-5cf02d7ef57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:39:24.133592 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 604/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:39:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:39:24.434622 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020bb9f1-b519-4eed-80f2-6d8e8a93c558 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:39:24.445893 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020bb9f1-b519-4eed-80f2-6d8e8a93c558 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:39:24.449614 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5944c-efdf-4ee6-a609-a74b7480e1db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:39:24.450246 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5944c-efdf-4ee6-a609-a74b7480e1db service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:24.450590 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5944c-efdf-4ee6-a609-a74b7480e1db service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:24.450901 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5944c-efdf-4ee6-a609-a74b7480e1db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:24.460671 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a5944c-efdf-4ee6-a609-a74b7480e1db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:39:24.462186 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a5944c-efdf-4ee6-a609-a74b7480e1db service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:39:24.471854 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 606/1210] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:39:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:39:28.405082 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300ae57-a6cb-4365-ad3d-f1bc57bf4e29 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:28.405669 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300ae57-a6cb-4365-ad3d-f1bc57bf4e29 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:28.405669 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300ae57-a6cb-4365-ad3d-f1bc57bf4e29 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:28.406961 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 605/1211] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:39:28.412713 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357f1ef-93b5-4923-90d8-7696aa35d9f9 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:28.413145 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357f1ef-93b5-4923-90d8-7696aa35d9f9 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:28.413282 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357f1ef-93b5-4923-90d8-7696aa35d9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:28.420823 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:39:28.433509 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-e357f1ef-93b5-4923-90d8-7696aa35d9f9 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:39:28.434710 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e357f1ef-93b5-4923-90d8-7696aa35d9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:39:28.442548 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 607/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:39:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:39:28.747401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300ae57-a6cb-4365-ad3d-f1bc57bf4e29 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:39:28.750152 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a300ae57-a6cb-4365-ad3d-f1bc57bf4e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:39:28.827697 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300ae57-a6cb-4365-ad3d-f1bc57bf4e29 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:39:28.831297 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2aa92-abc6-4961-9d7c-ead790617c7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:39:28.831894 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2aa92-abc6-4961-9d7c-ead790617c7c service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:28.832205 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2aa92-abc6-4961-9d7c-ead790617c7c service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:28.832481 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2aa92-abc6-4961-9d7c-ead790617c7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:28.841491 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2aa92-abc6-4961-9d7c-ead790617c7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:39:28.842905 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2aa92-abc6-4961-9d7c-ead790617c7c service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:39:28.852501 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 606/1213] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:39:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:39:30.991129 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65fdbf-6d2a-46af-9455-2bf2cb3819f4 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:30.991693 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65fdbf-6d2a-46af-9455-2bf2cb3819f4 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:30.991693 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65fdbf-6d2a-46af-9455-2bf2cb3819f4 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:30.993060 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 608/1214] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:39:30.998144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1042f9-75b3-430c-a6b0-29c6ff883af3 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:30.999930 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1042f9-75b3-430c-a6b0-29c6ff883af3 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:30.999930 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1042f9-75b3-430c-a6b0-29c6ff883af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:31.018018 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-2e1042f9-75b3-430c-a6b0-29c6ff883af3 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:39:31.019193 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-2e1042f9-75b3-430c-a6b0-29c6ff883af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:39:31.028102 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 607/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:39:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:39:31.347553 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65fdbf-6d2a-46af-9455-2bf2cb3819f4 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:39:31.349276 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3a65fdbf-6d2a-46af-9455-2bf2cb3819f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:39:31.362054 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65fdbf-6d2a-46af-9455-2bf2cb3819f4 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:39:31.365534 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec5ace-33e1-466a-b086-14ee71e304d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:39:31.366748 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec5ace-33e1-466a-b086-14ee71e304d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:31.367032 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec5ace-33e1-466a-b086-14ee71e304d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:31.367300 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec5ace-33e1-466a-b086-14ee71e304d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:31.375882 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec5ace-33e1-466a-b086-14ee71e304d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:39:31.377324 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec5ace-33e1-466a-b086-14ee71e304d8 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:39:31.386906 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 609/1216] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:39:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:39:41.013166 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=92 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:39:41.382878 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=8 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:00.022719 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b0d04-83c9-4b89-b5d4-f82ff7f07e88 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:00.023355 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b0d04-83c9-4b89-b5d4-f82ff7f07e88 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:00.023355 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b0d04-83c9-4b89-b5d4-f82ff7f07e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:00.052171 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-a56b0d04-83c9-4b89-b5d4-f82ff7f07e88 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:00.053385 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a56b0d04-83c9-4b89-b5d4-f82ff7f07e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:00.067109 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 608/1217] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:00.075846 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1368913-f3b3-477c-b80a-624d92e87df1 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:00.077074 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1368913-f3b3-477c-b80a-624d92e87df1 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:00.077074 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1368913-f3b3-477c-b80a-624d92e87df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:00.112757 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-a1368913-f3b3-477c-b80a-624d92e87df1 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:00.114000 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a1368913-f3b3-477c-b80a-624d92e87df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:00.126041 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 610/1218] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:00.131678 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b0d04-83c9-4b89-b5d4-f82ff7f07e88 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:00.145320 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c8493-3182-4250-9712-4ca72758406d None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:00.145682 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c8493-3182-4250-9712-4ca72758406d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:00.145864 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c8493-3182-4250-9712-4ca72758406d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:00.147293 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b0d04-83c9-4b89-b5d4-f82ff7f07e88 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:00.159250 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8f5ff-746f-4de3-8aca-e4e639f73c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:00.159880 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8f5ff-746f-4de3-8aca-e4e639f73c90 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:00.160180 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8f5ff-746f-4de3-8aca-e4e639f73c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:00.160450 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8f5ff-746f-4de3-8aca-e4e639f73c90 admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:00.161107 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a8f5ff-746f-4de3-8aca-e4e639f73c90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:41:00.161408 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a8f5ff-746f-4de3-8aca-e4e639f73c90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:00.162751 dv-cinder-804757-31-smb devstack@keystone.service[81610]: WARNING py.warnings [None req-c2a8f5ff-746f-4de3-8aca-e4e639f73c90 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:41:00.162751 dv-cinder-804757-31-smb devstack@keystone.service[81610]: warnings.warn(msg) Nov 02 07:41:00.162751 dv-cinder-804757-31-smb devstack@keystone.service[81610]: Nov 02 07:41:00.163656 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a8f5ff-746f-4de3-8aca-e4e639f73c90 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:00.181115 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-d90c8493-3182-4250-9712-4ca72758406d None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:00.183008 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d90c8493-3182-4250-9712-4ca72758406d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:00.185514 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 609/1219] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:41:00.186802 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb87be-1798-4b63-8a25-801bc09e87c1 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:00.187083 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb87be-1798-4b63-8a25-801bc09e87c1 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:00.187355 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb87be-1798-4b63-8a25-801bc09e87c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:00.198658 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 611/1220] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:41:00.203161 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c8493-3182-4250-9712-4ca72758406d None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:00.216447 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c8493-3182-4250-9712-4ca72758406d None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:00.224895 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-3fdb87be-1798-4b63-8a25-801bc09e87c1 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:00.226128 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-3fdb87be-1798-4b63-8a25-801bc09e87c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:00.229438 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e65879-a1ed-4f93-ba46-b76e5f677d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:00.230076 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e65879-a1ed-4f93-ba46-b76e5f677d0f admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:00.230357 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e65879-a1ed-4f93-ba46-b76e5f677d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:00.230627 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e65879-a1ed-4f93-ba46-b76e5f677d0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:00.231275 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e65879-a1ed-4f93-ba46-b76e5f677d0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:00.232470 dv-cinder-804757-31-smb devstack@keystone.service[81611]: WARNING py.warnings [None req-07e65879-a1ed-4f93-ba46-b76e5f677d0f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:41:00.232470 dv-cinder-804757-31-smb devstack@keystone.service[81611]: warnings.warn(msg) Nov 02 07:41:00.232470 dv-cinder-804757-31-smb devstack@keystone.service[81611]: Nov 02 07:41:00.233814 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e65879-a1ed-4f93-ba46-b76e5f677d0f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:00.248021 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 610/1221] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:00.249313 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799887c7-08b9-42ec-ac55-f2ad317cffed None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:00.249596 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799887c7-08b9-42ec-ac55-f2ad317cffed None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:00.249871 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799887c7-08b9-42ec-ac55-f2ad317cffed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:00.294742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-799887c7-08b9-42ec-ac55-f2ad317cffed None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:00.295895 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-799887c7-08b9-42ec-ac55-f2ad317cffed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:00.317812 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 611/1222] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:00.319094 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af379ef-6b3b-4c17-84ea-a263241f45f0 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:00.319376 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af379ef-6b3b-4c17-84ea-a263241f45f0 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:00.319649 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af379ef-6b3b-4c17-84ea-a263241f45f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:00.346795 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-8af379ef-6b3b-4c17-84ea-a263241f45f0 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:00.348038 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-8af379ef-6b3b-4c17-84ea-a263241f45f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:00.366240 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 612/1223] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:00.367119 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af379ef-6b3b-4c17-84ea-a263241f45f0 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:00.377997 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af379ef-6b3b-4c17-84ea-a263241f45f0 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:00.388638 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d75ba1-7d73-4441-8820-689a026f6f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:00.389259 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d75ba1-7d73-4441-8820-689a026f6f91 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:00.389536 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d75ba1-7d73-4441-8820-689a026f6f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:00.389805 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d75ba1-7d73-4441-8820-689a026f6f91 admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:00.390340 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 612/1224] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:00 2022] POST /identity/v3/projects => generated 369 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:00.390764 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d75ba1-7d73-4441-8820-689a026f6f91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:41:00.390764 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d75ba1-7d73-4441-8820-689a026f6f91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:00.391412 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e65879-a1ed-4f93-ba46-b76e5f677d0f admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:00.396304 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d75ba1-7d73-4441-8820-689a026f6f91 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:00.414370 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 613/1225] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:41:00.415212 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d75ba1-7d73-4441-8820-689a026f6f91 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:00.430349 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d75ba1-7d73-4441-8820-689a026f6f91 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:00.507107 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e65879-a1ed-4f93-ba46-b76e5f677d0f admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:00.518855 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1a25d-2673-415c-8b47-61115fd8350f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:00.519473 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1a25d-2673-415c-8b47-61115fd8350f admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:00.519750 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1a25d-2673-415c-8b47-61115fd8350f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:00.520020 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1a25d-2673-415c-8b47-61115fd8350f admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:00.521345 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a1a25d-2673-415c-8b47-61115fd8350f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:41:00.521649 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a1a25d-2673-415c-8b47-61115fd8350f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:00.523275 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a1a25d-2673-415c-8b47-61115fd8350f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:00.536176 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb082840-3f25-4c80-bc73-dc25fe4d5155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:00.536796 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb082840-3f25-4c80-bc73-dc25fe4d5155 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:00.537072 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb082840-3f25-4c80-bc73-dc25fe4d5155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:00.537343 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb082840-3f25-4c80-bc73-dc25fe4d5155 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:00.537978 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb082840-3f25-4c80-bc73-dc25fe4d5155 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:00.538988 dv-cinder-804757-31-smb devstack@keystone.service[81610]: WARNING py.warnings [None req-eb082840-3f25-4c80-bc73-dc25fe4d5155 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:41:00.538988 dv-cinder-804757-31-smb devstack@keystone.service[81610]: warnings.warn(msg) Nov 02 07:41:00.538988 dv-cinder-804757-31-smb devstack@keystone.service[81610]: Nov 02 07:41:00.540278 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb082840-3f25-4c80-bc73-dc25fe4d5155 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:00.549540 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 613/1226] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:41:00.550352 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1a25d-2673-415c-8b47-61115fd8350f admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:00.566975 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1a25d-2673-415c-8b47-61115fd8350f admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:00.573524 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386fe520-5e6a-44be-bc06-410255a17b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:00.573524 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386fe520-5e6a-44be-bc06-410255a17b90 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:00.573524 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386fe520-5e6a-44be-bc06-410255a17b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:00.573524 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386fe520-5e6a-44be-bc06-410255a17b90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:00.573973 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386fe520-5e6a-44be-bc06-410255a17b90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:00.575745 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386fe520-5e6a-44be-bc06-410255a17b90 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:00.680686 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 614/1227] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:00 2022] POST /identity/v3/users => generated 285 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:00.682364 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db079d80-a94a-4ca5-8621-b83556d99a9e None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:00.682749 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db079d80-a94a-4ca5-8621-b83556d99a9e None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:00.683278 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db079d80-a94a-4ca5-8621-b83556d99a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:00.703205 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-db079d80-a94a-4ca5-8621-b83556d99a9e None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:00.713434 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 614/1228] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:00 2022] POST /identity/v3/projects => generated 377 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:00.713578 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-db079d80-a94a-4ca5-8621-b83556d99a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:00.713687 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b34400-98e2-4f8d-9cf1-2a4d1ecf7623 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:00.713687 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b34400-98e2-4f8d-9cf1-2a4d1ecf7623 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:00.713687 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b34400-98e2-4f8d-9cf1-2a4d1ecf7623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:00.725875 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-88b34400-98e2-4f8d-9cf1-2a4d1ecf7623 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:00.727079 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-88b34400-98e2-4f8d-9cf1-2a4d1ecf7623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:00.766800 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 615/1229] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:00.768187 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746c1b0-e0ff-452f-9613-828d626c1ead None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:00.768476 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746c1b0-e0ff-452f-9613-828d626c1ead None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:00.768778 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746c1b0-e0ff-452f-9613-828d626c1ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:00.788323 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-2746c1b0-e0ff-452f-9613-828d626c1ead None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:00.789531 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-2746c1b0-e0ff-452f-9613-828d626c1ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:00.797280 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 615/1230] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:00.797751 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 616/1231] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:00.799970 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f12096-0349-4d1b-8e6c-147c732ac015 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:00.800234 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f12096-0349-4d1b-8e6c-147c732ac015 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:00.800515 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f12096-0349-4d1b-8e6c-147c732ac015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:00.805670 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b34400-98e2-4f8d-9cf1-2a4d1ecf7623 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:00.816593 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b34400-98e2-4f8d-9cf1-2a4d1ecf7623 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:00.819898 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-41f12096-0349-4d1b-8e6c-147c732ac015 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:00.821138 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-41f12096-0349-4d1b-8e6c-147c732ac015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:00.821296 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b757c-82db-48dc-a8a9-80b23263b7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:00.821905 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b757c-82db-48dc-a8a9-80b23263b7f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:00.822236 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b757c-82db-48dc-a8a9-80b23263b7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:00.822508 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b757c-82db-48dc-a8a9-80b23263b7f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:00.823143 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b757c-82db-48dc-a8a9-80b23263b7f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:00.825085 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b757c-82db-48dc-a8a9-80b23263b7f2 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:00.829322 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 617/1232] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:00.837998 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c241b0f-10e7-4a52-b54e-353f6d8685da None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:00.837998 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c241b0f-10e7-4a52-b54e-353f6d8685da None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:00.837998 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c241b0f-10e7-4a52-b54e-353f6d8685da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:00.851994 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-7c241b0f-10e7-4a52-b54e-353f6d8685da None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:00.853222 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-7c241b0f-10e7-4a52-b54e-353f6d8685da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:00.861907 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 618/1233] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:00.862666 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c241b0f-10e7-4a52-b54e-353f6d8685da None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:00.871878 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c241b0f-10e7-4a52-b54e-353f6d8685da None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:00.876516 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a52aa-bcc1-4987-91c5-584e138fbdbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:00.877153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a52aa-bcc1-4987-91c5-584e138fbdbe admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:00.877423 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a52aa-bcc1-4987-91c5-584e138fbdbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:00.877693 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a52aa-bcc1-4987-91c5-584e138fbdbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:00.878317 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a52aa-bcc1-4987-91c5-584e138fbdbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:00.879886 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a52aa-bcc1-4987-91c5-584e138fbdbe admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:00.889712 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 619/1234] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:00 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:00.890449 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a52aa-bcc1-4987-91c5-584e138fbdbe admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:00.899796 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a52aa-bcc1-4987-91c5-584e138fbdbe admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:00.904648 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41fe932-b1ab-4cec-8d0e-ab2a20d932db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:00.905198 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fe932-b1ab-4cec-8d0e-ab2a20d932db admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:00.905474 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fe932-b1ab-4cec-8d0e-ab2a20d932db admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:00.905740 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fe932-b1ab-4cec-8d0e-ab2a20d932db admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:00.906332 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41fe932-b1ab-4cec-8d0e-ab2a20d932db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:00.908706 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41fe932-b1ab-4cec-8d0e-ab2a20d932db admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:00.917320 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:00.961223 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 616/1235] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:00 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:00.962482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774373a-526f-48f4-84a1-b76673b8afb9 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:00.962785 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774373a-526f-48f4-84a1-b76673b8afb9 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:00.963036 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774373a-526f-48f4-84a1-b76673b8afb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:00.977372 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:00.983150 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-7774373a-526f-48f4-84a1-b76673b8afb9 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:00.984377 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7774373a-526f-48f4-84a1-b76673b8afb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:01.042393 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 617/1236] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:01.043624 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab82675-5082-42d0-adf8-1e3e690692a2 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:01.043908 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab82675-5082-42d0-adf8-1e3e690692a2 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:01.044223 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab82675-5082-42d0-adf8-1e3e690692a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:01.051658 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 620/1237] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:00 2022] POST /identity/v3/users => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:01.051658 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d2921-0085-424f-908c-7da58489ac31 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:01.051658 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d2921-0085-424f-908c-7da58489ac31 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:01.051658 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d2921-0085-424f-908c-7da58489ac31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:01.066755 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-3ab82675-5082-42d0-adf8-1e3e690692a2 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:01.068650 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3ab82675-5082-42d0-adf8-1e3e690692a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:01.070522 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-5f7d2921-0085-424f-908c-7da58489ac31 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:01.071685 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-5f7d2921-0085-424f-908c-7da58489ac31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:01.077839 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 618/1238] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:01.079140 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fda43-0604-4182-931b-a88a65ba33ac None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:01.079566 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fda43-0604-4182-931b-a88a65ba33ac None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:01.083880 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fda43-0604-4182-931b-a88a65ba33ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:01.083972 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 621/1239] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:01.083972 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6542962-0219-4db0-8946-70cd80093db3 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:01.083972 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6542962-0219-4db0-8946-70cd80093db3 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:01.083972 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6542962-0219-4db0-8946-70cd80093db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:01.100880 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-380fda43-0604-4182-931b-a88a65ba33ac None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:01.101678 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-b6542962-0219-4db0-8946-70cd80093db3 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:01.102141 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-380fda43-0604-4182-931b-a88a65ba33ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:01.102881 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-b6542962-0219-4db0-8946-70cd80093db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:01.110221 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 619/1240] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:01.111800 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380fda43-0604-4182-931b-a88a65ba33ac None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:01.112528 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 622/1241] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:01.113743 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6542962-0219-4db0-8946-70cd80093db3 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:01.123254 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6542962-0219-4db0-8946-70cd80093db3 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:01.127138 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380fda43-0604-4182-931b-a88a65ba33ac None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:01.128386 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c155aca-d4a4-4f7f-b959-e73bdc8baea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:01.128993 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c155aca-d4a4-4f7f-b959-e73bdc8baea4 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:01.129360 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c155aca-d4a4-4f7f-b959-e73bdc8baea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:01.129633 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c155aca-d4a4-4f7f-b959-e73bdc8baea4 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:01.130266 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c155aca-d4a4-4f7f-b959-e73bdc8baea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:01.131940 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9012b-cee3-4390-b7bc-2399f36aedf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:01.132206 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c155aca-d4a4-4f7f-b959-e73bdc8baea4 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:01.132564 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9012b-cee3-4390-b7bc-2399f36aedf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:01.132837 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9012b-cee3-4390-b7bc-2399f36aedf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:01.133105 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9012b-cee3-4390-b7bc-2399f36aedf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:01.133729 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd9012b-cee3-4390-b7bc-2399f36aedf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:01.135336 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd9012b-cee3-4390-b7bc-2399f36aedf4 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:01.146058 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 620/1242] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:01.146872 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9012b-cee3-4390-b7bc-2399f36aedf4 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:01.157590 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9012b-cee3-4390-b7bc-2399f36aedf4 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:01.162920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af4c86-3445-4190-96e7-490d5fb77453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:01.163504 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af4c86-3445-4190-96e7-490d5fb77453 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:01.163769 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af4c86-3445-4190-96e7-490d5fb77453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:01.164040 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af4c86-3445-4190-96e7-490d5fb77453 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:01.164689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af4c86-3445-4190-96e7-490d5fb77453 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:41:01.164986 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af4c86-3445-4190-96e7-490d5fb77453 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:01.166550 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af4c86-3445-4190-96e7-490d5fb77453 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:01.178471 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 621/1243] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:41:01.179251 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af4c86-3445-4190-96e7-490d5fb77453 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:01.188461 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af4c86-3445-4190-96e7-490d5fb77453 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:01.193216 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79161ca5-678f-4098-966b-5eb8973d7dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:01.193782 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79161ca5-678f-4098-966b-5eb8973d7dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:01.194062 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79161ca5-678f-4098-966b-5eb8973d7dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:01.194334 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79161ca5-678f-4098-966b-5eb8973d7dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:01.194944 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79161ca5-678f-4098-966b-5eb8973d7dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:01.196568 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79161ca5-678f-4098-966b-5eb8973d7dd4 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:01.206672 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 622/1244] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:01.207433 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79161ca5-678f-4098-966b-5eb8973d7dd4 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:01.217313 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79161ca5-678f-4098-966b-5eb8973d7dd4 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:01.223201 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d944f-7fce-4bbe-8064-a9b8d5a00b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:01.227713 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 623/1245] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:01 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:01.227855 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d944f-7fce-4bbe-8064-a9b8d5a00b43 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:01.227855 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d944f-7fce-4bbe-8064-a9b8d5a00b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:01.227855 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d944f-7fce-4bbe-8064-a9b8d5a00b43 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:01.228109 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c155aca-d4a4-4f7f-b959-e73bdc8baea4 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:01.228202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d944f-7fce-4bbe-8064-a9b8d5a00b43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:41:01.228202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d944f-7fce-4bbe-8064-a9b8d5a00b43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:01.228202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d944f-7fce-4bbe-8064-a9b8d5a00b43 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:01.233988 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c155aca-d4a4-4f7f-b959-e73bdc8baea4 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:01.239025 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce7e1f-3786-44dd-a47e-5df1d2fc57a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:01.239645 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce7e1f-3786-44dd-a47e-5df1d2fc57a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:01.239916 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce7e1f-3786-44dd-a47e-5df1d2fc57a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:01.240212 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce7e1f-3786-44dd-a47e-5df1d2fc57a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:01.247386 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 623/1246] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:41:01.247533 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce7e1f-3786-44dd-a47e-5df1d2fc57a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:41:01.247533 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce7e1f-3786-44dd-a47e-5df1d2fc57a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:01.247727 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d944f-7fce-4bbe-8064-a9b8d5a00b43 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:01.247832 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce7e1f-3786-44dd-a47e-5df1d2fc57a3 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:01.257714 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d944f-7fce-4bbe-8064-a9b8d5a00b43 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:01.266617 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 624/1247] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:41:01.266617 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce7e1f-3786-44dd-a47e-5df1d2fc57a3 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:01.266886 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e0e860-e52e-4655-8b18-0bc4486fe514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:01.266886 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0e860-e52e-4655-8b18-0bc4486fe514 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:01.266886 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0e860-e52e-4655-8b18-0bc4486fe514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:01.266886 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0e860-e52e-4655-8b18-0bc4486fe514 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:01.267781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e0e860-e52e-4655-8b18-0bc4486fe514 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:41:01.267781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e0e860-e52e-4655-8b18-0bc4486fe514 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:01.267781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e0e860-e52e-4655-8b18-0bc4486fe514 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:01.271244 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce7e1f-3786-44dd-a47e-5df1d2fc57a3 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:01.276295 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7340add-9aa3-4832-bf12-53562740096c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:01.279459 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7340add-9aa3-4832-bf12-53562740096c admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:01.279459 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7340add-9aa3-4832-bf12-53562740096c admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:01.279459 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7340add-9aa3-4832-bf12-53562740096c admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:01.279459 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7340add-9aa3-4832-bf12-53562740096c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:41:01.279459 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7340add-9aa3-4832-bf12-53562740096c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:01.279919 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 624/1248] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:41:01.280435 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7340add-9aa3-4832-bf12-53562740096c admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:01.280919 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e0e860-e52e-4655-8b18-0bc4486fe514 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:01.300522 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 625/1249] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:41:01.300522 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7340add-9aa3-4832-bf12-53562740096c admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:01.300815 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e0e860-e52e-4655-8b18-0bc4486fe514 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:01.300815 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ae9fb-9630-4ff8-b6f2-fa9d8be29060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:01.300815 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ae9fb-9630-4ff8-b6f2-fa9d8be29060 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:01.300815 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ae9fb-9630-4ff8-b6f2-fa9d8be29060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:01.301176 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ae9fb-9630-4ff8-b6f2-fa9d8be29060 admin admin] PATH_INFO: `/v3/projects/21800f4931a74506a9ed92caf8e79af5/users/209a2e01684345b8b18d6127fbdb0c1e/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:01.304333 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7340add-9aa3-4832-bf12-53562740096c admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:01.309112 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d938cf-12d9-40e1-957e-505ccbb825a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:01.309699 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d938cf-12d9-40e1-957e-505ccbb825a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:01.309972 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d938cf-12d9-40e1-957e-505ccbb825a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:01.310237 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d938cf-12d9-40e1-957e-505ccbb825a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:01.310876 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d938cf-12d9-40e1-957e-505ccbb825a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:01.312777 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d938cf-12d9-40e1-957e-505ccbb825a6 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:01.315622 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ae9fb-9630-4ff8-b6f2-fa9d8be29060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21800f4931a74506a9ed92caf8e79af5, user_id=209a2e01684345b8b18d6127fbdb0c1e, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:01.318277 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ae9fb-9630-4ff8-b6f2-fa9d8be29060 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:01.399841 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 625/1250] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:01 2022] PUT /identity/v3/projects/21800f4931a74506a9ed92caf8e79af5/users/209a2e01684345b8b18d6127fbdb0c1e/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:01.400689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ae9fb-9630-4ff8-b6f2-fa9d8be29060 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:01.430496 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 626/1251] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:01 2022] POST /identity/v3/projects => generated 371 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:01.430496 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d938cf-12d9-40e1-957e-505ccbb825a6 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:01.463047 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ae9fb-9630-4ff8-b6f2-fa9d8be29060 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:01.474698 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:01.493207 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d938cf-12d9-40e1-957e-505ccbb825a6 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:01.498173 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f554b0-26c9-4083-bb35-d40577f0d538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:01.498773 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f554b0-26c9-4083-bb35-d40577f0d538 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:01.499050 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f554b0-26c9-4083-bb35-d40577f0d538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:01.499323 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f554b0-26c9-4083-bb35-d40577f0d538 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:01.499952 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f554b0-26c9-4083-bb35-d40577f0d538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:01.502437 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f554b0-26c9-4083-bb35-d40577f0d538 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:01.521569 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 627/1252] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:01.521569 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f554b0-26c9-4083-bb35-d40577f0d538 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:01.521869 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd68ac-023f-4387-96f6-cf4519e6a2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:01.521869 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd68ac-023f-4387-96f6-cf4519e6a2a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:01.522106 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd68ac-023f-4387-96f6-cf4519e6a2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:01.522223 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd68ac-023f-4387-96f6-cf4519e6a2a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:01.522809 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dd68ac-023f-4387-96f6-cf4519e6a2a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:01.524423 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dd68ac-023f-4387-96f6-cf4519e6a2a5 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:01.531747 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f554b0-26c9-4083-bb35-d40577f0d538 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:01.535864 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 626/1253] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:01.536618 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f297b-706c-4719-bd6b-d0f36f0911dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:01.536816 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd68ac-023f-4387-96f6-cf4519e6a2a5 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:01.537381 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f297b-706c-4719-bd6b-d0f36f0911dc admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:01.537729 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f297b-706c-4719-bd6b-d0f36f0911dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:01.538169 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f297b-706c-4719-bd6b-d0f36f0911dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:01.539092 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f297b-706c-4719-bd6b-d0f36f0911dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:01.540906 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f297b-706c-4719-bd6b-d0f36f0911dc admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:01.546516 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd68ac-023f-4387-96f6-cf4519e6a2a5 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:01.551118 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b1b84f-ba6d-4fbe-a7f3-98b879f2ce89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:01.551715 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1b84f-ba6d-4fbe-a7f3-98b879f2ce89 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:01.551972 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1b84f-ba6d-4fbe-a7f3-98b879f2ce89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:01.552276 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1b84f-ba6d-4fbe-a7f3-98b879f2ce89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:01.552893 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b1b84f-ba6d-4fbe-a7f3-98b879f2ce89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:01.554824 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b1b84f-ba6d-4fbe-a7f3-98b879f2ce89 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:01.649964 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 628/1254] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:01 2022] POST /identity/v3/projects => generated 391 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:01.649964 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f297b-706c-4719-bd6b-d0f36f0911dc admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:01.655289 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 627/1255] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:01 2022] POST /identity/v3/projects => generated 389 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:01.655289 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b1b84f-ba6d-4fbe-a7f3-98b879f2ce89 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:01.700749 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:01.719145 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f297b-706c-4719-bd6b-d0f36f0911dc admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:01.720795 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b1b84f-ba6d-4fbe-a7f3-98b879f2ce89 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:01.724201 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884d056-e9d8-4048-901f-6b23cbd1a73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:01.724805 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884d056-e9d8-4048-901f-6b23cbd1a73f admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:01.725081 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884d056-e9d8-4048-901f-6b23cbd1a73f admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:01.725349 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884d056-e9d8-4048-901f-6b23cbd1a73f admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:01.725489 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf3a39-82f6-4078-a4dd-085d44673e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:01.725972 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884d056-e9d8-4048-901f-6b23cbd1a73f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:01.726075 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf3a39-82f6-4078-a4dd-085d44673e90 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:01.726352 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf3a39-82f6-4078-a4dd-085d44673e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:01.726618 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf3a39-82f6-4078-a4dd-085d44673e90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:01.727235 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf3a39-82f6-4078-a4dd-085d44673e90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:01.727859 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884d056-e9d8-4048-901f-6b23cbd1a73f admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:01.729151 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf3a39-82f6-4078-a4dd-085d44673e90 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:01.852464 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 629/1256] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:01 2022] POST /identity/v3/projects => generated 375 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:01.853738 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1c542-95b9-4c6b-b7aa-ae199483a7fd None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:01.854022 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1c542-95b9-4c6b-b7aa-ae199483a7fd None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:01.854294 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1c542-95b9-4c6b-b7aa-ae199483a7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:01.877496 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 628/1257] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:01 2022] POST /identity/v3/projects => generated 369 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:01.878339 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf3a39-82f6-4078-a4dd-085d44673e90 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:01.882798 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-bdf1c542-95b9-4c6b-b7aa-ae199483a7fd None None] MFA Rules not processed for user `209a2e01684345b8b18d6127fbdb0c1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:01.884108 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-bdf1c542-95b9-4c6b-b7aa-ae199483a7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:01.949862 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 630/1258] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:01.950490 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1c542-95b9-4c6b-b7aa-ae199483a7fd None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:01.950623 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf3a39-82f6-4078-a4dd-085d44673e90 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:01.955280 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68214015-d4b8-4fe6-b492-4a67af5e7e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:01.955885 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68214015-d4b8-4fe6-b492-4a67af5e7e57 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:01.956197 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68214015-d4b8-4fe6-b492-4a67af5e7e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:01.956472 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68214015-d4b8-4fe6-b492-4a67af5e7e57 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:01.957097 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68214015-d4b8-4fe6-b492-4a67af5e7e57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:01.959049 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68214015-d4b8-4fe6-b492-4a67af5e7e57 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:01.962950 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1c542-95b9-4c6b-b7aa-ae199483a7fd None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:01.967563 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8649290-3c28-4534-82ff-c64c564fe3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:01.968223 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8649290-3c28-4534-82ff-c64c564fe3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:01.968503 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8649290-3c28-4534-82ff-c64c564fe3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:01.968767 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8649290-3c28-4534-82ff-c64c564fe3a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:01.969398 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8649290-3c28-4534-82ff-c64c564fe3a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:01.971066 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8649290-3c28-4534-82ff-c64c564fe3a0 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:01.981014 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 631/1259] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:01.981775 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8649290-3c28-4534-82ff-c64c564fe3a0 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:01.991417 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8649290-3c28-4534-82ff-c64c564fe3a0 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:01.995905 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da97ccc0-658e-490b-9f25-9274844875b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:01.996555 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97ccc0-658e-490b-9f25-9274844875b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.000894 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97ccc0-658e-490b-9f25-9274844875b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.000894 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97ccc0-658e-490b-9f25-9274844875b5 admin admin] PATH_INFO: `/v3/projects/b29011f7d4f8427ab0286481f97d5e0e/users/ef0c95e28e4c439d8bf52b2fc8297444/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.011691 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da97ccc0-658e-490b-9f25-9274844875b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b29011f7d4f8427ab0286481f97d5e0e, user_id=ef0c95e28e4c439d8bf52b2fc8297444, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:02.014407 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da97ccc0-658e-490b-9f25-9274844875b5 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:02.103032 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 629/1260] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:01 2022] POST /identity/v3/users => generated 286 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:02.103865 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68214015-d4b8-4fe6-b492-4a67af5e7e57 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:02.109601 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:02.114073 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68214015-d4b8-4fe6-b492-4a67af5e7e57 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:02.118647 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc60a4-fa39-4849-a2f8-6444cfc2aedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:02.119220 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc60a4-fa39-4849-a2f8-6444cfc2aedf admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.119514 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc60a4-fa39-4849-a2f8-6444cfc2aedf admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.119782 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc60a4-fa39-4849-a2f8-6444cfc2aedf admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.120484 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffc60a4-fa39-4849-a2f8-6444cfc2aedf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:02.122375 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffc60a4-fa39-4849-a2f8-6444cfc2aedf admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:02.142290 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 632/1261] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:01 2022] PUT /identity/v3/projects/b29011f7d4f8427ab0286481f97d5e0e/users/ef0c95e28e4c439d8bf52b2fc8297444/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:02.143088 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da97ccc0-658e-490b-9f25-9274844875b5 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:02.205176 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da97ccc0-658e-490b-9f25-9274844875b5 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:02.209740 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85a4ea-dc09-43db-ab67-2a5a5f8f4190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:02.210337 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85a4ea-dc09-43db-ab67-2a5a5f8f4190 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.210612 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85a4ea-dc09-43db-ab67-2a5a5f8f4190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.210880 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85a4ea-dc09-43db-ab67-2a5a5f8f4190 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.211489 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf85a4ea-dc09-43db-ab67-2a5a5f8f4190 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:02.213409 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf85a4ea-dc09-43db-ab67-2a5a5f8f4190 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:02.245294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 630/1262] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:02 2022] POST /identity/v3/users => generated 296 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:02.246128 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc60a4-fa39-4849-a2f8-6444cfc2aedf admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:02.256347 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc60a4-fa39-4849-a2f8-6444cfc2aedf admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:02.260876 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc7262-1c5b-425c-b8e6-41b50cae3021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:02.261445 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc7262-1c5b-425c-b8e6-41b50cae3021 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.261720 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc7262-1c5b-425c-b8e6-41b50cae3021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.261988 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc7262-1c5b-425c-b8e6-41b50cae3021 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.262596 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc7262-1c5b-425c-b8e6-41b50cae3021 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:02.264561 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc7262-1c5b-425c-b8e6-41b50cae3021 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:02.349522 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 633/1263] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:02 2022] POST /identity/v3/users => generated 295 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:02.350521 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85a4ea-dc09-43db-ab67-2a5a5f8f4190 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:02.360170 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85a4ea-dc09-43db-ab67-2a5a5f8f4190 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:02.366094 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28223320-ba11-42af-9aa7-2d8c7b4cb5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:02.366750 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28223320-ba11-42af-9aa7-2d8c7b4cb5b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.367026 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28223320-ba11-42af-9aa7-2d8c7b4cb5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.367294 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28223320-ba11-42af-9aa7-2d8c7b4cb5b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.367906 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28223320-ba11-42af-9aa7-2d8c7b4cb5b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:02.369965 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28223320-ba11-42af-9aa7-2d8c7b4cb5b0 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:02.371569 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 631/1264] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:02 2022] POST /identity/v3/users => generated 288 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:02.372205 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc7262-1c5b-425c-b8e6-41b50cae3021 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:02.381558 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:02.381995 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc7262-1c5b-425c-b8e6-41b50cae3021 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:02.386658 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d11f4-1c1d-471d-b824-c328e106b9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:02.387246 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d11f4-1c1d-471d-b824-c328e106b9f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.387522 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d11f4-1c1d-471d-b824-c328e106b9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.387790 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d11f4-1c1d-471d-b824-c328e106b9f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.388447 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d11f4-1c1d-471d-b824-c328e106b9f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:02.390438 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d11f4-1c1d-471d-b824-c328e106b9f5 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:02.474387 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 634/1265] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:02 2022] POST /identity/v3/users => generated 285 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:02.475190 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28223320-ba11-42af-9aa7-2d8c7b4cb5b0 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:02.484416 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28223320-ba11-42af-9aa7-2d8c7b4cb5b0 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:02.489561 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1e63b-3874-493f-843e-cbe5aeeead1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:02.490185 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1e63b-3874-493f-843e-cbe5aeeead1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.490480 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1e63b-3874-493f-843e-cbe5aeeead1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.490729 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1e63b-3874-493f-843e-cbe5aeeead1b admin admin] PATH_INFO: `/v3/projects/bf440de5324c4cba8328e0368e874bb2/users/047b50cfb513438dbda9cdd89b578062/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.506962 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 632/1266] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:02 2022] POST /identity/v3/projects => generated 369 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:02.506962 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d11f4-1c1d-471d-b824-c328e106b9f5 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:02.507244 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d1e63b-3874-493f-843e-cbe5aeeead1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf440de5324c4cba8328e0368e874bb2, user_id=047b50cfb513438dbda9cdd89b578062, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:02.508863 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d1e63b-3874-493f-843e-cbe5aeeead1b admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:02.566269 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d11f4-1c1d-471d-b824-c328e106b9f5 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:02.570976 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5918e6-f1eb-4fe9-aa15-53d6f88da385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:02.571605 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5918e6-f1eb-4fe9-aa15-53d6f88da385 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.571853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5918e6-f1eb-4fe9-aa15-53d6f88da385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.572160 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5918e6-f1eb-4fe9-aa15-53d6f88da385 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.572786 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5918e6-f1eb-4fe9-aa15-53d6f88da385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:02.574391 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5918e6-f1eb-4fe9-aa15-53d6f88da385 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:02.583871 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 633/1267] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:02.585027 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bf5b8-74d5-4e9f-9426-e61513b5c4cf None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.585308 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bf5b8-74d5-4e9f-9426-e61513b5c4cf None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.585641 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bf5b8-74d5-4e9f-9426-e61513b5c4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.604019 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-a44bf5b8-74d5-4e9f-9426-e61513b5c4cf None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:02.607979 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a44bf5b8-74d5-4e9f-9426-e61513b5c4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:02.613532 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 634/1268] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:02.614223 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bf5b8-74d5-4e9f-9426-e61513b5c4cf None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:02.623248 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bf5b8-74d5-4e9f-9426-e61513b5c4cf None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:02.627904 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b0ff2-e505-4f74-8dd0-8d72d6086097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:02.628517 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b0ff2-e505-4f74-8dd0-8d72d6086097 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.628811 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b0ff2-e505-4f74-8dd0-8d72d6086097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.629059 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b0ff2-e505-4f74-8dd0-8d72d6086097 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.629678 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324b0ff2-e505-4f74-8dd0-8d72d6086097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:02.631257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324b0ff2-e505-4f74-8dd0-8d72d6086097 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:02.644342 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 635/1269] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:02.644342 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b0ff2-e505-4f74-8dd0-8d72d6086097 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:02.645220 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 635/1270] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:02 2022] PUT /identity/v3/projects/bf440de5324c4cba8328e0368e874bb2/users/047b50cfb513438dbda9cdd89b578062/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:02.646090 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1e63b-3874-493f-843e-cbe5aeeead1b admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:02.652099 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b0ff2-e505-4f74-8dd0-8d72d6086097 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:02.707475 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1e63b-3874-493f-843e-cbe5aeeead1b admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:02.711685 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebe920-3b94-4787-b34b-e0bb8dddf792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:02.711965 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e433a-8277-4713-8d37-0e2f7b931b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:02.712322 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebe920-3b94-4787-b34b-e0bb8dddf792 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.712583 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e433a-8277-4713-8d37-0e2f7b931b4a admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.712682 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebe920-3b94-4787-b34b-e0bb8dddf792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.712857 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e433a-8277-4713-8d37-0e2f7b931b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.712972 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebe920-3b94-4787-b34b-e0bb8dddf792 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.713127 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e433a-8277-4713-8d37-0e2f7b931b4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.713491 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ebe920-3b94-4787-b34b-e0bb8dddf792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:02.713774 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969e433a-8277-4713-8d37-0e2f7b931b4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:02.715073 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ebe920-3b94-4787-b34b-e0bb8dddf792 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:02.715330 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969e433a-8277-4713-8d37-0e2f7b931b4a admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:02.725513 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 636/1271] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:02.726379 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e433a-8277-4713-8d37-0e2f7b931b4a admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:02.729464 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 636/1272] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:02.729464 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebe920-3b94-4787-b34b-e0bb8dddf792 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:02.738036 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e433a-8277-4713-8d37-0e2f7b931b4a admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:02.738395 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebe920-3b94-4787-b34b-e0bb8dddf792 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:02.742642 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2b324-a9e8-4d01-9949-1a0f8a22007d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:02.742825 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4895d05-1a57-4079-9391-56ffa44c97ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:02.743232 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2b324-a9e8-4d01-9949-1a0f8a22007d admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.743412 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4895d05-1a57-4079-9391-56ffa44c97ae admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.743527 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2b324-a9e8-4d01-9949-1a0f8a22007d admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.743686 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4895d05-1a57-4079-9391-56ffa44c97ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.743791 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2b324-a9e8-4d01-9949-1a0f8a22007d admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.743956 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4895d05-1a57-4079-9391-56ffa44c97ae admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.744409 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2b324-a9e8-4d01-9949-1a0f8a22007d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:02.744620 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4895d05-1a57-4079-9391-56ffa44c97ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:02.745965 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2b324-a9e8-4d01-9949-1a0f8a22007d admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:02.746494 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4895d05-1a57-4079-9391-56ffa44c97ae admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:02.755745 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 637/1273] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:02.756572 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2b324-a9e8-4d01-9949-1a0f8a22007d admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:02.768019 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2b324-a9e8-4d01-9949-1a0f8a22007d admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:02.772521 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd717a-28e6-4f85-ae17-71f70e563764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:02.773093 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd717a-28e6-4f85-ae17-71f70e563764 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.773367 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd717a-28e6-4f85-ae17-71f70e563764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.773635 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd717a-28e6-4f85-ae17-71f70e563764 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.778186 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd717a-28e6-4f85-ae17-71f70e563764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:02.778186 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd717a-28e6-4f85-ae17-71f70e563764 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:02.786857 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 638/1274] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:02.787775 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd717a-28e6-4f85-ae17-71f70e563764 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:02.789346 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-acfd717a-28e6-4f85-ae17-71f70e563764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:02.843546 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd717a-28e6-4f85-ae17-71f70e563764 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:02.848547 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb249e-c2a0-4cfa-a575-6eb7bf185fae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:02.849145 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb249e-c2a0-4cfa-a575-6eb7bf185fae service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.849420 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb249e-c2a0-4cfa-a575-6eb7bf185fae service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.849689 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb249e-c2a0-4cfa-a575-6eb7bf185fae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.858454 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acb249e-c2a0-4cfa-a575-6eb7bf185fae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:02.859862 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acb249e-c2a0-4cfa-a575-6eb7bf185fae service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:02.869258 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 639/1275] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:02.869976 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb249e-c2a0-4cfa-a575-6eb7bf185fae service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:02.873900 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 637/1276] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:02 2022] POST /identity/v3/users => generated 291 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:02.875630 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54311a4d-abb8-4513-be40-a5437f03b5d2 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.875983 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54311a4d-abb8-4513-be40-a5437f03b5d2 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.876424 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54311a4d-abb8-4513-be40-a5437f03b5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.882160 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb249e-c2a0-4cfa-a575-6eb7bf185fae service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:02.885383 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:02.887437 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791cd3f6-6426-4ae7-b621-41ca88b53290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:02.888041 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cd3f6-6426-4ae7-b621-41ca88b53290 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.888344 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cd3f6-6426-4ae7-b621-41ca88b53290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.888661 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cd3f6-6426-4ae7-b621-41ca88b53290 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.889289 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791cd3f6-6426-4ae7-b621-41ca88b53290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:02.890922 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791cd3f6-6426-4ae7-b621-41ca88b53290 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:02.897610 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-54311a4d-abb8-4513-be40-a5437f03b5d2 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:02.898904 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-54311a4d-abb8-4513-be40-a5437f03b5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:02.901818 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 640/1277] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:02.902873 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791cd3f6-6426-4ae7-b621-41ca88b53290 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:02.911352 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 638/1278] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:02.912882 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54311a4d-abb8-4513-be40-a5437f03b5d2 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:02.912980 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791cd3f6-6426-4ae7-b621-41ca88b53290 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:02.917674 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c9f3e-a0ed-42d6-a2c1-fae7d0e7a1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:02.918268 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c9f3e-a0ed-42d6-a2c1-fae7d0e7a1d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.918547 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c9f3e-a0ed-42d6-a2c1-fae7d0e7a1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.918812 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c9f3e-a0ed-42d6-a2c1-fae7d0e7a1d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.919432 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8c9f3e-a0ed-42d6-a2c1-fae7d0e7a1d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:02.921249 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8c9f3e-a0ed-42d6-a2c1-fae7d0e7a1d0 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:02.927023 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54311a4d-abb8-4513-be40-a5437f03b5d2 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:02.931254 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 641/1279] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:02.935821 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c9f3e-a0ed-42d6-a2c1-fae7d0e7a1d0 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:02.935947 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c167ef-0b99-4e16-ac62-c78cca2db581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:02.935947 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c167ef-0b99-4e16-ac62-c78cca2db581 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.935947 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c167ef-0b99-4e16-ac62-c78cca2db581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.935947 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c167ef-0b99-4e16-ac62-c78cca2db581 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.936370 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c167ef-0b99-4e16-ac62-c78cca2db581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:02.938315 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c167ef-0b99-4e16-ac62-c78cca2db581 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:02.941620 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c9f3e-a0ed-42d6-a2c1-fae7d0e7a1d0 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:02.946221 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9af276-5c12-466a-a747-983e52424319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:02.946810 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9af276-5c12-466a-a747-983e52424319 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.947142 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9af276-5c12-466a-a747-983e52424319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.947430 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9af276-5c12-466a-a747-983e52424319 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.948072 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9af276-5c12-466a-a747-983e52424319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:02.949642 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9af276-5c12-466a-a747-983e52424319 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:02.951546 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 639/1280] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:02.952466 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c167ef-0b99-4e16-ac62-c78cca2db581 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:02.964863 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 642/1281] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:02.965011 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c167ef-0b99-4e16-ac62-c78cca2db581 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:02.965619 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9af276-5c12-466a-a747-983e52424319 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:02.971206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376f572-435d-43d6-85c0-8a06fd7258ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:02.971905 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376f572-435d-43d6-85c0-8a06fd7258ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.972218 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376f572-435d-43d6-85c0-8a06fd7258ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.972500 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376f572-435d-43d6-85c0-8a06fd7258ec admin admin] PATH_INFO: `/v3/projects/590bbd47daa2484ab500de3da5b5f90f/users/70ac4685ff694bf38d68ccd2144c1a71/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.978530 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9af276-5c12-466a-a747-983e52424319 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:02.983712 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9f65d-6169-4012-9500-f46b95ab159f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:02.984439 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9f65d-6169-4012-9500-f46b95ab159f admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.987407 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9f65d-6169-4012-9500-f46b95ab159f admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.987407 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9f65d-6169-4012-9500-f46b95ab159f admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.987407 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9f65d-6169-4012-9500-f46b95ab159f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:02.988192 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9f65d-6169-4012-9500-f46b95ab159f admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:02.990597 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f376f572-435d-43d6-85c0-8a06fd7258ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=590bbd47daa2484ab500de3da5b5f90f, user_id=70ac4685ff694bf38d68ccd2144c1a71, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:02.993661 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f376f572-435d-43d6-85c0-8a06fd7258ec admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:02.999912 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 643/1282] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:03.000750 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9f65d-6169-4012-9500-f46b95ab159f admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:03.007623 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:03.011631 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9f65d-6169-4012-9500-f46b95ab159f admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:03.016274 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d165385-fb1d-4cad-a381-ab32f1bd8e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:03.016939 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d165385-fb1d-4cad-a381-ab32f1bd8e78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:03.017756 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d165385-fb1d-4cad-a381-ab32f1bd8e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:03.018034 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d165385-fb1d-4cad-a381-ab32f1bd8e78 admin admin] PATH_INFO: `/v3/projects/faaf91ebd0fc4c278fccac280201f61c/users/193e45cadb3c4586ab94051c42cf5192/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:03.033671 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d165385-fb1d-4cad-a381-ab32f1bd8e78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faaf91ebd0fc4c278fccac280201f61c, user_id=193e45cadb3c4586ab94051c42cf5192, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:03.044963 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d165385-fb1d-4cad-a381-ab32f1bd8e78 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:03.062524 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 640/1283] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:02 2022] PUT /identity/v3/projects/590bbd47daa2484ab500de3da5b5f90f/users/70ac4685ff694bf38d68ccd2144c1a71/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:03.072283 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376f572-435d-43d6-85c0-8a06fd7258ec admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:03.118381 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376f572-435d-43d6-85c0-8a06fd7258ec admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:03.125474 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 644/1284] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:02 2022] PUT /identity/v3/projects/faaf91ebd0fc4c278fccac280201f61c/users/193e45cadb3c4586ab94051c42cf5192/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:03.126893 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d165385-fb1d-4cad-a381-ab32f1bd8e78 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:03.177794 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0102fb0-d3a7-43a4-af92-0af4762b35c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:03.178621 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0102fb0-d3a7-43a4-af92-0af4762b35c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:03.178832 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0102fb0-d3a7-43a4-af92-0af4762b35c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:03.179155 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0102fb0-d3a7-43a4-af92-0af4762b35c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:03.198828 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d165385-fb1d-4cad-a381-ab32f1bd8e78 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:03.203799 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30ff9f-880c-4c64-aa31-e2cf92b62bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:03.205169 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30ff9f-880c-4c64-aa31-e2cf92b62bb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:03.205527 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30ff9f-880c-4c64-aa31-e2cf92b62bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:03.205721 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30ff9f-880c-4c64-aa31-e2cf92b62bb1 admin admin] PATH_INFO: `/v3/projects/48f5030f8ee74b7dac66f6de4ad5d202/users/ac6b178f01af47bcb1f73b32e0efcb55/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:03.230321 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f30ff9f-880c-4c64-aa31-e2cf92b62bb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48f5030f8ee74b7dac66f6de4ad5d202, user_id=ac6b178f01af47bcb1f73b32e0efcb55, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:03.233403 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f30ff9f-880c-4c64-aa31-e2cf92b62bb1 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:03.257130 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0102fb0-d3a7-43a4-af92-0af4762b35c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:03.258651 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0102fb0-d3a7-43a4-af92-0af4762b35c3 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:03.269567 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 641/1285] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:03.270417 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0102fb0-d3a7-43a4-af92-0af4762b35c3 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:03.280149 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0102fb0-d3a7-43a4-af92-0af4762b35c3 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:03.284923 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbab680-875c-446a-9983-58d763e82bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:03.285576 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbab680-875c-446a-9983-58d763e82bb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:03.285869 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbab680-875c-446a-9983-58d763e82bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:03.286162 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbab680-875c-446a-9983-58d763e82bb6 admin admin] PATH_INFO: `/v3/projects/cdb70b80b9ca4a0591db934554861702/users/6fc9296c011d4712949ec015ea157762/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:03.301539 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbab680-875c-446a-9983-58d763e82bb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdb70b80b9ca4a0591db934554861702, user_id=6fc9296c011d4712949ec015ea157762, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:03.304319 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbab680-875c-446a-9983-58d763e82bb6 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:03.338060 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 645/1286] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:03 2022] PUT /identity/v3/projects/48f5030f8ee74b7dac66f6de4ad5d202/users/ac6b178f01af47bcb1f73b32e0efcb55/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:03.338873 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30ff9f-880c-4c64-aa31-e2cf92b62bb1 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:03.394613 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 642/1287] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:03 2022] PUT /identity/v3/projects/cdb70b80b9ca4a0591db934554861702/users/6fc9296c011d4712949ec015ea157762/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:03.395995 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbab680-875c-446a-9983-58d763e82bb6 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:03.404251 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:03.405446 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30ff9f-880c-4c64-aa31-e2cf92b62bb1 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:03.477113 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fba0a-de58-48f0-b00c-a8d8fa3ec4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:03.477657 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fba0a-de58-48f0-b00c-a8d8fa3ec4e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:03.477999 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fba0a-de58-48f0-b00c-a8d8fa3ec4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:03.478337 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fba0a-de58-48f0-b00c-a8d8fa3ec4e4 admin admin] PATH_INFO: `/v3/projects/299588e3d9434733a9fc0e482be629b5/users/3fcf66be3bcd47c5b7ae93b6f5aa7ebb/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:03.515847 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4fba0a-de58-48f0-b00c-a8d8fa3ec4e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=299588e3d9434733a9fc0e482be629b5, user_id=3fcf66be3bcd47c5b7ae93b6f5aa7ebb, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:03.519512 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4fba0a-de58-48f0-b00c-a8d8fa3ec4e4 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:03.521648 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:03.522797 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbab680-875c-446a-9983-58d763e82bb6 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:03.529298 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfcec1-bec3-486f-82f9-347fcd29b8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:03.532134 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfcec1-bec3-486f-82f9-347fcd29b8e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:03.532134 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfcec1-bec3-486f-82f9-347fcd29b8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:03.532134 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfcec1-bec3-486f-82f9-347fcd29b8e8 admin admin] PATH_INFO: `/v3/projects/27776355c7824ad988ea40f7ceb3741f/users/5ca28f220d054a9d9fb151c2c6e2ac4c/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:03.547132 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcfcec1-bec3-486f-82f9-347fcd29b8e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27776355c7824ad988ea40f7ceb3741f, user_id=5ca28f220d054a9d9fb151c2c6e2ac4c, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:03.550843 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcfcec1-bec3-486f-82f9-347fcd29b8e8 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:03.651368 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 646/1288] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:03 2022] PUT /identity/v3/projects/299588e3d9434733a9fc0e482be629b5/users/3fcf66be3bcd47c5b7ae93b6f5aa7ebb/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:03.651368 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d9d38-d207-4fe7-9c0e-b1af2446d635 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:03.651368 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d9d38-d207-4fe7-9c0e-b1af2446d635 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:03.651696 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 643/1289] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:03 2022] PUT /identity/v3/projects/27776355c7824ad988ea40f7ceb3741f/users/5ca28f220d054a9d9fb151c2c6e2ac4c/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:03.651830 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d9d38-d207-4fe7-9c0e-b1af2446d635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:03.651975 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b2b87-d772-4789-8ff5-9c3e7fad7e72 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:03.651975 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b2b87-d772-4789-8ff5-9c3e7fad7e72 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:03.651975 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b2b87-d772-4789-8ff5-9c3e7fad7e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:03.659172 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-c93b2b87-d772-4789-8ff5-9c3e7fad7e72 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:03.660435 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c93b2b87-d772-4789-8ff5-9c3e7fad7e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:03.671097 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-971d9d38-d207-4fe7-9c0e-b1af2446d635 None None] MFA Rules not processed for user `70ac4685ff694bf38d68ccd2144c1a71`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:03.675869 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-971d9d38-d207-4fe7-9c0e-b1af2446d635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:03.739260 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 644/1290] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:03.742590 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e463e-07a5-4364-a58f-a684295ba1f8 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:03.742590 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e463e-07a5-4364-a58f-a684295ba1f8 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:03.742590 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e463e-07a5-4364-a58f-a684295ba1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:03.774131 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-7c7e463e-07a5-4364-a58f-a684295ba1f8 None None] MFA Rules not processed for user `ac6b178f01af47bcb1f73b32e0efcb55`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:03.775895 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7c7e463e-07a5-4364-a58f-a684295ba1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:03.793325 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 647/1291] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:03.794856 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39b206-8c54-4986-b5c4-75f917800991 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:03.795691 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39b206-8c54-4986-b5c4-75f917800991 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:03.795975 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39b206-8c54-4986-b5c4-75f917800991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:03.817006 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-3a39b206-8c54-4986-b5c4-75f917800991 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:03.818202 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-3a39b206-8c54-4986-b5c4-75f917800991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:03.829687 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 648/1292] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:03.829687 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39b206-8c54-4986-b5c4-75f917800991 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:03.836828 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39b206-8c54-4986-b5c4-75f917800991 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:03.841596 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c743930-5e5b-45fb-9ef4-569f52208a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:03.842202 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c743930-5e5b-45fb-9ef4-569f52208a4d admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:03.842485 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c743930-5e5b-45fb-9ef4-569f52208a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:03.842760 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c743930-5e5b-45fb-9ef4-569f52208a4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:03.843395 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c743930-5e5b-45fb-9ef4-569f52208a4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:03.845027 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c743930-5e5b-45fb-9ef4-569f52208a4d admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:03.858904 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 645/1293] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:03.858904 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf0708-fc5e-4694-a37e-dca7b31707cf None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:03.858904 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf0708-fc5e-4694-a37e-dca7b31707cf None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:03.858904 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf0708-fc5e-4694-a37e-dca7b31707cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:03.859370 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 649/1294] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:03.859370 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c743930-5e5b-45fb-9ef4-569f52208a4d admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:03.895686 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-43bf0708-fc5e-4694-a37e-dca7b31707cf None None] MFA Rules not processed for user `3fcf66be3bcd47c5b7ae93b6f5aa7ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:03.896942 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-43bf0708-fc5e-4694-a37e-dca7b31707cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:03.906190 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:03.949053 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c743930-5e5b-45fb-9ef4-569f52208a4d admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:03.955586 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c60409-0e8a-4ce5-b41f-8302fc03aadf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:03.957043 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c60409-0e8a-4ce5-b41f-8302fc03aadf service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:03.957612 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c60409-0e8a-4ce5-b41f-8302fc03aadf service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:03.958431 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c60409-0e8a-4ce5-b41f-8302fc03aadf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:03.973915 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c60409-0e8a-4ce5-b41f-8302fc03aadf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:03.977808 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c60409-0e8a-4ce5-b41f-8302fc03aadf service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:04.000408 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 650/1295] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:04.003201 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c60409-0e8a-4ce5-b41f-8302fc03aadf service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:04.014021 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 646/1296] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:04.014021 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf0708-fc5e-4694-a37e-dca7b31707cf None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:04.021175 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c60409-0e8a-4ce5-b41f-8302fc03aadf service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:04.027123 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8a913-2fe9-4ad5-be8d-03fad496c99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:04.031567 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8a913-2fe9-4ad5-be8d-03fad496c99d admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:04.031567 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8a913-2fe9-4ad5-be8d-03fad496c99d admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:04.031903 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8a913-2fe9-4ad5-be8d-03fad496c99d admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:04.033450 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc8a913-2fe9-4ad5-be8d-03fad496c99d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:04.036225 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc8a913-2fe9-4ad5-be8d-03fad496c99d admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:04.039947 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf0708-fc5e-4694-a37e-dca7b31707cf None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:04.044426 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1448a3c5-a6af-4fe8-a9b5-a7a5abb53c29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:04.045172 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448a3c5-a6af-4fe8-a9b5-a7a5abb53c29 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:04.045552 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448a3c5-a6af-4fe8-a9b5-a7a5abb53c29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:04.045991 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448a3c5-a6af-4fe8-a9b5-a7a5abb53c29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:04.059503 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1448a3c5-a6af-4fe8-a9b5-a7a5abb53c29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:04.062173 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1448a3c5-a6af-4fe8-a9b5-a7a5abb53c29 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:04.077600 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 647/1297] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:04.078877 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1448a3c5-a6af-4fe8-a9b5-a7a5abb53c29 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:04.090542 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1448a3c5-a6af-4fe8-a9b5-a7a5abb53c29 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:04.097535 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9121c3-9928-4d45-a9c3-759e512e04ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:04.101329 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9121c3-9928-4d45-a9c3-759e512e04ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:04.101329 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9121c3-9928-4d45-a9c3-759e512e04ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:04.101329 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9121c3-9928-4d45-a9c3-759e512e04ee admin admin] PATH_INFO: `/v3/projects/27776355c7824ad988ea40f7ceb3741f/users/5ca28f220d054a9d9fb151c2c6e2ac4c/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:04.101329 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9121c3-9928-4d45-a9c3-759e512e04ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=27776355c7824ad988ea40f7ceb3741f, user_id=5ca28f220d054a9d9fb151c2c6e2ac4c, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:04.104222 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9121c3-9928-4d45-a9c3-759e512e04ee admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:04.116763 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 648/1298] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:04 2022] PUT /identity/v3/projects/27776355c7824ad988ea40f7ceb3741f/users/5ca28f220d054a9d9fb151c2c6e2ac4c/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:04.121599 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f604ac-cc6f-49ed-9ebc-f82c6bdd0904 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:04.122133 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f604ac-cc6f-49ed-9ebc-f82c6bdd0904 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:04.122269 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f604ac-cc6f-49ed-9ebc-f82c6bdd0904 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:04.123612 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 649/1299] 10.222.0.16 () {54 vars in 961 bytes} [Wed Nov 2 07:41:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:41:04.129280 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3314ba-b885-4072-9382-63044a9fc5f4 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:04.130048 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3314ba-b885-4072-9382-63044a9fc5f4 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:04.130048 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3314ba-b885-4072-9382-63044a9fc5f4 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:04.131061 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 650/1300] 10.222.0.16 () {54 vars in 961 bytes} [Wed Nov 2 07:41:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:41:04.132081 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5a239-dbb3-4094-8a56-da34dbed5743 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:04.132453 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5a239-dbb3-4094-8a56-da34dbed5743 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:04.132723 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5a239-dbb3-4094-8a56-da34dbed5743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:04.156772 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 651/1301] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:04 2022] POST /identity/v3/projects => generated 371 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:04.158956 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd2417-cb0c-4d76-8e26-5ea6eead85c5 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:04.159309 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd2417-cb0c-4d76-8e26-5ea6eead85c5 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:04.159652 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd2417-cb0c-4d76-8e26-5ea6eead85c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:04.171107 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-caf5a239-dbb3-4094-8a56-da34dbed5743 None None] MFA Rules not processed for user `5ca28f220d054a9d9fb151c2c6e2ac4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:04.172544 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-caf5a239-dbb3-4094-8a56-da34dbed5743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:04.203901 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-eabd2417-cb0c-4d76-8e26-5ea6eead85c5 None None] MFA Rules not processed for user `232210eabdfd4969a348d7333c50c438`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:04.206067 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-eabd2417-cb0c-4d76-8e26-5ea6eead85c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:04.242577 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:04.256777 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 651/1302] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:04 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:04.256777 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02d6e9-1a7b-493e-9354-9947799b3403 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:04.256777 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02d6e9-1a7b-493e-9354-9947799b3403 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:04.256777 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02d6e9-1a7b-493e-9354-9947799b3403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:04.293216 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-bd02d6e9-1a7b-493e-9354-9947799b3403 None None] MFA Rules not processed for user `232210eabdfd4969a348d7333c50c438`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:04.298129 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-bd02d6e9-1a7b-493e-9354-9947799b3403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:04.306591 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 652/1303] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Nov 2 07:41:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:04.309396 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd2417-cb0c-4d76-8e26-5ea6eead85c5 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:04.322257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 652/1304] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Nov 2 07:41:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:04.323087 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02d6e9-1a7b-493e-9354-9947799b3403 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:04.422487 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02d6e9-1a7b-493e-9354-9947799b3403 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:04.426625 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5993d99-37b3-43d6-aaea-60e185ac1cc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:04.427284 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd2417-cb0c-4d76-8e26-5ea6eead85c5 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:04.427413 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5993d99-37b3-43d6-aaea-60e185ac1cc2 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:04.427718 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5993d99-37b3-43d6-aaea-60e185ac1cc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:04.428142 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5993d99-37b3-43d6-aaea-60e185ac1cc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:04.433746 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f33f46-918a-4c8a-8b48-495b50007ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:04.434762 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f33f46-918a-4c8a-8b48-495b50007ef6 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:04.435049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f33f46-918a-4c8a-8b48-495b50007ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:04.435321 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f33f46-918a-4c8a-8b48-495b50007ef6 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:04.435985 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f33f46-918a-4c8a-8b48-495b50007ef6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:04.438351 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f33f46-918a-4c8a-8b48-495b50007ef6 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:04.445512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5993d99-37b3-43d6-aaea-60e185ac1cc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:04.447016 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5993d99-37b3-43d6-aaea-60e185ac1cc2 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:04.458158 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 653/1305] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:04 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:04.463902 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5993d99-37b3-43d6-aaea-60e185ac1cc2 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:04.471548 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5993d99-37b3-43d6-aaea-60e185ac1cc2 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:04.478062 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b89673-5357-42a6-9977-9de433e0d4a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:04.478337 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b89673-5357-42a6-9977-9de433e0d4a8 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:04.478873 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b89673-5357-42a6-9977-9de433e0d4a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:04.478873 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b89673-5357-42a6-9977-9de433e0d4a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:04.561137 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b89673-5357-42a6-9977-9de433e0d4a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:04.562889 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b89673-5357-42a6-9977-9de433e0d4a8 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:04.587695 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 654/1306] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:04.589894 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b89673-5357-42a6-9977-9de433e0d4a8 service nova] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:04.595890 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 653/1307] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:04 2022] POST /identity/v3/users => generated 292 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:04.599584 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f33f46-918a-4c8a-8b48-495b50007ef6 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:04.616204 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b89673-5357-42a6-9977-9de433e0d4a8 service nova] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:04.634307 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f33f46-918a-4c8a-8b48-495b50007ef6 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:04.643991 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53f1a3-c8d9-4c2b-be90-856c34a281f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:04.647247 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac0a97-d145-4951-b04f-1e1ed2cd90f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:04.648508 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac0a97-d145-4951-b04f-1e1ed2cd90f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:04.648626 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53f1a3-c8d9-4c2b-be90-856c34a281f2 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:04.648858 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53f1a3-c8d9-4c2b-be90-856c34a281f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:04.650014 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53f1a3-c8d9-4c2b-be90-856c34a281f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:04.650117 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac0a97-d145-4951-b04f-1e1ed2cd90f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:04.650117 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac0a97-d145-4951-b04f-1e1ed2cd90f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:04.650631 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac0a97-d145-4951-b04f-1e1ed2cd90f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:04.654305 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac0a97-d145-4951-b04f-1e1ed2cd90f8 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:04.685581 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 654/1308] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:41:04.687273 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac0a97-d145-4951-b04f-1e1ed2cd90f8 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:04.709837 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac0a97-d145-4951-b04f-1e1ed2cd90f8 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:04.721370 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582c081-cffa-4b71-a2f4-533b873f6315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:04.722855 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582c081-cffa-4b71-a2f4-533b873f6315 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:04.723935 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582c081-cffa-4b71-a2f4-533b873f6315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:04.724468 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582c081-cffa-4b71-a2f4-533b873f6315 admin admin] PATH_INFO: `/v3/projects/274efbe3694647c09d1aef08b7bc28e0/users/725e861c204147d8aa3907e4e9051ba6/roles/9252c356af254127896f3626d925a88a` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:04.763029 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582c081-cffa-4b71-a2f4-533b873f6315 admin admin] RBAC: Authorizing `identity:create_grant(project_id=274efbe3694647c09d1aef08b7bc28e0, user_id=725e861c204147d8aa3907e4e9051ba6, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:04.769496 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582c081-cffa-4b71-a2f4-533b873f6315 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:04.793533 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53f1a3-c8d9-4c2b-be90-856c34a281f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:04.795168 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53f1a3-c8d9-4c2b-be90-856c34a281f2 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:04.829151 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 655/1309] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:04.886755 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 655/1310] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:04 2022] PUT /identity/v3/projects/274efbe3694647c09d1aef08b7bc28e0/users/725e861c204147d8aa3907e4e9051ba6/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:04.891727 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53f1a3-c8d9-4c2b-be90-856c34a281f2 service nova] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:04.906688 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53f1a3-c8d9-4c2b-be90-856c34a281f2 service nova] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:04.992907 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b4634-6b24-42bd-9cb1-19a7f42126c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:04.993997 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b4634-6b24-42bd-9cb1-19a7f42126c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:04.993997 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b4634-6b24-42bd-9cb1-19a7f42126c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:04.994166 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b4634-6b24-42bd-9cb1-19a7f42126c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:04.994826 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b4634-6b24-42bd-9cb1-19a7f42126c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:04.996489 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b4634-6b24-42bd-9cb1-19a7f42126c5 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:05.046809 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 656/1311] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:05.047619 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582c081-cffa-4b71-a2f4-533b873f6315 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:05.063322 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582c081-cffa-4b71-a2f4-533b873f6315 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:05.079992 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef236b-c802-4320-9057-c56382d08dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:05.079992 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef236b-c802-4320-9057-c56382d08dc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:05.079992 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef236b-c802-4320-9057-c56382d08dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:05.079992 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef236b-c802-4320-9057-c56382d08dc2 admin admin] PATH_INFO: `/v3/projects/274efbe3694647c09d1aef08b7bc28e0/users/725e861c204147d8aa3907e4e9051ba6/roles/9252c356af254127896f3626d925a88a` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:05.081990 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef236b-c802-4320-9057-c56382d08dc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=274efbe3694647c09d1aef08b7bc28e0, user_id=725e861c204147d8aa3907e4e9051ba6, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:05.088791 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef236b-c802-4320-9057-c56382d08dc2 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:05.097856 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281ddd4-7005-420a-b1ed-9cbcf4334479 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:05.098239 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281ddd4-7005-420a-b1ed-9cbcf4334479 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:05.098581 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281ddd4-7005-420a-b1ed-9cbcf4334479 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:05.102038 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 657/1312] 10.222.0.16 () {54 vars in 912 bytes} [Wed Nov 2 07:41:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:41:05.105566 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0474cb-8238-4dbf-bd9a-941f69df5d2b None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:05.105844 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0474cb-8238-4dbf-bd9a-941f69df5d2b None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:05.108575 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0474cb-8238-4dbf-bd9a-941f69df5d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:05.131452 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:05.178721 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 656/1313] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:05 2022] PUT /identity/v3/projects/274efbe3694647c09d1aef08b7bc28e0/users/725e861c204147d8aa3907e4e9051ba6/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:05.179089 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-3b0474cb-8238-4dbf-bd9a-941f69df5d2b None None] MFA Rules not processed for user `232210eabdfd4969a348d7333c50c438`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:05.179089 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3b0474cb-8238-4dbf-bd9a-941f69df5d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:05.181114 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d5d11-d343-4837-91cd-2cc7452662b4 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:05.181477 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d5d11-d343-4837-91cd-2cc7452662b4 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:05.181828 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d5d11-d343-4837-91cd-2cc7452662b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:05.281744 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-eb4d5d11-d343-4837-91cd-2cc7452662b4 None None] MFA Rules not processed for user `725e861c204147d8aa3907e4e9051ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:05.284895 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-eb4d5d11-d343-4837-91cd-2cc7452662b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:05.441189 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:05.458550 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 658/1314] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Nov 2 07:41:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:41:05.476069 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 657/1315] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:05 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:05.476769 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d5d11-d343-4837-91cd-2cc7452662b4 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:05.476884 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045040b2-08b3-4da4-864d-39a8d2baaa4f None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:05.477079 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045040b2-08b3-4da4-864d-39a8d2baaa4f None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:05.478844 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045040b2-08b3-4da4-864d-39a8d2baaa4f None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:05.483101 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 659/1316] 10.222.0.16 () {54 vars in 912 bytes} [Wed Nov 2 07:41:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:41:05.488658 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4e629-9cc7-4ce8-80db-b89ab7902dcf None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:05.493410 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4e629-9cc7-4ce8-80db-b89ab7902dcf None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:05.493410 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4e629-9cc7-4ce8-80db-b89ab7902dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:05.529037 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-0da4e629-9cc7-4ce8-80db-b89ab7902dcf None None] MFA Rules not processed for user `232210eabdfd4969a348d7333c50c438`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:05.530320 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0da4e629-9cc7-4ce8-80db-b89ab7902dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:05.566441 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 660/1317] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Nov 2 07:41:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:05.567933 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4e629-9cc7-4ce8-80db-b89ab7902dcf None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:05.587791 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4e629-9cc7-4ce8-80db-b89ab7902dcf None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:05.589575 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d5d11-d343-4837-91cd-2cc7452662b4 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:05.594694 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8471d2-c3ce-4d66-adf2-750978d2b500 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:05.597240 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8471d2-c3ce-4d66-adf2-750978d2b500 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:05.597519 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8471d2-c3ce-4d66-adf2-750978d2b500 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:05.598736 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8471d2-c3ce-4d66-adf2-750978d2b500 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:05.599871 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29774934-8f2c-4ffa-9fe7-ed42a945da62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:05.601588 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29774934-8f2c-4ffa-9fe7-ed42a945da62 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:05.601865 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29774934-8f2c-4ffa-9fe7-ed42a945da62 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:05.602138 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29774934-8f2c-4ffa-9fe7-ed42a945da62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:05.621275 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8471d2-c3ce-4d66-adf2-750978d2b500 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:05.623246 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8471d2-c3ce-4d66-adf2-750978d2b500 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:05.624389 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29774934-8f2c-4ffa-9fe7-ed42a945da62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:05.630592 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29774934-8f2c-4ffa-9fe7-ed42a945da62 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:05.651277 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 658/1318] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:05.652440 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 661/1319] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:05 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:05.829743 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8471d2-c3ce-4d66-adf2-750978d2b500 service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:05.840293 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8471d2-c3ce-4d66-adf2-750978d2b500 service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:05.853769 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f2e8c-f22d-40ef-bbeb-586c1a587464 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:05.858154 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f2e8c-f22d-40ef-bbeb-586c1a587464 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:05.858154 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f2e8c-f22d-40ef-bbeb-586c1a587464 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:05.858154 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f2e8c-f22d-40ef-bbeb-586c1a587464 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:05.894366 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f2e8c-f22d-40ef-bbeb-586c1a587464 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:05.896027 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f2e8c-f22d-40ef-bbeb-586c1a587464 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:05.959959 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 659/1320] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:06.157364 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:06.497316 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29774934-8f2c-4ffa-9fe7-ed42a945da62 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:06.631613 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29774934-8f2c-4ffa-9fe7-ed42a945da62 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:06.640375 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888adc3d-61cd-4656-adf3-3f9f7dd1ca52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:06.641250 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888adc3d-61cd-4656-adf3-3f9f7dd1ca52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:06.641777 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888adc3d-61cd-4656-adf3-3f9f7dd1ca52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:06.642744 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888adc3d-61cd-4656-adf3-3f9f7dd1ca52 admin admin] PATH_INFO: `/v3/users/ac6b178f01af47bcb1f73b32e0efcb55` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:06.644322 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888adc3d-61cd-4656-adf3-3f9f7dd1ca52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac6b178f01af47bcb1f73b32e0efcb55)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:06.645615 dv-cinder-804757-31-smb devstack@keystone.service[81611]: WARNING py.warnings [None req-888adc3d-61cd-4656-adf3-3f9f7dd1ca52 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:41:06.645615 dv-cinder-804757-31-smb devstack@keystone.service[81611]: warnings.warn(msg) Nov 02 07:41:06.645615 dv-cinder-804757-31-smb devstack@keystone.service[81611]: Nov 02 07:41:06.647358 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888adc3d-61cd-4656-adf3-3f9f7dd1ca52 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:06.950184 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-888adc3d-61cd-4656-adf3-3f9f7dd1ca52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac6b178f01af47bcb1f73b32e0efcb55'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:07.012870 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-888adc3d-61cd-4656-adf3-3f9f7dd1ca52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac6b178f01af47bcb1f73b32e0efcb55'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:07.020250 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-888adc3d-61cd-4656-adf3-3f9f7dd1ca52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac6b178f01af47bcb1f73b32e0efcb55'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:07.058123 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-888adc3d-61cd-4656-adf3-3f9f7dd1ca52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac6b178f01af47bcb1f73b32e0efcb55'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:07.058911 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-888adc3d-61cd-4656-adf3-3f9f7dd1ca52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac6b178f01af47bcb1f73b32e0efcb55'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:07.169900 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 662/1321] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:41:06 2022] DELETE /identity/v3/users/ac6b178f01af47bcb1f73b32e0efcb55 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:07.174264 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8074f0-f25f-4098-8698-cd87a666db60 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:07.174727 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8074f0-f25f-4098-8698-cd87a666db60 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:07.174817 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8074f0-f25f-4098-8698-cd87a666db60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:07.270467 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-1d8074f0-f25f-4098-8698-cd87a666db60 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:07.271713 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-1d8074f0-f25f-4098-8698-cd87a666db60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:07.466916 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 660/1322] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:07.560547 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888adc3d-61cd-4656-adf3-3f9f7dd1ca52 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:07.562244 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-888adc3d-61cd-4656-adf3-3f9f7dd1ca52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:07.685713 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:07.760207 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888adc3d-61cd-4656-adf3-3f9f7dd1ca52 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:07.770892 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25769b5-3231-4812-8af9-b61136e6397d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:07.773343 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25769b5-3231-4812-8af9-b61136e6397d service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:07.774741 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25769b5-3231-4812-8af9-b61136e6397d service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:07.775202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25769b5-3231-4812-8af9-b61136e6397d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:07.804900 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25769b5-3231-4812-8af9-b61136e6397d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:07.809058 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25769b5-3231-4812-8af9-b61136e6397d service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:07.839936 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 663/1323] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:08.206956 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8074f0-f25f-4098-8698-cd87a666db60 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:08.212171 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-1d8074f0-f25f-4098-8698-cd87a666db60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:08.232956 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8074f0-f25f-4098-8698-cd87a666db60 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:08.247296 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4563b18-4920-4234-aed8-1c1308014992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:08.247955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4563b18-4920-4234-aed8-1c1308014992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:08.248263 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4563b18-4920-4234-aed8-1c1308014992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:08.248537 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4563b18-4920-4234-aed8-1c1308014992 admin admin] PATH_INFO: `/v3/users/70ac4685ff694bf38d68ccd2144c1a71` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:08.249759 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4563b18-4920-4234-aed8-1c1308014992 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70ac4685ff694bf38d68ccd2144c1a71)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:08.252312 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4563b18-4920-4234-aed8-1c1308014992 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:08.528267 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e4563b18-4920-4234-aed8-1c1308014992 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70ac4685ff694bf38d68ccd2144c1a71'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:08.609054 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e4563b18-4920-4234-aed8-1c1308014992 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70ac4685ff694bf38d68ccd2144c1a71'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:08.635224 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e4563b18-4920-4234-aed8-1c1308014992 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70ac4685ff694bf38d68ccd2144c1a71'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:08.637460 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e4563b18-4920-4234-aed8-1c1308014992 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70ac4685ff694bf38d68ccd2144c1a71'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:08.641125 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e4563b18-4920-4234-aed8-1c1308014992 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70ac4685ff694bf38d68ccd2144c1a71'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:08.648118 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:08.734483 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 661/1324] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:41:08 2022] DELETE /identity/v3/users/70ac4685ff694bf38d68ccd2144c1a71 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:08.740801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd772d-c9f0-4ee1-923f-912cb5ecb132 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:08.741371 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd772d-c9f0-4ee1-923f-912cb5ecb132 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:08.741471 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd772d-c9f0-4ee1-923f-912cb5ecb132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:08.805366 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-a6bd772d-c9f0-4ee1-923f-912cb5ecb132 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:08.810373 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a6bd772d-c9f0-4ee1-923f-912cb5ecb132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:09.247862 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 664/1325] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 509 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:09.278026 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4563b18-4920-4234-aed8-1c1308014992 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:09.279643 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e4563b18-4920-4234-aed8-1c1308014992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:09.436215 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4563b18-4920-4234-aed8-1c1308014992 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:09.448523 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc51e8-31d6-46c0-93a3-c02e9caf57b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:09.449171 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc51e8-31d6-46c0-93a3-c02e9caf57b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:09.449423 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc51e8-31d6-46c0-93a3-c02e9caf57b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:09.449880 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc51e8-31d6-46c0-93a3-c02e9caf57b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:09.471607 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc51e8-31d6-46c0-93a3-c02e9caf57b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:09.473096 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc51e8-31d6-46c0-93a3-c02e9caf57b3 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:09.503686 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 662/1326] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:10.111675 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd772d-c9f0-4ee1-923f-912cb5ecb132 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:10.119710 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a6bd772d-c9f0-4ee1-923f-912cb5ecb132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:10.148736 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd772d-c9f0-4ee1-923f-912cb5ecb132 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:10.159313 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957bd7b-c14b-4804-ac1b-b4a949181bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:10.160948 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957bd7b-c14b-4804-ac1b-b4a949181bfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:10.161230 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957bd7b-c14b-4804-ac1b-b4a949181bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:10.161504 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957bd7b-c14b-4804-ac1b-b4a949181bfe admin admin] PATH_INFO: `/v3/projects/48f5030f8ee74b7dac66f6de4ad5d202` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:10.164888 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0957bd7b-c14b-4804-ac1b-b4a949181bfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=48f5030f8ee74b7dac66f6de4ad5d202)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:10.169584 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0957bd7b-c14b-4804-ac1b-b4a949181bfe admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:10.348493 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0957bd7b-c14b-4804-ac1b-b4a949181bfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48f5030f8ee74b7dac66f6de4ad5d202', 'request_id': 'req-0957bd7b-c14b-4804-ac1b-b4a949181bfe'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:10.366874 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0957bd7b-c14b-4804-ac1b-b4a949181bfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48f5030f8ee74b7dac66f6de4ad5d202', 'request_id': 'req-0957bd7b-c14b-4804-ac1b-b4a949181bfe'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:10.417250 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0957bd7b-c14b-4804-ac1b-b4a949181bfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48f5030f8ee74b7dac66f6de4ad5d202', 'request_id': 'req-0957bd7b-c14b-4804-ac1b-b4a949181bfe'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:10.484032 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc51e8-31d6-46c0-93a3-c02e9caf57b3 service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:10.486771 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-4edc51e8-31d6-46c0-93a3-c02e9caf57b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:10.526536 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc51e8-31d6-46c0-93a3-c02e9caf57b3 service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:10.555166 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0957bd7b-c14b-4804-ac1b-b4a949181bfe admin admin] The token cache is being invalidate because project 48f5030f8ee74b7dac66f6de4ad5d202 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:41:10.555166 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0957bd7b-c14b-4804-ac1b-b4a949181bfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:10.555166 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0957bd7b-c14b-4804-ac1b-b4a949181bfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:10.555166 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 665/1327] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:41:10 2022] DELETE /identity/v3/projects/48f5030f8ee74b7dac66f6de4ad5d202 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:10.555166 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42555dc9-dee6-4f2e-8b66-77ad627200bb None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:10.555575 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42555dc9-dee6-4f2e-8b66-77ad627200bb None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:10.555575 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42555dc9-dee6-4f2e-8b66-77ad627200bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:10.604816 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-42555dc9-dee6-4f2e-8b66-77ad627200bb None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:10.604816 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-42555dc9-dee6-4f2e-8b66-77ad627200bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:10.682231 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016c5d8-a2c8-4819-9f1f-a247fa15a04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:10.682982 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016c5d8-a2c8-4819-9f1f-a247fa15a04e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:10.683341 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016c5d8-a2c8-4819-9f1f-a247fa15a04e admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:10.683690 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016c5d8-a2c8-4819-9f1f-a247fa15a04e admin admin] PATH_INFO: `/v3/users/209a2e01684345b8b18d6127fbdb0c1e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:10.687957 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016c5d8-a2c8-4819-9f1f-a247fa15a04e admin admin] RBAC: Authorizing `identity:delete_user(user_id=209a2e01684345b8b18d6127fbdb0c1e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:10.690447 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016c5d8-a2c8-4819-9f1f-a247fa15a04e admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:10.741238 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:10.763495 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 666/1328] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:41:10.765377 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db4b0b-3715-47cf-9118-5d1d52a928db None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:10.765732 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db4b0b-3715-47cf-9118-5d1d52a928db None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:10.766623 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db4b0b-3715-47cf-9118-5d1d52a928db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:10.787821 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-04db4b0b-3715-47cf-9118-5d1d52a928db None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:10.789819 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-04db4b0b-3715-47cf-9118-5d1d52a928db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:10.806788 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 667/1329] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:10.807844 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db4b0b-3715-47cf-9118-5d1d52a928db None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:10.809532 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-04db4b0b-3715-47cf-9118-5d1d52a928db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:10.834845 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db4b0b-3715-47cf-9118-5d1d52a928db None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:10.842063 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46226194-b396-452a-adcc-f42e205ee28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:10.843033 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46226194-b396-452a-adcc-f42e205ee28c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:10.843313 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46226194-b396-452a-adcc-f42e205ee28c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:10.843641 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46226194-b396-452a-adcc-f42e205ee28c admin admin] PATH_INFO: `/v3/projects/590bbd47daa2484ab500de3da5b5f90f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:10.844809 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46226194-b396-452a-adcc-f42e205ee28c admin admin] RBAC: Authorizing `identity:delete_project(project_id=590bbd47daa2484ab500de3da5b5f90f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:10.848739 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46226194-b396-452a-adcc-f42e205ee28c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:10.993294 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e016c5d8-a2c8-4819-9f1f-a247fa15a04e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '209a2e01684345b8b18d6127fbdb0c1e'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:10.996689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-46226194-b396-452a-adcc-f42e205ee28c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '590bbd47daa2484ab500de3da5b5f90f', 'request_id': 'req-46226194-b396-452a-adcc-f42e205ee28c'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:11.006665 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-46226194-b396-452a-adcc-f42e205ee28c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '590bbd47daa2484ab500de3da5b5f90f', 'request_id': 'req-46226194-b396-452a-adcc-f42e205ee28c'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:11.022482 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e016c5d8-a2c8-4819-9f1f-a247fa15a04e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '209a2e01684345b8b18d6127fbdb0c1e'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:11.024390 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-46226194-b396-452a-adcc-f42e205ee28c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '590bbd47daa2484ab500de3da5b5f90f', 'request_id': 'req-46226194-b396-452a-adcc-f42e205ee28c'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:11.038192 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e016c5d8-a2c8-4819-9f1f-a247fa15a04e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '209a2e01684345b8b18d6127fbdb0c1e'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:11.041600 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e016c5d8-a2c8-4819-9f1f-a247fa15a04e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '209a2e01684345b8b18d6127fbdb0c1e'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:11.042379 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e016c5d8-a2c8-4819-9f1f-a247fa15a04e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '209a2e01684345b8b18d6127fbdb0c1e'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:11.134490 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-46226194-b396-452a-adcc-f42e205ee28c admin admin] The token cache is being invalidate because project 590bbd47daa2484ab500de3da5b5f90f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:41:11.134490 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-46226194-b396-452a-adcc-f42e205ee28c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:11.144349 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-46226194-b396-452a-adcc-f42e205ee28c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:11.146665 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 668/1330] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:41:10 2022] DELETE /identity/v3/projects/590bbd47daa2484ab500de3da5b5f90f => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:11.148460 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46226194-b396-452a-adcc-f42e205ee28c admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:11.151035 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-46226194-b396-452a-adcc-f42e205ee28c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:11.267804 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 663/1331] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:41:10 2022] DELETE /identity/v3/users/209a2e01684345b8b18d6127fbdb0c1e => generated 0 bytes in 782 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:11.267804 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016c5d8-a2c8-4819-9f1f-a247fa15a04e admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:11.268764 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e016c5d8-a2c8-4819-9f1f-a247fa15a04e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:11.331879 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:11.390236 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46226194-b396-452a-adcc-f42e205ee28c admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:11.512137 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016c5d8-a2c8-4819-9f1f-a247fa15a04e admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:11.530290 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee23044-2ff7-4f37-9b38-448fa8c8e78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:11.531210 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee23044-2ff7-4f37-9b38-448fa8c8e78b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:11.531588 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee23044-2ff7-4f37-9b38-448fa8c8e78b admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:11.531961 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee23044-2ff7-4f37-9b38-448fa8c8e78b admin admin] PATH_INFO: `/v3/users/725e861c204147d8aa3907e4e9051ba6` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:11.534695 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee23044-2ff7-4f37-9b38-448fa8c8e78b admin admin] RBAC: Authorizing `identity:delete_user(user_id=725e861c204147d8aa3907e4e9051ba6)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:11.539172 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee23044-2ff7-4f37-9b38-448fa8c8e78b admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:11.546937 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be5e62-063c-429e-9e37-480fcf512cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:11.547583 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be5e62-063c-429e-9e37-480fcf512cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:11.548042 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be5e62-063c-429e-9e37-480fcf512cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:11.548930 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be5e62-063c-429e-9e37-480fcf512cd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:11.553796 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be5e62-063c-429e-9e37-480fcf512cd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:41:11.554169 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be5e62-063c-429e-9e37-480fcf512cd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:11.556011 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be5e62-063c-429e-9e37-480fcf512cd3 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:11.598041 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 669/1332] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:41:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 450 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:41:11.599981 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc9867-2a41-4cc7-83a0-dd8816932612 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:11.600299 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc9867-2a41-4cc7-83a0-dd8816932612 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:11.600576 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc9867-2a41-4cc7-83a0-dd8816932612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:11.656791 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-37cc9867-2a41-4cc7-83a0-dd8816932612 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:11.659059 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-37cc9867-2a41-4cc7-83a0-dd8816932612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:11.681874 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 670/1333] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:11.682638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc9867-2a41-4cc7-83a0-dd8816932612 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:11.699413 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc9867-2a41-4cc7-83a0-dd8816932612 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:11.715477 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1699de7-abd3-43a8-95ea-38006500a3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:11.715477 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1699de7-abd3-43a8-95ea-38006500a3f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:11.715477 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1699de7-abd3-43a8-95ea-38006500a3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:11.715477 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1699de7-abd3-43a8-95ea-38006500a3f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:11.715871 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1699de7-abd3-43a8-95ea-38006500a3f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:11.728778 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1699de7-abd3-43a8-95ea-38006500a3f6 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:11.855790 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-5ee23044-2ff7-4f37-9b38-448fa8c8e78b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '725e861c204147d8aa3907e4e9051ba6'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:11.873992 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 671/1334] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:11 2022] POST /identity/v3/projects => generated 365 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:11.875362 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1699de7-abd3-43a8-95ea-38006500a3f6 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:11.883547 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a1699de7-abd3-43a8-95ea-38006500a3f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:11.899782 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-5ee23044-2ff7-4f37-9b38-448fa8c8e78b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '725e861c204147d8aa3907e4e9051ba6'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:11.914593 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-5ee23044-2ff7-4f37-9b38-448fa8c8e78b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '725e861c204147d8aa3907e4e9051ba6'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:11.916483 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-5ee23044-2ff7-4f37-9b38-448fa8c8e78b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '725e861c204147d8aa3907e4e9051ba6'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:11.920133 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-5ee23044-2ff7-4f37-9b38-448fa8c8e78b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '725e861c204147d8aa3907e4e9051ba6'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:12.044271 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 664/1335] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:41:11 2022] DELETE /identity/v3/users/725e861c204147d8aa3907e4e9051ba6 => generated 0 bytes in 776 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:12.045397 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee23044-2ff7-4f37-9b38-448fa8c8e78b admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:12.046760 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-5ee23044-2ff7-4f37-9b38-448fa8c8e78b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:12.132172 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1699de7-abd3-43a8-95ea-38006500a3f6 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:12.216130 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee23044-2ff7-4f37-9b38-448fa8c8e78b admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:12.224891 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc5c58-49a1-41af-b125-ac240091acc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:12.225634 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc5c58-49a1-41af-b125-ac240091acc7 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:12.225919 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc5c58-49a1-41af-b125-ac240091acc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:12.226661 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc5c58-49a1-41af-b125-ac240091acc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:12.230305 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-8dbc5c58-49a1-41af-b125-ac240091acc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:12.273424 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e19b5-39f1-46fb-ad8c-cc89917387ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:12.277079 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e19b5-39f1-46fb-ad8c-cc89917387ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:12.277415 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e19b5-39f1-46fb-ad8c-cc89917387ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:12.278658 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e19b5-39f1-46fb-ad8c-cc89917387ce admin admin] PATH_INFO: `/v3/users/3fcf66be3bcd47c5b7ae93b6f5aa7ebb` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:12.285129 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e19b5-39f1-46fb-ad8c-cc89917387ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fcf66be3bcd47c5b7ae93b6f5aa7ebb)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:12.288238 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e19b5-39f1-46fb-ad8c-cc89917387ce admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:12.355155 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc5c58-49a1-41af-b125-ac240091acc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:12.356769 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc5c58-49a1-41af-b125-ac240091acc7 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:12.408375 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 665/1336] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:12.409573 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc5c58-49a1-41af-b125-ac240091acc7 service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:12.411207 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-8dbc5c58-49a1-41af-b125-ac240091acc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:12.441068 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc5c58-49a1-41af-b125-ac240091acc7 service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:12.458855 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fdd16e-d24e-4dca-8293-374af877d311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:12.459628 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdd16e-d24e-4dca-8293-374af877d311 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:12.460532 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdd16e-d24e-4dca-8293-374af877d311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:12.460883 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdd16e-d24e-4dca-8293-374af877d311 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:12.461616 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fdd16e-d24e-4dca-8293-374af877d311 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:12.467819 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fdd16e-d24e-4dca-8293-374af877d311 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:12.539021 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ef2e19b5-39f1-46fb-ad8c-cc89917387ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fcf66be3bcd47c5b7ae93b6f5aa7ebb'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:12.582742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 666/1337] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:12 2022] POST /identity/v3/users => generated 283 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:12.586751 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fdd16e-d24e-4dca-8293-374af877d311 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:12.590766 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ef2e19b5-39f1-46fb-ad8c-cc89917387ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fcf66be3bcd47c5b7ae93b6f5aa7ebb'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:12.591983 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ef2e19b5-39f1-46fb-ad8c-cc89917387ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fcf66be3bcd47c5b7ae93b6f5aa7ebb'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:12.609469 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ef2e19b5-39f1-46fb-ad8c-cc89917387ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fcf66be3bcd47c5b7ae93b6f5aa7ebb'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:12.610352 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ef2e19b5-39f1-46fb-ad8c-cc89917387ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fcf66be3bcd47c5b7ae93b6f5aa7ebb'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:12.615278 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fdd16e-d24e-4dca-8293-374af877d311 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:12.633163 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aed3b8-1d78-4146-bd2c-53618d68c443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:12.634088 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aed3b8-1d78-4146-bd2c-53618d68c443 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:12.634364 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aed3b8-1d78-4146-bd2c-53618d68c443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:12.634635 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aed3b8-1d78-4146-bd2c-53618d68c443 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:12.635279 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aed3b8-1d78-4146-bd2c-53618d68c443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:12.636943 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aed3b8-1d78-4146-bd2c-53618d68c443 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:12.668276 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 667/1338] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:41:12.669238 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aed3b8-1d78-4146-bd2c-53618d68c443 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:12.674443 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-b3aed3b8-1d78-4146-bd2c-53618d68c443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:12.706299 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aed3b8-1d78-4146-bd2c-53618d68c443 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:12.719318 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bdea78-eede-4a08-9927-077ed9d731fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:12.720606 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 672/1339] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:41:11 2022] DELETE /identity/v3/users/3fcf66be3bcd47c5b7ae93b6f5aa7ebb => generated 0 bytes in 845 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:12.722387 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdea78-eede-4a08-9927-077ed9d731fa admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:12.723015 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdea78-eede-4a08-9927-077ed9d731fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:12.723515 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdea78-eede-4a08-9927-077ed9d731fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:12.724440 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bdea78-eede-4a08-9927-077ed9d731fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:12.726282 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bdea78-eede-4a08-9927-077ed9d731fa admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:12.729980 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa10cc-18ce-4121-96e9-7b4d374a06bc None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:12.730380 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa10cc-18ce-4121-96e9-7b4d374a06bc None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:12.730658 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa10cc-18ce-4121-96e9-7b4d374a06bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:12.759515 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 668/1340] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:41:12.766209 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bdea78-eede-4a08-9927-077ed9d731fa admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:12.785999 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-eafa10cc-18ce-4121-96e9-7b4d374a06bc None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:12.794855 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-eafa10cc-18ce-4121-96e9-7b4d374a06bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:12.795260 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bdea78-eede-4a08-9927-077ed9d731fa admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:12.921929 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e75c3-0397-4a8a-8ce1-135044d44142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:12.923200 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e75c3-0397-4a8a-8ce1-135044d44142 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:12.923549 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 673/1341] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:12.923942 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e75c3-0397-4a8a-8ce1-135044d44142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:12.924446 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e75c3-0397-4a8a-8ce1-135044d44142 admin admin] PATH_INFO: `/v3/projects/d2834ae3a66a4ec483af9eb649657305/users/bd24154ab9e94a179139b48256c51823/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:12.941484 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e75c3-0397-4a8a-8ce1-135044d44142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2834ae3a66a4ec483af9eb649657305, user_id=bd24154ab9e94a179139b48256c51823, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:12.947965 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e75c3-0397-4a8a-8ce1-135044d44142 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:13.050594 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:13.064346 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 669/1342] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:12 2022] PUT /identity/v3/projects/d2834ae3a66a4ec483af9eb649657305/users/bd24154ab9e94a179139b48256c51823/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:13.083397 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641cf61-6ea3-4413-b407-f303bbcaf3a3 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:13.083678 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641cf61-6ea3-4413-b407-f303bbcaf3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:13.083952 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641cf61-6ea3-4413-b407-f303bbcaf3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:13.135468 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-2641cf61-6ea3-4413-b407-f303bbcaf3a3 None None] MFA Rules not processed for user `bd24154ab9e94a179139b48256c51823`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:13.141242 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2641cf61-6ea3-4413-b407-f303bbcaf3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:13.239389 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 674/1343] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:13.244917 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e75c3-0397-4a8a-8ce1-135044d44142 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:13.313420 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641cf61-6ea3-4413-b407-f303bbcaf3a3 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:13.315851 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2641cf61-6ea3-4413-b407-f303bbcaf3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:13.334336 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e75c3-0397-4a8a-8ce1-135044d44142 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:13.340635 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34067c2-ad8f-41b3-a54b-dbd3bd4de14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:13.342176 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34067c2-ad8f-41b3-a54b-dbd3bd4de14b admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:13.342176 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34067c2-ad8f-41b3-a54b-dbd3bd4de14b admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:13.342176 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34067c2-ad8f-41b3-a54b-dbd3bd4de14b admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:13.343191 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34067c2-ad8f-41b3-a54b-dbd3bd4de14b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:13.347155 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34067c2-ad8f-41b3-a54b-dbd3bd4de14b admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:13.377566 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:13.431320 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 670/1344] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:13 2022] POST /identity/v3/projects => generated 365 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:13.444467 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641cf61-6ea3-4413-b407-f303bbcaf3a3 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:13.444687 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34067c2-ad8f-41b3-a54b-dbd3bd4de14b admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:13.551242 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29578ac-b7c4-4b53-abe6-33f76ffd537f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:13.551876 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29578ac-b7c4-4b53-abe6-33f76ffd537f service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:13.552176 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29578ac-b7c4-4b53-abe6-33f76ffd537f service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:13.552450 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29578ac-b7c4-4b53-abe6-33f76ffd537f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:13.594242 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34067c2-ad8f-41b3-a54b-dbd3bd4de14b admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:13.630557 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543c3d4-9858-4eee-a9a2-a3776b47bdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:13.633490 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543c3d4-9858-4eee-a9a2-a3776b47bdc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:13.633965 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543c3d4-9858-4eee-a9a2-a3776b47bdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:13.648755 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543c3d4-9858-4eee-a9a2-a3776b47bdc8 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:13.663948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e543c3d4-9858-4eee-a9a2-a3776b47bdc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:13.667172 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e543c3d4-9858-4eee-a9a2-a3776b47bdc8 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:13.692711 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29578ac-b7c4-4b53-abe6-33f76ffd537f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:13.694227 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29578ac-b7c4-4b53-abe6-33f76ffd537f service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:13.725678 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 675/1345] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:41:13.726557 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29578ac-b7c4-4b53-abe6-33f76ffd537f service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:13.735366 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c29578ac-b7c4-4b53-abe6-33f76ffd537f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:13.763943 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29578ac-b7c4-4b53-abe6-33f76ffd537f service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:13.769785 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 671/1346] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:13 2022] POST /identity/v3/users => generated 289 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:13.773902 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543c3d4-9858-4eee-a9a2-a3776b47bdc8 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:13.777675 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a8f19-8d68-4d6d-9c86-2d632c4f82b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:13.778603 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a8f19-8d68-4d6d-9c86-2d632c4f82b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:13.778881 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a8f19-8d68-4d6d-9c86-2d632c4f82b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:13.779154 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a8f19-8d68-4d6d-9c86-2d632c4f82b2 admin admin] PATH_INFO: `/v3/projects/274efbe3694647c09d1aef08b7bc28e0` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:13.780330 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a8f19-8d68-4d6d-9c86-2d632c4f82b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=274efbe3694647c09d1aef08b7bc28e0)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:13.782473 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a8f19-8d68-4d6d-9c86-2d632c4f82b2 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:13.797226 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543c3d4-9858-4eee-a9a2-a3776b47bdc8 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:13.804093 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42464f-2e98-402c-8ae9-f2890203430a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:13.805563 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42464f-2e98-402c-8ae9-f2890203430a admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:13.806006 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42464f-2e98-402c-8ae9-f2890203430a admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:13.806453 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42464f-2e98-402c-8ae9-f2890203430a admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:13.808243 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c42464f-2e98-402c-8ae9-f2890203430a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:13.810581 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c42464f-2e98-402c-8ae9-f2890203430a admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:13.845289 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 672/1347] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:13.849914 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42464f-2e98-402c-8ae9-f2890203430a admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:13.868378 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42464f-2e98-402c-8ae9-f2890203430a admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:13.873968 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9055488-f789-44c6-95cd-a9626db89016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:13.874892 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9055488-f789-44c6-95cd-a9626db89016 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:13.875251 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9055488-f789-44c6-95cd-a9626db89016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:13.875597 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9055488-f789-44c6-95cd-a9626db89016 admin admin] PATH_INFO: `/v3/projects/3314b19e7d7540849718531863f45df0/users/74e3a100b2c646c7b99450065677081a/roles/9252c356af254127896f3626d925a88a` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:13.903585 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9055488-f789-44c6-95cd-a9626db89016 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3314b19e7d7540849718531863f45df0, user_id=74e3a100b2c646c7b99450065677081a, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:13.911231 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9055488-f789-44c6-95cd-a9626db89016 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:14.066477 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 673/1348] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:13 2022] PUT /identity/v3/projects/3314b19e7d7540849718531863f45df0/users/74e3a100b2c646c7b99450065677081a/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:14.066477 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9055488-f789-44c6-95cd-a9626db89016 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:14.071687 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a25a8f19-8d68-4d6d-9c86-2d632c4f82b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '274efbe3694647c09d1aef08b7bc28e0', 'request_id': 'req-a25a8f19-8d68-4d6d-9c86-2d632c4f82b2'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:14.082940 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a25a8f19-8d68-4d6d-9c86-2d632c4f82b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '274efbe3694647c09d1aef08b7bc28e0', 'request_id': 'req-a25a8f19-8d68-4d6d-9c86-2d632c4f82b2'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:14.091904 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a25a8f19-8d68-4d6d-9c86-2d632c4f82b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '274efbe3694647c09d1aef08b7bc28e0', 'request_id': 'req-a25a8f19-8d68-4d6d-9c86-2d632c4f82b2'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:14.190578 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a25a8f19-8d68-4d6d-9c86-2d632c4f82b2 admin admin] The token cache is being invalidate because project 274efbe3694647c09d1aef08b7bc28e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:41:14.190578 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a25a8f19-8d68-4d6d-9c86-2d632c4f82b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:14.190578 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a25a8f19-8d68-4d6d-9c86-2d632c4f82b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:14.190578 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 676/1349] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:41:13 2022] DELETE /identity/v3/projects/274efbe3694647c09d1aef08b7bc28e0 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:14.191215 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4bc00-ddfe-43d7-9119-0a5fcc0020a1 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:14.191497 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4bc00-ddfe-43d7-9119-0a5fcc0020a1 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:14.191767 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4bc00-ddfe-43d7-9119-0a5fcc0020a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:14.197998 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9055488-f789-44c6-95cd-a9626db89016 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:14.237055 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-70a4bc00-ddfe-43d7-9119-0a5fcc0020a1 None None] MFA Rules not processed for user `ef0c95e28e4c439d8bf52b2fc8297444`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:14.238315 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-70a4bc00-ddfe-43d7-9119-0a5fcc0020a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:14.291461 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8f9a6-64a7-4788-bf1b-5ee42c3bdbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:14.292358 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8f9a6-64a7-4788-bf1b-5ee42c3bdbc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:14.292793 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8f9a6-64a7-4788-bf1b-5ee42c3bdbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:14.293235 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8f9a6-64a7-4788-bf1b-5ee42c3bdbc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:14.294032 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e8f9a6-64a7-4788-bf1b-5ee42c3bdbc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:14.295867 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e8f9a6-64a7-4788-bf1b-5ee42c3bdbc6 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:14.319157 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 674/1350] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:14 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:14.320438 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8f9a6-64a7-4788-bf1b-5ee42c3bdbc6 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:14.326007 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-41e8f9a6-64a7-4788-bf1b-5ee42c3bdbc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:14.360145 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8f9a6-64a7-4788-bf1b-5ee42c3bdbc6 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:14.377029 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 677/1351] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:14.379123 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffec684-e25b-4736-8e69-8dd77ebd81cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:14.379760 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffec684-e25b-4736-8e69-8dd77ebd81cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:14.380166 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffec684-e25b-4736-8e69-8dd77ebd81cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:14.380543 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffec684-e25b-4736-8e69-8dd77ebd81cb admin admin] PATH_INFO: `/v3/projects/21800f4931a74506a9ed92caf8e79af5` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:14.381036 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cf081-24ca-44b2-afc4-59d61c55d685 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:14.381547 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cf081-24ca-44b2-afc4-59d61c55d685 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:14.381961 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cf081-24ca-44b2-afc4-59d61c55d685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:14.382395 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffec684-e25b-4736-8e69-8dd77ebd81cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=21800f4931a74506a9ed92caf8e79af5)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:14.383512 dv-cinder-804757-31-smb devstack@keystone.service[81610]: WARNING py.warnings [None req-cffec684-e25b-4736-8e69-8dd77ebd81cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:41:14.383512 dv-cinder-804757-31-smb devstack@keystone.service[81610]: warnings.warn(msg) Nov 02 07:41:14.383512 dv-cinder-804757-31-smb devstack@keystone.service[81610]: Nov 02 07:41:14.384993 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffec684-e25b-4736-8e69-8dd77ebd81cb admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:14.435144 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-ca6cf081-24ca-44b2-afc4-59d61c55d685 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:14.439789 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ca6cf081-24ca-44b2-afc4-59d61c55d685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:14.462785 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 678/1352] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:14.465375 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6cf081-24ca-44b2-afc4-59d61c55d685 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:14.473727 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ca6cf081-24ca-44b2-afc4-59d61c55d685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:14.492004 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6cf081-24ca-44b2-afc4-59d61c55d685 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:14.494721 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac6ccc-dc8d-4620-b734-e2204a534fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:14.495448 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac6ccc-dc8d-4620-b734-e2204a534fb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:14.495736 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac6ccc-dc8d-4620-b734-e2204a534fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:14.496011 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac6ccc-dc8d-4620-b734-e2204a534fb6 admin admin] PATH_INFO: `/v3/projects/3314b19e7d7540849718531863f45df0/users/74e3a100b2c646c7b99450065677081a/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:14.499282 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac6ccc-dc8d-4620-b734-e2204a534fb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3314b19e7d7540849718531863f45df0, user_id=74e3a100b2c646c7b99450065677081a, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:14.503576 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac6ccc-dc8d-4620-b734-e2204a534fb6 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:14.515325 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 679/1353] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:14 2022] PUT /identity/v3/projects/3314b19e7d7540849718531863f45df0/users/74e3a100b2c646c7b99450065677081a/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:14.516739 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffc616-e626-4484-8b70-c10060d0fcb4 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:14.517108 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffc616-e626-4484-8b70-c10060d0fcb4 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:14.518205 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffc616-e626-4484-8b70-c10060d0fcb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:14.549643 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-ecffc616-e626-4484-8b70-c10060d0fcb4 None None] MFA Rules not processed for user `ef0c95e28e4c439d8bf52b2fc8297444`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:14.551067 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ecffc616-e626-4484-8b70-c10060d0fcb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:14.616808 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:14.632021 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-cffec684-e25b-4736-8e69-8dd77ebd81cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21800f4931a74506a9ed92caf8e79af5', 'request_id': 'req-cffec684-e25b-4736-8e69-8dd77ebd81cb'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:14.648552 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 680/1354] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:14.649994 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95862408-c880-406c-851d-d15b674c5d79 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:14.650397 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95862408-c880-406c-851d-d15b674c5d79 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:14.650826 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95862408-c880-406c-851d-d15b674c5d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:14.666235 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-cffec684-e25b-4736-8e69-8dd77ebd81cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21800f4931a74506a9ed92caf8e79af5', 'request_id': 'req-cffec684-e25b-4736-8e69-8dd77ebd81cb'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:14.685806 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-cffec684-e25b-4736-8e69-8dd77ebd81cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21800f4931a74506a9ed92caf8e79af5', 'request_id': 'req-cffec684-e25b-4736-8e69-8dd77ebd81cb'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:14.689586 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-95862408-c880-406c-851d-d15b674c5d79 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:14.691395 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-95862408-c880-406c-851d-d15b674c5d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:14.773895 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-cffec684-e25b-4736-8e69-8dd77ebd81cb admin admin] The token cache is being invalidate because project 21800f4931a74506a9ed92caf8e79af5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:41:14.774689 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-cffec684-e25b-4736-8e69-8dd77ebd81cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:14.775612 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-cffec684-e25b-4736-8e69-8dd77ebd81cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:14.781975 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 675/1355] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:41:14 2022] DELETE /identity/v3/projects/21800f4931a74506a9ed92caf8e79af5 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:14.801744 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301587fb-81fa-4867-9111-771313acff9c None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:14.804499 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301587fb-81fa-4867-9111-771313acff9c None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:14.804499 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301587fb-81fa-4867-9111-771313acff9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:14.812233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 681/1356] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:14.813264 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95862408-c880-406c-851d-d15b674c5d79 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:14.818975 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-95862408-c880-406c-851d-d15b674c5d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:14.871964 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-301587fb-81fa-4867-9111-771313acff9c None None] MFA Rules not processed for user `74e3a100b2c646c7b99450065677081a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:14.873674 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-301587fb-81fa-4867-9111-771313acff9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:14.942581 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95862408-c880-406c-851d-d15b674c5d79 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:14.958672 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b400a9-1a49-49e3-81d6-0ea34d2cdfb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:14.959389 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b400a9-1a49-49e3-81d6-0ea34d2cdfb8 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:14.959804 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b400a9-1a49-49e3-81d6-0ea34d2cdfb8 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:14.960092 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b400a9-1a49-49e3-81d6-0ea34d2cdfb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:14.962811 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d9b400a9-1a49-49e3-81d6-0ea34d2cdfb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:14.992806 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 676/1357] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:14 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:14.994019 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301587fb-81fa-4867-9111-771313acff9c None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:15.007087 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-301587fb-81fa-4867-9111-771313acff9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:15.035721 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301587fb-81fa-4867-9111-771313acff9c None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:15.045614 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8da7c9-dfbf-441b-ac7c-219a7a885f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:15.047770 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8da7c9-dfbf-441b-ac7c-219a7a885f32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:15.049003 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8da7c9-dfbf-441b-ac7c-219a7a885f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:15.050762 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8da7c9-dfbf-441b-ac7c-219a7a885f32 admin admin] PATH_INFO: `/v3/users/5ca28f220d054a9d9fb151c2c6e2ac4c` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:15.054370 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8da7c9-dfbf-441b-ac7c-219a7a885f32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ca28f220d054a9d9fb151c2c6e2ac4c)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:15.058489 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8da7c9-dfbf-441b-ac7c-219a7a885f32 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:15.067043 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b400a9-1a49-49e3-81d6-0ea34d2cdfb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:15.069651 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b400a9-1a49-49e3-81d6-0ea34d2cdfb8 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:15.082913 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 682/1358] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:15.085714 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b400a9-1a49-49e3-81d6-0ea34d2cdfb8 service nova] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:15.096580 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b400a9-1a49-49e3-81d6-0ea34d2cdfb8 service nova] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:15.103023 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77983830-18c6-4b15-a80d-0c085b0f76db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:15.103649 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77983830-18c6-4b15-a80d-0c085b0f76db admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:15.108448 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77983830-18c6-4b15-a80d-0c085b0f76db admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:15.108448 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77983830-18c6-4b15-a80d-0c085b0f76db admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:15.108448 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77983830-18c6-4b15-a80d-0c085b0f76db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:41:15.108448 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77983830-18c6-4b15-a80d-0c085b0f76db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:15.108448 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77983830-18c6-4b15-a80d-0c085b0f76db admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:15.125835 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:15.126371 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 683/1359] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:41:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:41:15.133093 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77983830-18c6-4b15-a80d-0c085b0f76db admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:15.142902 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-77983830-18c6-4b15-a80d-0c085b0f76db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:15.258414 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-9e8da7c9-dfbf-441b-ac7c-219a7a885f32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ca28f220d054a9d9fb151c2c6e2ac4c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:15.278915 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77983830-18c6-4b15-a80d-0c085b0f76db admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:15.287286 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc220b-c21f-49c3-8dfe-0ef3ff9d8c89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:15.292460 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc220b-c21f-49c3-8dfe-0ef3ff9d8c89 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:15.292460 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc220b-c21f-49c3-8dfe-0ef3ff9d8c89 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:15.292460 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc220b-c21f-49c3-8dfe-0ef3ff9d8c89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:15.292838 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-9e8da7c9-dfbf-441b-ac7c-219a7a885f32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ca28f220d054a9d9fb151c2c6e2ac4c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:15.308355 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-9e8da7c9-dfbf-441b-ac7c-219a7a885f32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ca28f220d054a9d9fb151c2c6e2ac4c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:15.309813 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-9e8da7c9-dfbf-441b-ac7c-219a7a885f32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ca28f220d054a9d9fb151c2c6e2ac4c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:15.309994 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc220b-c21f-49c3-8dfe-0ef3ff9d8c89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:15.311094 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-9e8da7c9-dfbf-441b-ac7c-219a7a885f32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ca28f220d054a9d9fb151c2c6e2ac4c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:15.312269 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc220b-c21f-49c3-8dfe-0ef3ff9d8c89 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:15.326826 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 684/1360] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:15 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:15.328234 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc220b-c21f-49c3-8dfe-0ef3ff9d8c89 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:15.342841 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc220b-c21f-49c3-8dfe-0ef3ff9d8c89 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:15.350011 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74660d-e109-497d-bc8f-25b513ef23f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:15.350360 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74660d-e109-497d-bc8f-25b513ef23f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:15.350777 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74660d-e109-497d-bc8f-25b513ef23f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:15.351144 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74660d-e109-497d-bc8f-25b513ef23f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:15.352016 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74660d-e109-497d-bc8f-25b513ef23f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:15.354588 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74660d-e109-497d-bc8f-25b513ef23f8 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:15.401120 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 677/1361] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:41:14 2022] DELETE /identity/v3/users/5ca28f220d054a9d9fb151c2c6e2ac4c => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:15.492238 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 685/1362] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:15 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:15.496542 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8da7c9-dfbf-441b-ac7c-219a7a885f32 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:15.500246 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-9e8da7c9-dfbf-441b-ac7c-219a7a885f32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:15.605069 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8da7c9-dfbf-441b-ac7c-219a7a885f32 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:15.769826 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f74cf-ff27-4aa8-93a4-cf6d788a31a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:15.773788 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f74cf-ff27-4aa8-93a4-cf6d788a31a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:15.774077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f74cf-ff27-4aa8-93a4-cf6d788a31a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:15.776459 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f74cf-ff27-4aa8-93a4-cf6d788a31a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:15.777171 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f74cf-ff27-4aa8-93a4-cf6d788a31a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:15.786557 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f74cf-ff27-4aa8-93a4-cf6d788a31a9 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:15.871186 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74660d-e109-497d-bc8f-25b513ef23f8 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:15.873474 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5c74660d-e109-497d-bc8f-25b513ef23f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:15.897929 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74660d-e109-497d-bc8f-25b513ef23f8 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:15.898725 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 678/1363] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:15 2022] POST /identity/v3/users => generated 289 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:15.902535 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f74cf-ff27-4aa8-93a4-cf6d788a31a9 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:15.913615 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd93a33b-4e83-43f8-a076-481ab908cdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:15.914423 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93a33b-4e83-43f8-a076-481ab908cdb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:15.914715 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93a33b-4e83-43f8-a076-481ab908cdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:15.914976 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93a33b-4e83-43f8-a076-481ab908cdb6 admin admin] PATH_INFO: `/v3/projects/299588e3d9434733a9fc0e482be629b5` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:15.919158 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd93a33b-4e83-43f8-a076-481ab908cdb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=299588e3d9434733a9fc0e482be629b5)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:15.925826 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd93a33b-4e83-43f8-a076-481ab908cdb6 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:15.942728 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f74cf-ff27-4aa8-93a4-cf6d788a31a9 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:15.958829 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e3a68-7cbe-4e3b-b40c-a914aa63ae59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:15.959836 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e3a68-7cbe-4e3b-b40c-a914aa63ae59 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:15.960362 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e3a68-7cbe-4e3b-b40c-a914aa63ae59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:15.960875 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e3a68-7cbe-4e3b-b40c-a914aa63ae59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:15.961731 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e3a68-7cbe-4e3b-b40c-a914aa63ae59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:15.963564 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e3a68-7cbe-4e3b-b40c-a914aa63ae59 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:15.986060 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 679/1364] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:15.989953 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e3a68-7cbe-4e3b-b40c-a914aa63ae59 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:16.009545 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e3a68-7cbe-4e3b-b40c-a914aa63ae59 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:16.029992 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da89f51-1204-41c6-be3d-b4eee64106c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:16.030681 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da89f51-1204-41c6-be3d-b4eee64106c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:16.030963 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da89f51-1204-41c6-be3d-b4eee64106c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:16.031237 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da89f51-1204-41c6-be3d-b4eee64106c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:16.032562 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da89f51-1204-41c6-be3d-b4eee64106c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:16.035275 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da89f51-1204-41c6-be3d-b4eee64106c3 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:16.048308 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 680/1365] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:41:16.052662 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da89f51-1204-41c6-be3d-b4eee64106c3 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:16.102824 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da89f51-1204-41c6-be3d-b4eee64106c3 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:16.123508 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-fd93a33b-4e83-43f8-a076-481ab908cdb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '299588e3d9434733a9fc0e482be629b5', 'request_id': 'req-fd93a33b-4e83-43f8-a076-481ab908cdb6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:16.143129 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-fd93a33b-4e83-43f8-a076-481ab908cdb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '299588e3d9434733a9fc0e482be629b5', 'request_id': 'req-fd93a33b-4e83-43f8-a076-481ab908cdb6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:16.166513 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-fd93a33b-4e83-43f8-a076-481ab908cdb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '299588e3d9434733a9fc0e482be629b5', 'request_id': 'req-fd93a33b-4e83-43f8-a076-481ab908cdb6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:16.242767 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084cbfdf-ceb4-4874-b533-3b096599cf84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:16.244153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084cbfdf-ceb4-4874-b533-3b096599cf84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:16.244518 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084cbfdf-ceb4-4874-b533-3b096599cf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:16.245074 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084cbfdf-ceb4-4874-b533-3b096599cf84 admin admin] PATH_INFO: `/v3/projects/57e25d8be58947809c9ec9041fbc736e/users/a5c89e0efadf4ffdb5e126c95a8273c1/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:16.264447 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-fd93a33b-4e83-43f8-a076-481ab908cdb6 admin admin] The token cache is being invalidate because project 299588e3d9434733a9fc0e482be629b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:41:16.264751 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-fd93a33b-4e83-43f8-a076-481ab908cdb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:16.267639 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-fd93a33b-4e83-43f8-a076-481ab908cdb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:16.274088 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 686/1366] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:41:15 2022] DELETE /identity/v3/projects/299588e3d9434733a9fc0e482be629b5 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:41:16.276348 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c031a-526e-41aa-8dc9-4c746ac08386 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:16.276629 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c031a-526e-41aa-8dc9-4c746ac08386 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:16.276905 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c031a-526e-41aa-8dc9-4c746ac08386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:16.334135 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084cbfdf-ceb4-4874-b533-3b096599cf84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57e25d8be58947809c9ec9041fbc736e, user_id=a5c89e0efadf4ffdb5e126c95a8273c1, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:16.341556 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-902c031a-526e-41aa-8dc9-4c746ac08386 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:16.342881 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084cbfdf-ceb4-4874-b533-3b096599cf84 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:16.344434 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-902c031a-526e-41aa-8dc9-4c746ac08386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:16.383056 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 687/1367] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:16.384961 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ff882-e6e7-4e63-9774-06cc708ca4dd None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:16.385452 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ff882-e6e7-4e63-9774-06cc708ca4dd None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:16.385893 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ff882-e6e7-4e63-9774-06cc708ca4dd None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:16.408774 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 688/1368] 10.222.0.16 () {54 vars in 912 bytes} [Wed Nov 2 07:41:16 2022] GET /identity => generated 270 bytes in 25 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:41:16.410399 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053b0e0-8a1e-47fe-addb-0f1c37effec5 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:16.413318 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053b0e0-8a1e-47fe-addb-0f1c37effec5 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:16.414040 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053b0e0-8a1e-47fe-addb-0f1c37effec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:16.461015 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-c053b0e0-8a1e-47fe-addb-0f1c37effec5 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:16.462303 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c053b0e0-8a1e-47fe-addb-0f1c37effec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:16.463783 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 681/1369] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:16 2022] PUT /identity/v3/projects/57e25d8be58947809c9ec9041fbc736e/users/a5c89e0efadf4ffdb5e126c95a8273c1/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:16.476978 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f805f0-0dfc-4353-8528-cbdf33ecdc11 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:16.484621 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f805f0-0dfc-4353-8528-cbdf33ecdc11 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:16.484621 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f805f0-0dfc-4353-8528-cbdf33ecdc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:16.570292 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:16.618683 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-20f805f0-0dfc-4353-8528-cbdf33ecdc11 None None] MFA Rules not processed for user `c35fe87fc263440980ce70680748e5af`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:16.620164 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-20f805f0-0dfc-4353-8528-cbdf33ecdc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:16.627711 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 689/1370] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:16.633435 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5f2e3-5a91-4245-a4ae-adeefe896453 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:16.633789 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5f2e3-5a91-4245-a4ae-adeefe896453 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:16.634167 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5f2e3-5a91-4245-a4ae-adeefe896453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:16.642350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:16.693283 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-70e5f2e3-5a91-4245-a4ae-adeefe896453 None None] MFA Rules not processed for user `a5c89e0efadf4ffdb5e126c95a8273c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:16.694600 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-70e5f2e3-5a91-4245-a4ae-adeefe896453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:16.699042 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 682/1371] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Nov 2 07:41:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:16.699952 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f805f0-0dfc-4353-8528-cbdf33ecdc11 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:16.742874 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f805f0-0dfc-4353-8528-cbdf33ecdc11 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:16.755580 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48865e0-be10-4db1-8d26-ea7e76067a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:16.756434 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48865e0-be10-4db1-8d26-ea7e76067a80 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:16.758002 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48865e0-be10-4db1-8d26-ea7e76067a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:16.758293 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48865e0-be10-4db1-8d26-ea7e76067a80 admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:16.759690 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48865e0-be10-4db1-8d26-ea7e76067a80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:41:16.760030 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48865e0-be10-4db1-8d26-ea7e76067a80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:16.761806 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48865e0-be10-4db1-8d26-ea7e76067a80 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:16.785684 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 683/1372] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:41:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:41:16.785684 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48865e0-be10-4db1-8d26-ea7e76067a80 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:16.785684 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a48865e0-be10-4db1-8d26-ea7e76067a80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:16.825671 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48865e0-be10-4db1-8d26-ea7e76067a80 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:16.851922 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d570c1d-2e7f-4ad2-908a-1881200160d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:16.853200 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d570c1d-2e7f-4ad2-908a-1881200160d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:16.853487 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d570c1d-2e7f-4ad2-908a-1881200160d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:16.853904 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d570c1d-2e7f-4ad2-908a-1881200160d4 admin admin] PATH_INFO: `/v3/users/bd24154ab9e94a179139b48256c51823` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:16.856140 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d570c1d-2e7f-4ad2-908a-1881200160d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd24154ab9e94a179139b48256c51823)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:16.858314 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d570c1d-2e7f-4ad2-908a-1881200160d4 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:16.859224 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 690/1373] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:16.860250 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5f2e3-5a91-4245-a4ae-adeefe896453 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:16.886487 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5f2e3-5a91-4245-a4ae-adeefe896453 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:16.899216 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc74853-8a23-4253-a6a0-58ae65bc8774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:16.899852 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc74853-8a23-4253-a6a0-58ae65bc8774 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:16.900157 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc74853-8a23-4253-a6a0-58ae65bc8774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:16.900429 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc74853-8a23-4253-a6a0-58ae65bc8774 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:16.901153 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc74853-8a23-4253-a6a0-58ae65bc8774 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:16.903341 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc74853-8a23-4253-a6a0-58ae65bc8774 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:17.026840 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 691/1374] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:16 2022] POST /identity/v3/projects => generated 389 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:17.027573 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc74853-8a23-4253-a6a0-58ae65bc8774 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:17.039188 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-1dc74853-8a23-4253-a6a0-58ae65bc8774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:17.159288 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4d570c1d-2e7f-4ad2-908a-1881200160d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd24154ab9e94a179139b48256c51823'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:17.192276 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc74853-8a23-4253-a6a0-58ae65bc8774 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:17.207012 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25299e34-a3f7-4fe9-bf5a-20759d7f6dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:17.207643 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25299e34-a3f7-4fe9-bf5a-20759d7f6dd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:17.207920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25299e34-a3f7-4fe9-bf5a-20759d7f6dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:17.208233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25299e34-a3f7-4fe9-bf5a-20759d7f6dd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:17.208875 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25299e34-a3f7-4fe9-bf5a-20759d7f6dd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:17.210911 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25299e34-a3f7-4fe9-bf5a-20759d7f6dd7 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:17.214529 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4d570c1d-2e7f-4ad2-908a-1881200160d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd24154ab9e94a179139b48256c51823'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:17.236707 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4d570c1d-2e7f-4ad2-908a-1881200160d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd24154ab9e94a179139b48256c51823'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:17.241118 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4d570c1d-2e7f-4ad2-908a-1881200160d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd24154ab9e94a179139b48256c51823'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:17.242051 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4d570c1d-2e7f-4ad2-908a-1881200160d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd24154ab9e94a179139b48256c51823'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:17.245253 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:17.345717 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 684/1375] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:41:16 2022] DELETE /identity/v3/users/bd24154ab9e94a179139b48256c51823 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:17.347233 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d570c1d-2e7f-4ad2-908a-1881200160d4 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:17.350025 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-4d570c1d-2e7f-4ad2-908a-1881200160d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:17.378182 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 692/1376] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:17 2022] POST /identity/v3/projects => generated 375 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:17.379096 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25299e34-a3f7-4fe9-bf5a-20759d7f6dd7 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:17.389741 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-25299e34-a3f7-4fe9-bf5a-20759d7f6dd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:17.446097 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d570c1d-2e7f-4ad2-908a-1881200160d4 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:17.539353 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25299e34-a3f7-4fe9-bf5a-20759d7f6dd7 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:17.555772 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a0211-f96f-4e43-b5a6-b4f880671cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:17.555772 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a0211-f96f-4e43-b5a6-b4f880671cb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:17.555772 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a0211-f96f-4e43-b5a6-b4f880671cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:17.556083 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a0211-f96f-4e43-b5a6-b4f880671cb8 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:17.556652 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a0211-f96f-4e43-b5a6-b4f880671cb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:17.560871 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a0211-f96f-4e43-b5a6-b4f880671cb8 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:17.592338 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da3a4a-5ae7-4805-9067-da9d74e1f321 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:17.593015 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da3a4a-5ae7-4805-9067-da9d74e1f321 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:17.593293 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da3a4a-5ae7-4805-9067-da9d74e1f321 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:17.593567 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da3a4a-5ae7-4805-9067-da9d74e1f321 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:17.599352 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-67da3a4a-5ae7-4805-9067-da9d74e1f321 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:17.617120 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da3a4a-5ae7-4805-9067-da9d74e1f321 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:17.618244 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da3a4a-5ae7-4805-9067-da9d74e1f321 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:17.642732 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 685/1377] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:17.644837 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb5352-784a-481e-9f00-de80db6abc24 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:17.645131 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb5352-784a-481e-9f00-de80db6abc24 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:17.645505 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb5352-784a-481e-9f00-de80db6abc24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:17.690922 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-aefb5352-784a-481e-9f00-de80db6abc24 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:17.699260 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-aefb5352-784a-481e-9f00-de80db6abc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:17.715348 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 693/1378] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:17 2022] POST /identity/v3/users => generated 295 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:17.715896 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a0211-f96f-4e43-b5a6-b4f880671cb8 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:17.718585 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-808a0211-f96f-4e43-b5a6-b4f880671cb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:17.725208 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 686/1379] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:17.726161 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb5352-784a-481e-9f00-de80db6abc24 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:17.730041 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-aefb5352-784a-481e-9f00-de80db6abc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:17.754889 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb5352-784a-481e-9f00-de80db6abc24 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:17.755385 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a0211-f96f-4e43-b5a6-b4f880671cb8 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:17.766803 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b7dfb-96cb-4e10-a155-ff94982cd01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:17.767500 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b7dfb-96cb-4e10-a155-ff94982cd01c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:17.767778 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b7dfb-96cb-4e10-a155-ff94982cd01c admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:17.768074 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b7dfb-96cb-4e10-a155-ff94982cd01c admin admin] PATH_INFO: `/v3/projects/27776355c7824ad988ea40f7ceb3741f` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:17.770076 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54b7dfb-96cb-4e10-a155-ff94982cd01c admin admin] RBAC: Authorizing `identity:delete_project(project_id=27776355c7824ad988ea40f7ceb3741f)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:17.772871 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae391201-486f-4ea6-a8ae-a64f3c3a9e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:17.777758 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae391201-486f-4ea6-a8ae-a64f3c3a9e81 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:17.777758 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae391201-486f-4ea6-a8ae-a64f3c3a9e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:17.778254 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54b7dfb-96cb-4e10-a155-ff94982cd01c admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:17.779695 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae391201-486f-4ea6-a8ae-a64f3c3a9e81 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:17.781199 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae391201-486f-4ea6-a8ae-a64f3c3a9e81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:17.794472 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae391201-486f-4ea6-a8ae-a64f3c3a9e81 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:17.839978 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:17.960631 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 694/1380] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:17 2022] POST /identity/v3/users => generated 294 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:17.961565 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae391201-486f-4ea6-a8ae-a64f3c3a9e81 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:17.968942 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c54b7dfb-96cb-4e10-a155-ff94982cd01c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27776355c7824ad988ea40f7ceb3741f', 'request_id': 'req-c54b7dfb-96cb-4e10-a155-ff94982cd01c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:17.981660 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c54b7dfb-96cb-4e10-a155-ff94982cd01c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27776355c7824ad988ea40f7ceb3741f', 'request_id': 'req-c54b7dfb-96cb-4e10-a155-ff94982cd01c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:17.996358 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae391201-486f-4ea6-a8ae-a64f3c3a9e81 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:18.003962 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c54b7dfb-96cb-4e10-a155-ff94982cd01c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27776355c7824ad988ea40f7ceb3741f', 'request_id': 'req-c54b7dfb-96cb-4e10-a155-ff94982cd01c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:18.435612 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c54b7dfb-96cb-4e10-a155-ff94982cd01c admin admin] The token cache is being invalidate because project 27776355c7824ad988ea40f7ceb3741f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:41:18.435612 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c54b7dfb-96cb-4e10-a155-ff94982cd01c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:18.435612 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c54b7dfb-96cb-4e10-a155-ff94982cd01c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:18.435612 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 687/1381] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:41:17 2022] DELETE /identity/v3/projects/27776355c7824ad988ea40f7ceb3741f => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:18.435612 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b7dfb-96cb-4e10-a155-ff94982cd01c admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:18.437809 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c54b7dfb-96cb-4e10-a155-ff94982cd01c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:18.438232 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031e983-708a-4acf-be42-5b4a73329b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:18.438232 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031e983-708a-4acf-be42-5b4a73329b4c admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:18.438232 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031e983-708a-4acf-be42-5b4a73329b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:18.438232 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031e983-708a-4acf-be42-5b4a73329b4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:18.438599 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031e983-708a-4acf-be42-5b4a73329b4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:18.438599 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031e983-708a-4acf-be42-5b4a73329b4c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:18.438599 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 695/1382] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:18.438599 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031e983-708a-4acf-be42-5b4a73329b4c admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:18.438599 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b031e983-708a-4acf-be42-5b4a73329b4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:18.438599 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031e983-708a-4acf-be42-5b4a73329b4c admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:18.442029 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ffda9-d823-4292-ad2e-337821dd16a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:18.442029 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ffda9-d823-4292-ad2e-337821dd16a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:18.442029 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ffda9-d823-4292-ad2e-337821dd16a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:18.442029 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ffda9-d823-4292-ad2e-337821dd16a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:18.442409 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ffda9-d823-4292-ad2e-337821dd16a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:18.442409 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ffda9-d823-4292-ad2e-337821dd16a3 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:18.442409 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 696/1383] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:18.442409 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aaff6c-ae4b-427d-b3e8-34678cb82dd9 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:18.442409 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aaff6c-ae4b-427d-b3e8-34678cb82dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:18.442409 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aaff6c-ae4b-427d-b3e8-34678cb82dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:18.442741 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-47aaff6c-ae4b-427d-b3e8-34678cb82dd9 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:18.442741 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-47aaff6c-ae4b-427d-b3e8-34678cb82dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:18.442741 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 697/1384] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:18.442741 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aaff6c-ae4b-427d-b3e8-34678cb82dd9 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:18.442741 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-47aaff6c-ae4b-427d-b3e8-34678cb82dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:18.443804 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b7dfb-96cb-4e10-a155-ff94982cd01c admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:18.443804 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ad2a6-c90e-480b-a293-59cf2eeeb588 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:18.443804 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ad2a6-c90e-480b-a293-59cf2eeeb588 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:18.443804 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ad2a6-c90e-480b-a293-59cf2eeeb588 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:18.444083 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ad2a6-c90e-480b-a293-59cf2eeeb588 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:18.444083 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-2b4ad2a6-c90e-480b-a293-59cf2eeeb588 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:18.459230 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aaff6c-ae4b-427d-b3e8-34678cb82dd9 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:18.476202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76aa72-2804-4ac1-ab07-8ea7d6c7ae1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:18.476872 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76aa72-2804-4ac1-ab07-8ea7d6c7ae1e admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:18.477917 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76aa72-2804-4ac1-ab07-8ea7d6c7ae1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:18.478321 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76aa72-2804-4ac1-ab07-8ea7d6c7ae1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:18.480983 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f76aa72-2804-4ac1-ab07-8ea7d6c7ae1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:18.490849 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f76aa72-2804-4ac1-ab07-8ea7d6c7ae1e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:18.494178 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4ad2a6-c90e-480b-a293-59cf2eeeb588 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:18.527332 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4ad2a6-c90e-480b-a293-59cf2eeeb588 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:18.527477 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 698/1385] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:18.527849 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76aa72-2804-4ac1-ab07-8ea7d6c7ae1e admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:18.540987 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 688/1386] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:18.543560 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d6484-933d-42bb-a2cc-5ec3170f106d None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:18.543925 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d6484-933d-42bb-a2cc-5ec3170f106d None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:18.544309 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d6484-933d-42bb-a2cc-5ec3170f106d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:18.553671 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76aa72-2804-4ac1-ab07-8ea7d6c7ae1e admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:18.570190 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee431296-0a5e-4f96-b0f7-507182fc0abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:18.570773 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee431296-0a5e-4f96-b0f7-507182fc0abc admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:18.581673 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee431296-0a5e-4f96-b0f7-507182fc0abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:18.582912 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee431296-0a5e-4f96-b0f7-507182fc0abc admin admin] PATH_INFO: `/v3/projects/884d6fe9ae48498998a04cba7fc452ff/users/ace8fbdaa0724388a159cda894cbee69/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:18.599304 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-072d6484-933d-42bb-a2cc-5ec3170f106d None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:18.602598 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-072d6484-933d-42bb-a2cc-5ec3170f106d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:18.611560 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 689/1387] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:18.612620 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d6484-933d-42bb-a2cc-5ec3170f106d None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:18.630169 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d6484-933d-42bb-a2cc-5ec3170f106d None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:18.636820 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed506913-a4fc-47d4-9f1c-d1e23a18d61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:18.637712 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed506913-a4fc-47d4-9f1c-d1e23a18d61f admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:18.638155 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed506913-a4fc-47d4-9f1c-d1e23a18d61f admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:18.638851 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed506913-a4fc-47d4-9f1c-d1e23a18d61f admin admin] PATH_INFO: `/v3/projects/2e7478bda4e4445185e6a143c2d31f43/users/ee94f1ea11124c30b55eb7d5fe22bd1f/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:18.645388 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee431296-0a5e-4f96-b0f7-507182fc0abc admin admin] RBAC: Authorizing `identity:create_grant(project_id=884d6fe9ae48498998a04cba7fc452ff, user_id=ace8fbdaa0724388a159cda894cbee69, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:18.652104 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee431296-0a5e-4f96-b0f7-507182fc0abc admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:18.671375 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed506913-a4fc-47d4-9f1c-d1e23a18d61f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e7478bda4e4445185e6a143c2d31f43, user_id=ee94f1ea11124c30b55eb7d5fe22bd1f, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:18.676971 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed506913-a4fc-47d4-9f1c-d1e23a18d61f admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:18.958050 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 699/1388] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:18 2022] PUT /identity/v3/projects/884d6fe9ae48498998a04cba7fc452ff/users/ace8fbdaa0724388a159cda894cbee69/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:18.958050 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee431296-0a5e-4f96-b0f7-507182fc0abc admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:18.958563 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 690/1389] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:18 2022] PUT /identity/v3/projects/2e7478bda4e4445185e6a143c2d31f43/users/ee94f1ea11124c30b55eb7d5fe22bd1f/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:18.958563 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed506913-a4fc-47d4-9f1c-d1e23a18d61f admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:19.093722 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee431296-0a5e-4f96-b0f7-507182fc0abc admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:19.104753 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50d601-8ad2-4f91-8f20-62811405a641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:19.106868 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50d601-8ad2-4f91-8f20-62811405a641 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:19.107466 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50d601-8ad2-4f91-8f20-62811405a641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:19.107834 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50d601-8ad2-4f91-8f20-62811405a641 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:19.112195 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb50d601-8ad2-4f91-8f20-62811405a641 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:41:19.112738 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb50d601-8ad2-4f91-8f20-62811405a641 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:19.115312 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb50d601-8ad2-4f91-8f20-62811405a641 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:19.116318 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed506913-a4fc-47d4-9f1c-d1e23a18d61f admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:19.122059 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cec954-573a-410f-9683-cea733e20b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:19.123871 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cec954-573a-410f-9683-cea733e20b59 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:19.124376 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cec954-573a-410f-9683-cea733e20b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:19.124885 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cec954-573a-410f-9683-cea733e20b59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:19.128494 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cec954-573a-410f-9683-cea733e20b59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:19.131049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cec954-573a-410f-9683-cea733e20b59 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:19.148437 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 700/1390] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:41:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:41:19.149017 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0352e-9c12-4eb8-8e1b-b8e1441910fd None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:19.152497 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0352e-9c12-4eb8-8e1b-b8e1441910fd None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:19.152928 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0352e-9c12-4eb8-8e1b-b8e1441910fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:19.199646 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 691/1391] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:19.199856 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cec954-573a-410f-9683-cea733e20b59 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:19.216779 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-40b0352e-9c12-4eb8-8e1b-b8e1441910fd None None] MFA Rules not processed for user `ee94f1ea11124c30b55eb7d5fe22bd1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:19.222472 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-40b0352e-9c12-4eb8-8e1b-b8e1441910fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:19.238301 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cec954-573a-410f-9683-cea733e20b59 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:19.267401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9669a1f-07ca-480d-bb82-a5bbc06d7b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:19.267401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9669a1f-07ca-480d-bb82-a5bbc06d7b92 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:19.267401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9669a1f-07ca-480d-bb82-a5bbc06d7b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:19.267401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9669a1f-07ca-480d-bb82-a5bbc06d7b92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:19.267819 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9669a1f-07ca-480d-bb82-a5bbc06d7b92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:19.275034 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9669a1f-07ca-480d-bb82-a5bbc06d7b92 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:19.374895 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 701/1392] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:19 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:19.378890 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0352e-9c12-4eb8-8e1b-b8e1441910fd None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:19.413013 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0352e-9c12-4eb8-8e1b-b8e1441910fd None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:19.420445 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 692/1393] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:19 2022] POST /identity/v3/projects => generated 379 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:19.421982 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b806247-4c32-4bfc-93ca-c08fc1823b9a None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:19.422413 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b806247-4c32-4bfc-93ca-c08fc1823b9a None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:19.422830 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b806247-4c32-4bfc-93ca-c08fc1823b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:19.429495 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:19.436585 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb267e-7369-4e53-b676-6bed06b78498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:19.436585 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb267e-7369-4e53-b676-6bed06b78498 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:19.436585 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb267e-7369-4e53-b676-6bed06b78498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:19.436585 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb267e-7369-4e53-b676-6bed06b78498 admin admin] PATH_INFO: `/v3/projects/884d6fe9ae48498998a04cba7fc452ff/users/ace8fbdaa0724388a159cda894cbee69/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:19.437860 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bb267e-7369-4e53-b676-6bed06b78498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=884d6fe9ae48498998a04cba7fc452ff, user_id=ace8fbdaa0724388a159cda894cbee69, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:19.441810 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bb267e-7369-4e53-b676-6bed06b78498 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:19.474399 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 702/1394] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:19 2022] PUT /identity/v3/projects/884d6fe9ae48498998a04cba7fc452ff/users/ace8fbdaa0724388a159cda894cbee69/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:19.475304 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb267e-7369-4e53-b676-6bed06b78498 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:19.519473 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-0b806247-4c32-4bfc-93ca-c08fc1823b9a None None] MFA Rules not processed for user `047b50cfb513438dbda9cdd89b578062`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:19.524257 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-0b806247-4c32-4bfc-93ca-c08fc1823b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:19.665589 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb267e-7369-4e53-b676-6bed06b78498 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:19.685497 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a59cae-832f-4a8d-be14-dea2cfc50439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:19.686695 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a59cae-832f-4a8d-be14-dea2cfc50439 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:19.687645 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a59cae-832f-4a8d-be14-dea2cfc50439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:19.688611 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a59cae-832f-4a8d-be14-dea2cfc50439 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:19.690497 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a59cae-832f-4a8d-be14-dea2cfc50439 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:19.697809 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a59cae-832f-4a8d-be14-dea2cfc50439 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:19.751811 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 693/1395] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:19.751811 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b806247-4c32-4bfc-93ca-c08fc1823b9a None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:19.775650 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b806247-4c32-4bfc-93ca-c08fc1823b9a None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:19.791315 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091abea5-3479-47ff-9734-042fc27badf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:19.797576 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091abea5-3479-47ff-9734-042fc27badf7 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:19.797576 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091abea5-3479-47ff-9734-042fc27badf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:19.797576 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091abea5-3479-47ff-9734-042fc27badf7 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:19.797576 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091abea5-3479-47ff-9734-042fc27badf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:19.797576 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091abea5-3479-47ff-9734-042fc27badf7 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:19.931194 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 703/1396] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:19 2022] POST /identity/v3/projects => generated 387 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:19.931194 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a6d4e-ee63-47f0-a7f3-61d954426403 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:19.933653 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a6d4e-ee63-47f0-a7f3-61d954426403 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:19.934222 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a6d4e-ee63-47f0-a7f3-61d954426403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:19.975783 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 694/1397] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:19 2022] POST /identity/v3/users => generated 290 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:19.976762 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091abea5-3479-47ff-9734-042fc27badf7 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:19.981730 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-091abea5-3479-47ff-9734-042fc27badf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:19.995257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-a45a6d4e-ee63-47f0-a7f3-61d954426403 None None] MFA Rules not processed for user `ace8fbdaa0724388a159cda894cbee69`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:19.999542 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a45a6d4e-ee63-47f0-a7f3-61d954426403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:20.057164 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:20.103138 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091abea5-3479-47ff-9734-042fc27badf7 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:20.137619 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:20.164854 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 704/1398] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:20.166442 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a6d4e-ee63-47f0-a7f3-61d954426403 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:20.168157 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a45a6d4e-ee63-47f0-a7f3-61d954426403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:20.224922 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cfc2d6-aa76-4916-b6cc-8539239457c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:20.228210 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfc2d6-aa76-4916-b6cc-8539239457c9 service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:20.228210 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfc2d6-aa76-4916-b6cc-8539239457c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:20.228210 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfc2d6-aa76-4916-b6cc-8539239457c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:20.333610 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a6d4e-ee63-47f0-a7f3-61d954426403 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:20.339620 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cfc2d6-aa76-4916-b6cc-8539239457c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:20.342904 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cfc2d6-aa76-4916-b6cc-8539239457c9 service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:20.358598 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9b88b-f993-4c30-b94e-975a9d5a918f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '741c9fc71c80438faa037c85f4997c3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:20.358598 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9b88b-f993-4c30-b94e-975a9d5a918f service placement] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:20.358598 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9b88b-f993-4c30-b94e-975a9d5a918f service placement] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:20.358598 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9b88b-f993-4c30-b94e-975a9d5a918f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:20.360316 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-afe9b88b-f993-4c30-b94e-975a9d5a918f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:20.366980 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 695/1399] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:20.368001 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cfc2d6-aa76-4916-b6cc-8539239457c9 service nova] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:20.385236 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9b88b-f993-4c30-b94e-975a9d5a918f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:20.390707 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9b88b-f993-4c30-b94e-975a9d5a918f service placement] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:20.417302 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 705/1400] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:20.418414 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9b88b-f993-4c30-b94e-975a9d5a918f service placement] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:20.533110 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cfc2d6-aa76-4916-b6cc-8539239457c9 service nova] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:20.543341 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba627a8-166f-4462-9ef9-48c1381983e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:20.544965 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba627a8-166f-4462-9ef9-48c1381983e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:20.550467 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba627a8-166f-4462-9ef9-48c1381983e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:20.550467 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba627a8-166f-4462-9ef9-48c1381983e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:20.551308 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba627a8-166f-4462-9ef9-48c1381983e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:20.558036 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba627a8-166f-4462-9ef9-48c1381983e1 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:20.592857 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9b88b-f993-4c30-b94e-975a9d5a918f service placement] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:20.600834 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e6941-80c1-42c0-a0f4-77b18dac6e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:20.601603 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e6941-80c1-42c0-a0f4-77b18dac6e95 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:20.601946 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e6941-80c1-42c0-a0f4-77b18dac6e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:20.602287 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e6941-80c1-42c0-a0f4-77b18dac6e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:20.603061 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e6941-80c1-42c0-a0f4-77b18dac6e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:20.624874 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e6941-80c1-42c0-a0f4-77b18dac6e95 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:20.684523 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 696/1401] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:20 2022] POST /identity/v3/users => generated 300 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:20.686468 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 706/1402] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:20.687591 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e6941-80c1-42c0-a0f4-77b18dac6e95 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:20.689381 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba627a8-166f-4462-9ef9-48c1381983e1 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:20.690194 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ae2e6941-80c1-42c0-a0f4-77b18dac6e95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:20.701474 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-7ba627a8-166f-4462-9ef9-48c1381983e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:20.757288 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba627a8-166f-4462-9ef9-48c1381983e1 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:20.804025 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f66469-f4b4-4dac-8f11-3d1891c9fcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:20.805267 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f66469-f4b4-4dac-8f11-3d1891c9fcbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:20.807288 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f66469-f4b4-4dac-8f11-3d1891c9fcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:20.810566 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f66469-f4b4-4dac-8f11-3d1891c9fcbf admin admin] PATH_INFO: `/v3/projects/d2834ae3a66a4ec483af9eb649657305` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:20.816158 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f66469-f4b4-4dac-8f11-3d1891c9fcbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2834ae3a66a4ec483af9eb649657305)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:20.820899 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f66469-f4b4-4dac-8f11-3d1891c9fcbf admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:20.935461 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e6941-80c1-42c0-a0f4-77b18dac6e95 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:20.951439 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8439bd84-3233-4c98-8855-4be781b963c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:20.951439 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439bd84-3233-4c98-8855-4be781b963c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:20.951439 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439bd84-3233-4c98-8855-4be781b963c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:20.951439 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439bd84-3233-4c98-8855-4be781b963c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:20.958791 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8439bd84-3233-4c98-8855-4be781b963c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:21.054066 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e4f66469-f4b4-4dac-8f11-3d1891c9fcbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2834ae3a66a4ec483af9eb649657305', 'request_id': 'req-e4f66469-f4b4-4dac-8f11-3d1891c9fcbf'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:21.077920 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e4f66469-f4b4-4dac-8f11-3d1891c9fcbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2834ae3a66a4ec483af9eb649657305', 'request_id': 'req-e4f66469-f4b4-4dac-8f11-3d1891c9fcbf'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:21.088713 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e4f66469-f4b4-4dac-8f11-3d1891c9fcbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2834ae3a66a4ec483af9eb649657305', 'request_id': 'req-e4f66469-f4b4-4dac-8f11-3d1891c9fcbf'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:21.206093 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8439bd84-3233-4c98-8855-4be781b963c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:21.207561 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8439bd84-3233-4c98-8855-4be781b963c0 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:21.226797 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e4f66469-f4b4-4dac-8f11-3d1891c9fcbf admin admin] The token cache is being invalidate because project d2834ae3a66a4ec483af9eb649657305 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:41:21.226797 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e4f66469-f4b4-4dac-8f11-3d1891c9fcbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:21.226797 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e4f66469-f4b4-4dac-8f11-3d1891c9fcbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:21.228570 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 697/1403] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:41:20 2022] DELETE /identity/v3/projects/d2834ae3a66a4ec483af9eb649657305 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:21.230017 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f66469-f4b4-4dac-8f11-3d1891c9fcbf admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:21.233040 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e4f66469-f4b4-4dac-8f11-3d1891c9fcbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:21.243844 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 707/1404] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:21.245491 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8439bd84-3233-4c98-8855-4be781b963c0 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:21.272401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8439bd84-3233-4c98-8855-4be781b963c0 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:21.429107 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f66469-f4b4-4dac-8f11-3d1891c9fcbf admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:21.443000 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6544ba-63d6-4111-928c-7127ca84ab41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:21.443779 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6544ba-63d6-4111-928c-7127ca84ab41 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:21.444096 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6544ba-63d6-4111-928c-7127ca84ab41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:21.444237 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6544ba-63d6-4111-928c-7127ca84ab41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:21.446703 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a76457-fb0d-47f1-8ea5-3a92f787b67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:21.447325 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a76457-fb0d-47f1-8ea5-3a92f787b67a admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:21.447603 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a76457-fb0d-47f1-8ea5-3a92f787b67a admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:21.447873 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a76457-fb0d-47f1-8ea5-3a92f787b67a admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:21.449371 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6544ba-63d6-4111-928c-7127ca84ab41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:21.453093 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6544ba-63d6-4111-928c-7127ca84ab41 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:21.453241 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a76457-fb0d-47f1-8ea5-3a92f787b67a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:21.454827 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a76457-fb0d-47f1-8ea5-3a92f787b67a admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:21.478579 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 698/1405] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:21.479455 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6544ba-63d6-4111-928c-7127ca84ab41 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:21.482418 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 708/1406] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:21.482983 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-6f6544ba-63d6-4111-928c-7127ca84ab41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:21.483305 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a76457-fb0d-47f1-8ea5-3a92f787b67a admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:21.508544 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a76457-fb0d-47f1-8ea5-3a92f787b67a admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:21.519505 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b3ad2-0870-42d3-be4f-2e6cbbcc30c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:21.525697 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b3ad2-0870-42d3-be4f-2e6cbbcc30c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:21.528815 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6544ba-63d6-4111-928c-7127ca84ab41 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:21.528969 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b3ad2-0870-42d3-be4f-2e6cbbcc30c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:21.529237 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b3ad2-0870-42d3-be4f-2e6cbbcc30c3 admin admin] PATH_INFO: `/v3/projects/72f386d1e565487aa4fc51cf0aa32338/users/70cf580b61b544258a30d9c27e8999ff/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:21.559280 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49250e90-8754-418d-82d1-d1ffe6897773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:21.560113 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49250e90-8754-418d-82d1-d1ffe6897773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:21.560471 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49250e90-8754-418d-82d1-d1ffe6897773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:21.560890 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49250e90-8754-418d-82d1-d1ffe6897773 admin admin] PATH_INFO: `/v3/users/74e3a100b2c646c7b99450065677081a` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:21.562441 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49250e90-8754-418d-82d1-d1ffe6897773 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74e3a100b2c646c7b99450065677081a)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:21.565908 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49250e90-8754-418d-82d1-d1ffe6897773 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:21.588159 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b3ad2-0870-42d3-be4f-2e6cbbcc30c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72f386d1e565487aa4fc51cf0aa32338, user_id=70cf580b61b544258a30d9c27e8999ff, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:21.599187 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b3ad2-0870-42d3-be4f-2e6cbbcc30c3 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:21.694807 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 709/1407] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:21 2022] PUT /identity/v3/projects/72f386d1e565487aa4fc51cf0aa32338/users/70cf580b61b544258a30d9c27e8999ff/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:21.695812 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b3ad2-0870-42d3-be4f-2e6cbbcc30c3 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:21.706424 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-304b3ad2-0870-42d3-be4f-2e6cbbcc30c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:21.891782 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-49250e90-8754-418d-82d1-d1ffe6897773 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74e3a100b2c646c7b99450065677081a'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:21.938652 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-49250e90-8754-418d-82d1-d1ffe6897773 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74e3a100b2c646c7b99450065677081a'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:21.950500 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:21.955310 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-49250e90-8754-418d-82d1-d1ffe6897773 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74e3a100b2c646c7b99450065677081a'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:21.957752 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-49250e90-8754-418d-82d1-d1ffe6897773 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74e3a100b2c646c7b99450065677081a'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:21.960011 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-49250e90-8754-418d-82d1-d1ffe6897773 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74e3a100b2c646c7b99450065677081a'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:21.977210 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b3ad2-0870-42d3-be4f-2e6cbbcc30c3 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:21.988441 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9435e3-df42-4bd8-8d04-4c72df301b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:21.989517 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9435e3-df42-4bd8-8d04-4c72df301b19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:21.991552 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9435e3-df42-4bd8-8d04-4c72df301b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:21.992005 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9435e3-df42-4bd8-8d04-4c72df301b19 admin admin] PATH_INFO: `/v3/projects/c80fc130e9b74249b899991628d7e4ce/users/d741aff188f74c468a3894d28241321f/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:22.013608 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9435e3-df42-4bd8-8d04-4c72df301b19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c80fc130e9b74249b899991628d7e4ce, user_id=d741aff188f74c468a3894d28241321f, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:22.018274 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9435e3-df42-4bd8-8d04-4c72df301b19 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:22.105706 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 699/1408] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:41:21 2022] DELETE /identity/v3/users/74e3a100b2c646c7b99450065677081a => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:22.109251 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:22.117372 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 710/1409] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:21 2022] PUT /identity/v3/projects/c80fc130e9b74249b899991628d7e4ce/users/d741aff188f74c468a3894d28241321f/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:22.120457 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c7eff-ec2f-4291-a2ac-f969ee1d3390 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:22.120721 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c7eff-ec2f-4291-a2ac-f969ee1d3390 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:22.120992 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c7eff-ec2f-4291-a2ac-f969ee1d3390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:22.122644 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2671483-4ad0-48fd-9552-d1a90945f421 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:22.122941 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2671483-4ad0-48fd-9552-d1a90945f421 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:22.123220 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2671483-4ad0-48fd-9552-d1a90945f421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:22.223671 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-d68c7eff-ec2f-4291-a2ac-f969ee1d3390 None None] MFA Rules not processed for user `6fc9296c011d4712949ec015ea157762`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:22.231395 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d68c7eff-ec2f-4291-a2ac-f969ee1d3390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:22.245635 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-f2671483-4ad0-48fd-9552-d1a90945f421 None None] MFA Rules not processed for user `70cf580b61b544258a30d9c27e8999ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:22.249994 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f2671483-4ad0-48fd-9552-d1a90945f421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:22.464333 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 711/1410] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:22 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:22.465968 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c7eff-ec2f-4291-a2ac-f969ee1d3390 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:22.468899 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d68c7eff-ec2f-4291-a2ac-f969ee1d3390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:22.472328 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 700/1411] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:22.473460 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2671483-4ad0-48fd-9552-d1a90945f421 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:22.476516 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f2671483-4ad0-48fd-9552-d1a90945f421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:22.643442 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c7eff-ec2f-4291-a2ac-f969ee1d3390 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:22.657837 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956a0c3-0c20-4c03-b285-3e5dd965512d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:22.661467 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956a0c3-0c20-4c03-b285-3e5dd965512d admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:22.661467 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956a0c3-0c20-4c03-b285-3e5dd965512d admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:22.661467 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956a0c3-0c20-4c03-b285-3e5dd965512d admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:22.662476 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2671483-4ad0-48fd-9552-d1a90945f421 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:22.663101 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956a0c3-0c20-4c03-b285-3e5dd965512d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:22.667480 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956a0c3-0c20-4c03-b285-3e5dd965512d admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:22.685739 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c27168-2621-43fe-88dd-a2760f52708e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:22.687014 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c27168-2621-43fe-88dd-a2760f52708e service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:22.687227 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c27168-2621-43fe-88dd-a2760f52708e service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:22.687624 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c27168-2621-43fe-88dd-a2760f52708e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:22.699909 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 712/1412] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:22.702176 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956a0c3-0c20-4c03-b285-3e5dd965512d admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:22.703982 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c27168-2621-43fe-88dd-a2760f52708e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:22.706338 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c27168-2621-43fe-88dd-a2760f52708e service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:22.708521 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c956a0c3-0c20-4c03-b285-3e5dd965512d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:22.737752 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 701/1413] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:22 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:22.742509 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c27168-2621-43fe-88dd-a2760f52708e service nova] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:22.755685 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956a0c3-0c20-4c03-b285-3e5dd965512d admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:22.766712 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7bf9b-6d26-40c7-a2b3-b331a67e8d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:22.767645 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7bf9b-6d26-40c7-a2b3-b331a67e8d89 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:22.768034 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7bf9b-6d26-40c7-a2b3-b331a67e8d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:22.768348 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7bf9b-6d26-40c7-a2b3-b331a67e8d89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:22.768997 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf7bf9b-6d26-40c7-a2b3-b331a67e8d89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:22.773545 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf7bf9b-6d26-40c7-a2b3-b331a67e8d89 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:22.775721 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c27168-2621-43fe-88dd-a2760f52708e service nova] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:22.789169 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f7139-9fc3-4b93-9b9e-aea8b5c24365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:22.789857 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f7139-9fc3-4b93-9b9e-aea8b5c24365 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:22.790142 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f7139-9fc3-4b93-9b9e-aea8b5c24365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:22.790903 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f7139-9fc3-4b93-9b9e-aea8b5c24365 admin admin] PATH_INFO: `/v3/projects/c80fc130e9b74249b899991628d7e4ce/users/d741aff188f74c468a3894d28241321f/roles/9252c356af254127896f3626d925a88a` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:22.797148 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90f7139-9fc3-4b93-9b9e-aea8b5c24365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c80fc130e9b74249b899991628d7e4ce, user_id=d741aff188f74c468a3894d28241321f, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:22.801990 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90f7139-9fc3-4b93-9b9e-aea8b5c24365 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:22.826421 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 702/1414] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:22 2022] PUT /identity/v3/projects/c80fc130e9b74249b899991628d7e4ce/users/d741aff188f74c468a3894d28241321f/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:22.837428 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f8503-e3c0-4d14-978c-9a4a9bb0f5db None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:22.838286 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f8503-e3c0-4d14-978c-9a4a9bb0f5db None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:22.838596 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f8503-e3c0-4d14-978c-9a4a9bb0f5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:22.934991 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 713/1415] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:22 2022] POST /identity/v3/projects => generated 379 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:22.940776 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7bf9b-6d26-40c7-a2b3-b331a67e8d89 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:22.965100 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-ee1f8503-e3c0-4d14-978c-9a4a9bb0f5db None None] MFA Rules not processed for user `d741aff188f74c468a3894d28241321f`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:22.976856 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-ee1f8503-e3c0-4d14-978c-9a4a9bb0f5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:23.093774 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7bf9b-6d26-40c7-a2b3-b331a67e8d89 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:23.103902 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96642c23-6f3d-45ad-ae4c-049a0424e97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:23.104526 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96642c23-6f3d-45ad-ae4c-049a0424e97b admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:23.105067 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96642c23-6f3d-45ad-ae4c-049a0424e97b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:23.105323 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96642c23-6f3d-45ad-ae4c-049a0424e97b admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:23.105968 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96642c23-6f3d-45ad-ae4c-049a0424e97b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:23.110697 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96642c23-6f3d-45ad-ae4c-049a0424e97b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:23.226036 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 703/1416] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:22 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:23.226036 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f8503-e3c0-4d14-978c-9a4a9bb0f5db None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:23.226036 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-ee1f8503-e3c0-4d14-978c-9a4a9bb0f5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:23.241364 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f8503-e3c0-4d14-978c-9a4a9bb0f5db None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:23.255581 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123df3d4-061e-4f72-9e60-a06585cc78dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:23.256272 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123df3d4-061e-4f72-9e60-a06585cc78dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:23.256552 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123df3d4-061e-4f72-9e60-a06585cc78dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:23.256824 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123df3d4-061e-4f72-9e60-a06585cc78dd admin admin] PATH_INFO: `/v3/projects/3314b19e7d7540849718531863f45df0` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:23.259477 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123df3d4-061e-4f72-9e60-a06585cc78dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3314b19e7d7540849718531863f45df0)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:23.273745 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 714/1417] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:22 2022] POST /identity/v3/users => generated 296 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:23.275234 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96642c23-6f3d-45ad-ae4c-049a0424e97b admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:23.276627 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123df3d4-061e-4f72-9e60-a06585cc78dd admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:23.277823 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-96642c23-6f3d-45ad-ae4c-049a0424e97b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:23.379286 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:23.386834 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96642c23-6f3d-45ad-ae4c-049a0424e97b admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:23.390963 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f75688-3ee9-4cfc-bab0-65f835dc7ba4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:23.391750 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f75688-3ee9-4cfc-bab0-65f835dc7ba4 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:23.392774 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f75688-3ee9-4cfc-bab0-65f835dc7ba4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:23.393104 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f75688-3ee9-4cfc-bab0-65f835dc7ba4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:23.404449 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f75688-3ee9-4cfc-bab0-65f835dc7ba4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:23.406433 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f75688-3ee9-4cfc-bab0-65f835dc7ba4 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:23.420296 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 715/1418] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:23 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:23.421677 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f75688-3ee9-4cfc-bab0-65f835dc7ba4 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:23.435117 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f75688-3ee9-4cfc-bab0-65f835dc7ba4 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:23.440811 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-123df3d4-061e-4f72-9e60-a06585cc78dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3314b19e7d7540849718531863f45df0', 'request_id': 'req-123df3d4-061e-4f72-9e60-a06585cc78dd'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:23.451133 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-123df3d4-061e-4f72-9e60-a06585cc78dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3314b19e7d7540849718531863f45df0', 'request_id': 'req-123df3d4-061e-4f72-9e60-a06585cc78dd'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:23.458361 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-123df3d4-061e-4f72-9e60-a06585cc78dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3314b19e7d7540849718531863f45df0', 'request_id': 'req-123df3d4-061e-4f72-9e60-a06585cc78dd'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:23.508735 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-123df3d4-061e-4f72-9e60-a06585cc78dd admin admin] The token cache is being invalidate because project 3314b19e7d7540849718531863f45df0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:41:23.509177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-123df3d4-061e-4f72-9e60-a06585cc78dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:23.510799 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-123df3d4-061e-4f72-9e60-a06585cc78dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:23.515500 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 704/1419] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:41:23 2022] DELETE /identity/v3/projects/3314b19e7d7540849718531863f45df0 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:23.523312 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37673c6c-eb80-4981-b176-d2b4d98e0547 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:23.524323 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37673c6c-eb80-4981-b176-d2b4d98e0547 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:23.524739 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37673c6c-eb80-4981-b176-d2b4d98e0547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:23.594648 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-37673c6c-eb80-4981-b176-d2b4d98e0547 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:23.611782 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-37673c6c-eb80-4981-b176-d2b4d98e0547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:23.626689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b53dc4-ae55-4048-b168-569593ea663d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:23.631549 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b53dc4-ae55-4048-b168-569593ea663d admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:23.631549 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b53dc4-ae55-4048-b168-569593ea663d admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:23.631549 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b53dc4-ae55-4048-b168-569593ea663d admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:23.635269 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b53dc4-ae55-4048-b168-569593ea663d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:23.637065 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b53dc4-ae55-4048-b168-569593ea663d admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:23.643233 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 705/1420] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:23.650111 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126d7a5-c692-4a65-a650-3d4a3a928a48 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:23.651154 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126d7a5-c692-4a65-a650-3d4a3a928a48 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:23.651486 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126d7a5-c692-4a65-a650-3d4a3a928a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:23.681963 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 716/1421] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:23.703226 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b53dc4-ae55-4048-b168-569593ea663d admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:23.721527 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f6b53dc4-ae55-4048-b168-569593ea663d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:23.736607 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b53dc4-ae55-4048-b168-569593ea663d admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:23.742683 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0662cf6-d5d7-4b86-9089-6dea8d40b2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:23.743560 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0662cf6-d5d7-4b86-9089-6dea8d40b2e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:23.743682 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-9126d7a5-c692-4a65-a650-3d4a3a928a48 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:23.744103 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0662cf6-d5d7-4b86-9089-6dea8d40b2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:23.744746 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0662cf6-d5d7-4b86-9089-6dea8d40b2e6 admin admin] PATH_INFO: `/v3/projects/7ac325c466a84c14b2c00e2de6d1514c/users/5f5afccce6164732b78e91bf8e731149/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:23.745106 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-9126d7a5-c692-4a65-a650-3d4a3a928a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:23.756976 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 706/1422] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:23.759086 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126d7a5-c692-4a65-a650-3d4a3a928a48 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:23.759772 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-9126d7a5-c692-4a65-a650-3d4a3a928a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:23.768028 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0662cf6-d5d7-4b86-9089-6dea8d40b2e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ac325c466a84c14b2c00e2de6d1514c, user_id=5f5afccce6164732b78e91bf8e731149, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:23.776184 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0662cf6-d5d7-4b86-9089-6dea8d40b2e6 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:23.777689 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126d7a5-c692-4a65-a650-3d4a3a928a48 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:23.789648 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d1ee5-ec22-4474-9a77-95edb6b733ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:23.789648 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d1ee5-ec22-4474-9a77-95edb6b733ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:23.789648 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d1ee5-ec22-4474-9a77-95edb6b733ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:23.789648 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d1ee5-ec22-4474-9a77-95edb6b733ad admin admin] PATH_INFO: `/v3/users/ee94f1ea11124c30b55eb7d5fe22bd1f` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:23.790275 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d1ee5-ec22-4474-9a77-95edb6b733ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee94f1ea11124c30b55eb7d5fe22bd1f)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:23.790555 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d1ee5-ec22-4474-9a77-95edb6b733ad admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:23.859628 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:23.875806 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 717/1423] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:23 2022] PUT /identity/v3/projects/7ac325c466a84c14b2c00e2de6d1514c/users/5f5afccce6164732b78e91bf8e731149/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:23.879144 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45bb272-093b-4921-9ef1-d45573c018ec None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:23.880435 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45bb272-093b-4921-9ef1-d45573c018ec None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:23.883424 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45bb272-093b-4921-9ef1-d45573c018ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:23.967598 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-c45bb272-093b-4921-9ef1-d45573c018ec None None] MFA Rules not processed for user `193e45cadb3c4586ab94051c42cf5192`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:23.975049 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c45bb272-093b-4921-9ef1-d45573c018ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:24.032151 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f78d1ee5-ec22-4474-9a77-95edb6b733ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee94f1ea11124c30b55eb7d5fe22bd1f'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:24.056263 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f78d1ee5-ec22-4474-9a77-95edb6b733ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee94f1ea11124c30b55eb7d5fe22bd1f'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:24.071581 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f78d1ee5-ec22-4474-9a77-95edb6b733ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee94f1ea11124c30b55eb7d5fe22bd1f'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:24.072615 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f78d1ee5-ec22-4474-9a77-95edb6b733ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee94f1ea11124c30b55eb7d5fe22bd1f'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:24.073365 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f78d1ee5-ec22-4474-9a77-95edb6b733ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee94f1ea11124c30b55eb7d5fe22bd1f'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:24.080910 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 718/1424] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:23 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:24.084953 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45bb272-093b-4921-9ef1-d45573c018ec None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:24.205266 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 707/1425] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:41:23 2022] DELETE /identity/v3/users/ee94f1ea11124c30b55eb7d5fe22bd1f => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:24.206985 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d1ee5-ec22-4474-9a77-95edb6b733ad admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:24.214580 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f78d1ee5-ec22-4474-9a77-95edb6b733ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:24.274461 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45bb272-093b-4921-9ef1-d45573c018ec None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:24.382407 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d1ee5-ec22-4474-9a77-95edb6b733ad admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:24.397173 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71055e7-3c55-42d9-b108-e1f351c97e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:24.399750 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71055e7-3c55-42d9-b108-e1f351c97e68 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:24.400688 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71055e7-3c55-42d9-b108-e1f351c97e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:24.401833 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71055e7-3c55-42d9-b108-e1f351c97e68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:24.402630 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71055e7-3c55-42d9-b108-e1f351c97e68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:24.405953 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71055e7-3c55-42d9-b108-e1f351c97e68 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:24.410033 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d12d5-dff0-4008-9b1a-c4e80929b1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:24.416577 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d12d5-dff0-4008-9b1a-c4e80929b1e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:24.416577 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d12d5-dff0-4008-9b1a-c4e80929b1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:24.416577 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d12d5-dff0-4008-9b1a-c4e80929b1e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:24.416577 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d12d5-dff0-4008-9b1a-c4e80929b1e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:41:24.416577 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d12d5-dff0-4008-9b1a-c4e80929b1e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:24.416577 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d12d5-dff0-4008-9b1a-c4e80929b1e2 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:24.426926 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 708/1426] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:24.429239 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af000529-f818-48cf-b5a4-9a8ae8937c0c None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:24.429670 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af000529-f818-48cf-b5a4-9a8ae8937c0c None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:24.430336 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af000529-f818-48cf-b5a4-9a8ae8937c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:24.438357 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 719/1427] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:41:24.438357 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a94a4-208e-4df1-81a7-baf5fd431239 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:24.438357 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a94a4-208e-4df1-81a7-baf5fd431239 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:24.438357 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a94a4-208e-4df1-81a7-baf5fd431239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:24.457209 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-af000529-f818-48cf-b5a4-9a8ae8937c0c None None] MFA Rules not processed for user `193e45cadb3c4586ab94051c42cf5192`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:24.458713 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-af000529-f818-48cf-b5a4-9a8ae8937c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:24.466918 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-f03a94a4-208e-4df1-81a7-baf5fd431239 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:24.468374 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f03a94a4-208e-4df1-81a7-baf5fd431239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:24.479062 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 720/1428] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:24.480365 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a94a4-208e-4df1-81a7-baf5fd431239 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:24.499750 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a94a4-208e-4df1-81a7-baf5fd431239 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:24.508461 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c4a75-4aed-451b-ba96-746a9f99cf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:24.509135 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c4a75-4aed-451b-ba96-746a9f99cf75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:24.509413 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c4a75-4aed-451b-ba96-746a9f99cf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:24.509691 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c4a75-4aed-451b-ba96-746a9f99cf75 admin admin] PATH_INFO: `/v3/projects/7ac325c466a84c14b2c00e2de6d1514c/users/5f5afccce6164732b78e91bf8e731149/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:24.511895 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c4a75-4aed-451b-ba96-746a9f99cf75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ac325c466a84c14b2c00e2de6d1514c, user_id=5f5afccce6164732b78e91bf8e731149, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:24.515381 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c4a75-4aed-451b-ba96-746a9f99cf75 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:24.528031 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 721/1429] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:24 2022] PUT /identity/v3/projects/7ac325c466a84c14b2c00e2de6d1514c/users/5f5afccce6164732b78e91bf8e731149/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:24.533570 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c4a75-4aed-451b-ba96-746a9f99cf75 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:24.537492 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-af4c4a75-4aed-451b-ba96-746a9f99cf75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:24.547911 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 709/1430] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:24.564439 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af000529-f818-48cf-b5a4-9a8ae8937c0c None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:24.569498 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-af000529-f818-48cf-b5a4-9a8ae8937c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:24.643036 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c4a75-4aed-451b-ba96-746a9f99cf75 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:24.665065 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12dfc59-7863-404c-af41-770ae3e2952f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:24.665702 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12dfc59-7863-404c-af41-770ae3e2952f admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:24.665982 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12dfc59-7863-404c-af41-770ae3e2952f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:24.666423 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12dfc59-7863-404c-af41-770ae3e2952f admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:24.667139 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12dfc59-7863-404c-af41-770ae3e2952f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:24.676471 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12dfc59-7863-404c-af41-770ae3e2952f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:24.732177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af000529-f818-48cf-b5a4-9a8ae8937c0c None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:24.802687 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 722/1431] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:24 2022] POST /identity/v3/projects => generated 377 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:24.807275 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4d758-ad04-4271-a991-ed09ea308c16 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:24.807568 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4d758-ad04-4271-a991-ed09ea308c16 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:24.807844 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4d758-ad04-4271-a991-ed09ea308c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:24.824504 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c1af1-5af0-4462-b7be-06b8988f246b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:24.825513 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c1af1-5af0-4462-b7be-06b8988f246b service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:24.826018 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c1af1-5af0-4462-b7be-06b8988f246b service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:24.826497 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c1af1-5af0-4462-b7be-06b8988f246b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:24.848858 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c1af1-5af0-4462-b7be-06b8988f246b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:24.850451 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c1af1-5af0-4462-b7be-06b8988f246b service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:24.857307 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-d7e4d758-ad04-4271-a991-ed09ea308c16 None None] MFA Rules not processed for user `5f5afccce6164732b78e91bf8e731149`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:24.859096 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d7e4d758-ad04-4271-a991-ed09ea308c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:24.861859 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 710/1432] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:24.869348 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c1af1-5af0-4462-b7be-06b8988f246b service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:24.871004 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-9d7c1af1-5af0-4462-b7be-06b8988f246b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:25.053889 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 723/1433] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:24 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:25.054659 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4d758-ad04-4271-a991-ed09ea308c16 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:25.068294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:25.100978 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c1af1-5af0-4462-b7be-06b8988f246b service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:25.206801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4d758-ad04-4271-a991-ed09ea308c16 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:25.214270 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69aea0a-3f11-4603-8155-c8c38a9b4164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:25.215346 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69aea0a-3f11-4603-8155-c8c38a9b4164 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:25.216015 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69aea0a-3f11-4603-8155-c8c38a9b4164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:25.216445 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69aea0a-3f11-4603-8155-c8c38a9b4164 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:25.217387 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69aea0a-3f11-4603-8155-c8c38a9b4164 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:25.224664 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69aea0a-3f11-4603-8155-c8c38a9b4164 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:25.291061 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6213ab-85ad-4ff6-b080-a006218e58e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:25.291840 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6213ab-85ad-4ff6-b080-a006218e58e6 service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:25.293975 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6213ab-85ad-4ff6-b080-a006218e58e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:25.293975 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6213ab-85ad-4ff6-b080-a006218e58e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:25.297555 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-4f6213ab-85ad-4ff6-b080-a006218e58e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:25.387692 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 724/1434] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:25 2022] POST /identity/v3/users => generated 289 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:25.388393 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69aea0a-3f11-4603-8155-c8c38a9b4164 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:25.392113 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d69aea0a-3f11-4603-8155-c8c38a9b4164 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:25.531431 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6213ab-85ad-4ff6-b080-a006218e58e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:25.537507 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6213ab-85ad-4ff6-b080-a006218e58e6 service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:25.557023 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69aea0a-3f11-4603-8155-c8c38a9b4164 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:25.575070 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b85bf-ced3-4a23-bf6e-e4794fffe3af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:25.576452 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b85bf-ced3-4a23-bf6e-e4794fffe3af service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:25.576919 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b85bf-ced3-4a23-bf6e-e4794fffe3af service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:25.577023 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 711/1435] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:24 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 708 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:25.577198 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b85bf-ced3-4a23-bf6e-e4794fffe3af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:25.577914 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6213ab-85ad-4ff6-b080-a006218e58e6 service nova] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:25.587982 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-297b85bf-ced3-4a23-bf6e-e4794fffe3af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:25.616649 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6213ab-85ad-4ff6-b080-a006218e58e6 service nova] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:25.635698 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414ce48-7b0d-4587-8b98-cd09e7531128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:25.636370 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414ce48-7b0d-4587-8b98-cd09e7531128 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:25.636644 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414ce48-7b0d-4587-8b98-cd09e7531128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:25.641232 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414ce48-7b0d-4587-8b98-cd09e7531128 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:25.642474 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414ce48-7b0d-4587-8b98-cd09e7531128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:25.648628 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414ce48-7b0d-4587-8b98-cd09e7531128 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:25.694547 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 712/1436] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:25.699124 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414ce48-7b0d-4587-8b98-cd09e7531128 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:25.741607 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414ce48-7b0d-4587-8b98-cd09e7531128 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:25.756553 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e027a4a-da0f-43c3-a12a-b8457fdd7f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:25.761646 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e027a4a-da0f-43c3-a12a-b8457fdd7f8c admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:25.761932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e027a4a-da0f-43c3-a12a-b8457fdd7f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:25.762215 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e027a4a-da0f-43c3-a12a-b8457fdd7f8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:25.764198 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e027a4a-da0f-43c3-a12a-b8457fdd7f8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:25.765818 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e027a4a-da0f-43c3-a12a-b8457fdd7f8c admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:25.803833 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 713/1437] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:25.808536 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e027a4a-da0f-43c3-a12a-b8457fdd7f8c admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:25.820196 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297b85bf-ced3-4a23-bf6e-e4794fffe3af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:25.822946 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297b85bf-ced3-4a23-bf6e-e4794fffe3af service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:25.837020 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 725/1438] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:25.854203 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e027a4a-da0f-43c3-a12a-b8457fdd7f8c admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:25.890672 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe54a3-bcb2-487c-9e88-66c5f31fae42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:25.893068 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe54a3-bcb2-487c-9e88-66c5f31fae42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:25.893363 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe54a3-bcb2-487c-9e88-66c5f31fae42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:25.895563 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe54a3-bcb2-487c-9e88-66c5f31fae42 admin admin] PATH_INFO: `/v3/projects/10eb3ac9fd3e4bb5b06a288bf0b1ce8e/users/5bc29c9a3f2742e2a1a71e7e81cf50d9/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:25.910748 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256130d4-a992-47ee-8dfb-52fcc4759d88 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:25.910971 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256130d4-a992-47ee-8dfb-52fcc4759d88 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:25.913545 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256130d4-a992-47ee-8dfb-52fcc4759d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:25.966285 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe54a3-bcb2-487c-9e88-66c5f31fae42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10eb3ac9fd3e4bb5b06a288bf0b1ce8e, user_id=5bc29c9a3f2742e2a1a71e7e81cf50d9, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:25.968532 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-256130d4-a992-47ee-8dfb-52fcc4759d88 None None] MFA Rules not processed for user `047b50cfb513438dbda9cdd89b578062`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:25.969782 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-256130d4-a992-47ee-8dfb-52fcc4759d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:25.972690 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe54a3-bcb2-487c-9e88-66c5f31fae42 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:26.106954 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 726/1439] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:26.119175 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 714/1440] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:25 2022] PUT /identity/v3/projects/10eb3ac9fd3e4bb5b06a288bf0b1ce8e/users/5bc29c9a3f2742e2a1a71e7e81cf50d9/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:26.134510 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb37a33-587f-4072-bd09-49fa59d40bb1 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:26.134868 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb37a33-587f-4072-bd09-49fa59d40bb1 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:26.137012 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb37a33-587f-4072-bd09-49fa59d40bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:26.209637 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe54a3-bcb2-487c-9e88-66c5f31fae42 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:26.209637 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-4ffe54a3-bcb2-487c-9e88-66c5f31fae42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:26.225365 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-dbb37a33-587f-4072-bd09-49fa59d40bb1 None None] MFA Rules not processed for user `5bc29c9a3f2742e2a1a71e7e81cf50d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:26.230007 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:26.231937 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-dbb37a33-587f-4072-bd09-49fa59d40bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:26.365067 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe54a3-bcb2-487c-9e88-66c5f31fae42 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:26.378448 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef74a3-4cab-481d-a13b-a38ec63872d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:26.379080 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef74a3-4cab-481d-a13b-a38ec63872d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:26.381730 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef74a3-4cab-481d-a13b-a38ec63872d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:26.382036 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef74a3-4cab-481d-a13b-a38ec63872d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:26.393855 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-44ef74a3-4cab-481d-a13b-a38ec63872d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:26.415513 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 727/1441] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:26.417412 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb37a33-587f-4072-bd09-49fa59d40bb1 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:26.423710 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-dbb37a33-587f-4072-bd09-49fa59d40bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:26.506002 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:26.551194 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef74a3-4cab-481d-a13b-a38ec63872d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:26.552779 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef74a3-4cab-481d-a13b-a38ec63872d8 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:26.594183 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 715/1442] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:26 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:26.596307 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fe5af-c768-41ed-a7a3-6d171cbbb603 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:26.596594 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fe5af-c768-41ed-a7a3-6d171cbbb603 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:26.596870 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fe5af-c768-41ed-a7a3-6d171cbbb603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:26.641756 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb37a33-587f-4072-bd09-49fa59d40bb1 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:26.654938 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c376c1-e577-4590-8957-55bfcfc8dfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:26.656324 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c376c1-e577-4590-8957-55bfcfc8dfde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:26.665862 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c376c1-e577-4590-8957-55bfcfc8dfde admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:26.665862 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c376c1-e577-4590-8957-55bfcfc8dfde admin admin] PATH_INFO: `/v3/projects/2e7478bda4e4445185e6a143c2d31f43` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:26.665862 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c376c1-e577-4590-8957-55bfcfc8dfde admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e7478bda4e4445185e6a143c2d31f43)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:26.671905 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c376c1-e577-4590-8957-55bfcfc8dfde admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:26.799060 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-960fe5af-c768-41ed-a7a3-6d171cbbb603 None None] MFA Rules not processed for user `0c65f5001a224e0b92e94dc6df9f8f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:26.800366 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-960fe5af-c768-41ed-a7a3-6d171cbbb603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:26.902570 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-80c376c1-e577-4590-8957-55bfcfc8dfde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e7478bda4e4445185e6a143c2d31f43', 'request_id': 'req-80c376c1-e577-4590-8957-55bfcfc8dfde'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:26.924989 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-80c376c1-e577-4590-8957-55bfcfc8dfde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e7478bda4e4445185e6a143c2d31f43', 'request_id': 'req-80c376c1-e577-4590-8957-55bfcfc8dfde'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:26.937090 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-80c376c1-e577-4590-8957-55bfcfc8dfde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e7478bda4e4445185e6a143c2d31f43', 'request_id': 'req-80c376c1-e577-4590-8957-55bfcfc8dfde'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:27.003130 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 716/1443] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Nov 2 07:41:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:27.004984 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960fe5af-c768-41ed-a7a3-6d171cbbb603 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:27.043331 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960fe5af-c768-41ed-a7a3-6d171cbbb603 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:27.128768 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-80c376c1-e577-4590-8957-55bfcfc8dfde admin admin] The token cache is being invalidate because project 2e7478bda4e4445185e6a143c2d31f43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:41:27.129341 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-80c376c1-e577-4590-8957-55bfcfc8dfde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:27.140477 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-80c376c1-e577-4590-8957-55bfcfc8dfde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:27.145712 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 728/1444] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:41:26 2022] DELETE /identity/v3/projects/2e7478bda4e4445185e6a143c2d31f43 => generated 0 bytes in 727 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:27.151763 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f604425-6390-40f8-bcba-e00dba5c7f75 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:27.154510 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f604425-6390-40f8-bcba-e00dba5c7f75 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:27.156068 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f604425-6390-40f8-bcba-e00dba5c7f75 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:27.159977 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 729/1445] 10.222.0.16 () {54 vars in 912 bytes} [Wed Nov 2 07:41:27 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:41:27.162832 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f604425-6390-40f8-bcba-e00dba5c7f75 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:27.169725 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4f604425-6390-40f8-bcba-e00dba5c7f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:27.196824 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cd17a-515d-47f9-90d3-ead0b44c5494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:27.198755 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cd17a-515d-47f9-90d3-ead0b44c5494 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:27.199282 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cd17a-515d-47f9-90d3-ead0b44c5494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:27.199722 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cd17a-515d-47f9-90d3-ead0b44c5494 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:27.200536 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600cd17a-515d-47f9-90d3-ead0b44c5494 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:27.202851 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600cd17a-515d-47f9-90d3-ead0b44c5494 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:27.221657 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f604425-6390-40f8-bcba-e00dba5c7f75 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:27.251803 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d32bf-1639-47a1-8951-a3f5d7c3c563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:27.252489 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d32bf-1639-47a1-8951-a3f5d7c3c563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:27.252767 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d32bf-1639-47a1-8951-a3f5d7c3c563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:27.253035 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d32bf-1639-47a1-8951-a3f5d7c3c563 admin admin] PATH_INFO: `/v3/users/d741aff188f74c468a3894d28241321f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:27.258053 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d32bf-1639-47a1-8951-a3f5d7c3c563 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d741aff188f74c468a3894d28241321f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:27.260580 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d32bf-1639-47a1-8951-a3f5d7c3c563 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:27.367101 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 717/1446] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:27 2022] POST /identity/v3/projects => generated 379 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:27.371472 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8860769-5fb8-4875-af80-5bf400a01205 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:27.375454 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8860769-5fb8-4875-af80-5bf400a01205 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:27.375859 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8860769-5fb8-4875-af80-5bf400a01205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:27.426246 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-e8860769-5fb8-4875-af80-5bf400a01205 None None] MFA Rules not processed for user `c35fe87fc263440980ce70680748e5af`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:27.428629 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e8860769-5fb8-4875-af80-5bf400a01205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:27.445812 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:27.549839 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 718/1447] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Nov 2 07:41:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:27.550932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8860769-5fb8-4875-af80-5bf400a01205 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:27.552590 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e8860769-5fb8-4875-af80-5bf400a01205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:27.606367 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8f2d32bf-1639-47a1-8951-a3f5d7c3c563 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd741aff188f74c468a3894d28241321f'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:27.633642 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8f2d32bf-1639-47a1-8951-a3f5d7c3c563 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd741aff188f74c468a3894d28241321f'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:27.634842 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8f2d32bf-1639-47a1-8951-a3f5d7c3c563 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd741aff188f74c468a3894d28241321f'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:27.652692 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8f2d32bf-1639-47a1-8951-a3f5d7c3c563 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd741aff188f74c468a3894d28241321f'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:27.653782 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8f2d32bf-1639-47a1-8951-a3f5d7c3c563 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd741aff188f74c468a3894d28241321f'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:27.661955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8860769-5fb8-4875-af80-5bf400a01205 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:27.667857 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76907fff-8258-4500-901e-af6dc0b73116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:27.670267 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76907fff-8258-4500-901e-af6dc0b73116 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:27.670267 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76907fff-8258-4500-901e-af6dc0b73116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:27.670267 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76907fff-8258-4500-901e-af6dc0b73116 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:27.670267 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76907fff-8258-4500-901e-af6dc0b73116 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:27.671883 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76907fff-8258-4500-901e-af6dc0b73116 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:27.769687 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 730/1448] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:41:27 2022] DELETE /identity/v3/users/d741aff188f74c468a3894d28241321f => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:27.770928 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d32bf-1639-47a1-8951-a3f5d7c3c563 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:27.773572 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8f2d32bf-1639-47a1-8951-a3f5d7c3c563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:27.795368 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 719/1449] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:27 2022] POST /identity/v3/users => generated 290 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:27.796672 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76907fff-8258-4500-901e-af6dc0b73116 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:27.802463 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-76907fff-8258-4500-901e-af6dc0b73116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:27.840028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76907fff-8258-4500-901e-af6dc0b73116 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:27.946244 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c63b1-3a6a-4041-ae43-b19db167eb14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:27.946891 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c63b1-3a6a-4041-ae43-b19db167eb14 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:27.947172 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c63b1-3a6a-4041-ae43-b19db167eb14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:27.947449 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c63b1-3a6a-4041-ae43-b19db167eb14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:28.074585 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-940c63b1-3a6a-4041-ae43-b19db167eb14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:28.074585 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940c63b1-3a6a-4041-ae43-b19db167eb14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:28.074585 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940c63b1-3a6a-4041-ae43-b19db167eb14 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:28.075359 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d32bf-1639-47a1-8951-a3f5d7c3c563 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:28.075870 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 720/1450] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:28.076754 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827df3d-d155-444b-9e26-816cced56006 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d63a04c2d74c90b95a4f48c49ddb29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:28.077125 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c63b1-3a6a-4041-ae43-b19db167eb14 service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:28.077213 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827df3d-d155-444b-9e26-816cced56006 service swift] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:28.077296 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-940c63b1-3a6a-4041-ae43-b19db167eb14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:28.077374 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827df3d-d155-444b-9e26-816cced56006 service swift] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:28.077374 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827df3d-d155-444b-9e26-816cced56006 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:28.077374 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5827df3d-d155-444b-9e26-816cced56006 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:28.219293 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c63b1-3a6a-4041-ae43-b19db167eb14 service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:28.233607 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e3e8a-ae50-4c33-b164-e836fe1d84a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:28.237199 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e3e8a-ae50-4c33-b164-e836fe1d84a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:28.237925 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e3e8a-ae50-4c33-b164-e836fe1d84a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:28.238426 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e3e8a-ae50-4c33-b164-e836fe1d84a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:28.239341 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e3e8a-ae50-4c33-b164-e836fe1d84a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:28.244168 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e3e8a-ae50-4c33-b164-e836fe1d84a2 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:28.273413 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827df3d-d155-444b-9e26-816cced56006 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:28.274055 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 721/1451] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:28.275442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e3e8a-ae50-4c33-b164-e836fe1d84a2 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:28.283912 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827df3d-d155-444b-9e26-816cced56006 service swift] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:28.302329 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e3e8a-ae50-4c33-b164-e836fe1d84a2 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:28.316695 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 731/1452] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Nov 2 07:41:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:41:28.320729 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba0081-7630-40c4-8c45-92c7419fe7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:28.321165 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba0081-7630-40c4-8c45-92c7419fe7dc admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:28.321542 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba0081-7630-40c4-8c45-92c7419fe7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:28.324527 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba0081-7630-40c4-8c45-92c7419fe7dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:28.324527 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba0081-7630-40c4-8c45-92c7419fe7dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:28.328771 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba0081-7630-40c4-8c45-92c7419fe7dc admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:28.357530 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:28.363604 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827df3d-d155-444b-9e26-816cced56006 service swift] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:28.363885 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 722/1453] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:28.380679 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827df3d-d155-444b-9e26-816cced56006 service swift] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:28.415222 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55b607-79c8-43b8-99da-a171ccf435fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:28.416907 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55b607-79c8-43b8-99da-a171ccf435fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:28.417395 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55b607-79c8-43b8-99da-a171ccf435fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:28.417994 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55b607-79c8-43b8-99da-a171ccf435fa admin admin] PATH_INFO: `/v3/projects/580505cf91054ae19ea944938ee3c750/users/8d1f732e25194de8961b5bb7a9d9a827/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:28.516434 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f55b607-79c8-43b8-99da-a171ccf435fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=580505cf91054ae19ea944938ee3c750, user_id=8d1f732e25194de8961b5bb7a9d9a827, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:28.519471 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f55b607-79c8-43b8-99da-a171ccf435fa admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:28.648602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 732/1454] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:28 2022] PUT /identity/v3/projects/580505cf91054ae19ea944938ee3c750/users/8d1f732e25194de8961b5bb7a9d9a827/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:28.662838 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6846021-b962-4abf-b12b-0167c8bc6fef None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:28.663423 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6846021-b962-4abf-b12b-0167c8bc6fef None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:28.663638 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6846021-b962-4abf-b12b-0167c8bc6fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:28.975981 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-a6846021-b962-4abf-b12b-0167c8bc6fef None None] MFA Rules not processed for user `8d1f732e25194de8961b5bb7a9d9a827`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:28.977613 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a6846021-b962-4abf-b12b-0167c8bc6fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:29.165698 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 723/1455] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 504 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:29.171902 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55b607-79c8-43b8-99da-a171ccf435fa admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:29.320996 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6846021-b962-4abf-b12b-0167c8bc6fef None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:29.322453 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a6846021-b962-4abf-b12b-0167c8bc6fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:29.461607 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55b607-79c8-43b8-99da-a171ccf435fa admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:29.486241 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa3f4f-c0dd-49cb-9106-b83d96df01e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:29.487222 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa3f4f-c0dd-49cb-9106-b83d96df01e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:29.487954 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa3f4f-c0dd-49cb-9106-b83d96df01e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:29.488770 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa3f4f-c0dd-49cb-9106-b83d96df01e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:29.490088 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa3f4f-c0dd-49cb-9106-b83d96df01e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:29.494998 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa3f4f-c0dd-49cb-9106-b83d96df01e5 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:29.614476 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6846021-b962-4abf-b12b-0167c8bc6fef None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:29.642856 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291eff04-8238-4170-9d65-7d3a28bef3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:29.642856 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291eff04-8238-4170-9d65-7d3a28bef3bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:29.642856 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291eff04-8238-4170-9d65-7d3a28bef3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:29.642856 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291eff04-8238-4170-9d65-7d3a28bef3bc admin admin] PATH_INFO: `/v3/projects/c80fc130e9b74249b899991628d7e4ce` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:29.643125 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291eff04-8238-4170-9d65-7d3a28bef3bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c80fc130e9b74249b899991628d7e4ce)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:29.643125 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291eff04-8238-4170-9d65-7d3a28bef3bc admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:29.663830 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:29.710600 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 733/1456] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:29 2022] POST /identity/v3/projects => generated 379 bytes in 538 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:29.710600 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa3f4f-c0dd-49cb-9106-b83d96df01e5 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:29.725524 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b2fa3f4f-c0dd-49cb-9106-b83d96df01e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:29.935106 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-291eff04-8238-4170-9d65-7d3a28bef3bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c80fc130e9b74249b899991628d7e4ce', 'request_id': 'req-291eff04-8238-4170-9d65-7d3a28bef3bc'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:29.966280 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-291eff04-8238-4170-9d65-7d3a28bef3bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c80fc130e9b74249b899991628d7e4ce', 'request_id': 'req-291eff04-8238-4170-9d65-7d3a28bef3bc'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:29.989786 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-291eff04-8238-4170-9d65-7d3a28bef3bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c80fc130e9b74249b899991628d7e4ce', 'request_id': 'req-291eff04-8238-4170-9d65-7d3a28bef3bc'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:29.997026 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa3f4f-c0dd-49cb-9106-b83d96df01e5 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:30.006002 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:30.100648 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-291eff04-8238-4170-9d65-7d3a28bef3bc admin admin] The token cache is being invalidate because project c80fc130e9b74249b899991628d7e4ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:41:30.103548 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-291eff04-8238-4170-9d65-7d3a28bef3bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:30.106781 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-291eff04-8238-4170-9d65-7d3a28bef3bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:30.112077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 724/1457] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:41:29 2022] DELETE /identity/v3/projects/c80fc130e9b74249b899991628d7e4ce => generated 0 bytes in 791 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:41:30.117884 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291eff04-8238-4170-9d65-7d3a28bef3bc admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:30.124239 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-291eff04-8238-4170-9d65-7d3a28bef3bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:30.155961 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46a238-7993-4ac5-98f9-f779dde07ecd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:30.156766 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46a238-7993-4ac5-98f9-f779dde07ecd service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:30.157075 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46a238-7993-4ac5-98f9-f779dde07ecd service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:30.157385 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46a238-7993-4ac5-98f9-f779dde07ecd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:30.166579 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9a46a238-7993-4ac5-98f9-f779dde07ecd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:30.373169 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291eff04-8238-4170-9d65-7d3a28bef3bc admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:30.382550 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a46a238-7993-4ac5-98f9-f779dde07ecd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:30.384032 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a46a238-7993-4ac5-98f9-f779dde07ecd service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:30.393347 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90a8a4-5619-4b70-a046-bb8ebf6b0fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:30.398222 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90a8a4-5619-4b70-a046-bb8ebf6b0fb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:30.398222 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90a8a4-5619-4b70-a046-bb8ebf6b0fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:30.398222 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90a8a4-5619-4b70-a046-bb8ebf6b0fb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:30.398222 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90a8a4-5619-4b70-a046-bb8ebf6b0fb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:30.399473 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90a8a4-5619-4b70-a046-bb8ebf6b0fb1 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:30.433101 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 734/1458] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:29 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 724 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:30.437130 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c028e-e585-4529-96d2-d8f2e16e4b48 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:30.440488 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c028e-e585-4529-96d2-d8f2e16e4b48 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:30.442273 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c028e-e585-4529-96d2-d8f2e16e4b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:30.536463 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-671c028e-e585-4529-96d2-d8f2e16e4b48 None None] MFA Rules not processed for user `193e45cadb3c4586ab94051c42cf5192`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:30.541993 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-671c028e-e585-4529-96d2-d8f2e16e4b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:30.584295 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 725/1459] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:30 2022] POST /identity/v3/users => generated 296 bytes in 472 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:30.585909 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a8a38-20c1-400c-a75a-80ff6dc28578 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:30.586301 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a8a38-20c1-400c-a75a-80ff6dc28578 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:30.586694 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a8a38-20c1-400c-a75a-80ff6dc28578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:30.647154 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-db0a8a38-20c1-400c-a75a-80ff6dc28578 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:30.650482 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-db0a8a38-20c1-400c-a75a-80ff6dc28578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:30.678290 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 726/1460] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:30.687870 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e304d79-4a25-4b88-a2ed-931bda70dd84 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:30.690346 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e304d79-4a25-4b88-a2ed-931bda70dd84 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:30.690737 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e304d79-4a25-4b88-a2ed-931bda70dd84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:30.739369 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-7e304d79-4a25-4b88-a2ed-931bda70dd84 None None] MFA Rules not processed for user `c35fe87fc263440980ce70680748e5af`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:30.769661 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-7e304d79-4a25-4b88-a2ed-931bda70dd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:30.856781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 735/1461] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:30 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:30.858394 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c028e-e585-4529-96d2-d8f2e16e4b48 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:30.878154 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c028e-e585-4529-96d2-d8f2e16e4b48 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:30.887372 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd6d0e-aca8-43f4-8b87-ae3f0432e9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:30.890371 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd6d0e-aca8-43f4-8b87-ae3f0432e9a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:30.890927 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd6d0e-aca8-43f4-8b87-ae3f0432e9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:30.891626 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd6d0e-aca8-43f4-8b87-ae3f0432e9a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:30.893957 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd6d0e-aca8-43f4-8b87-ae3f0432e9a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:30.896532 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd6d0e-aca8-43f4-8b87-ae3f0432e9a4 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:30.911638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 736/1462] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:30.932375 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 727/1463] 10.222.0.45 () {58 vars in 1015 bytes} [Wed Nov 2 07:41:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:30.933491 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e304d79-4a25-4b88-a2ed-931bda70dd84 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:30.935325 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0facc15-b90d-4a9c-bb7d-86017ae6e8e8 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:30.961276 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e304d79-4a25-4b88-a2ed-931bda70dd84 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:30.973066 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0facc15-b90d-4a9c-bb7d-86017ae6e8e8 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:30.974647 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0facc15-b90d-4a9c-bb7d-86017ae6e8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:30.981462 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9414dad-fdb5-4b65-8348-f6e3446e1f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:30.982392 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9414dad-fdb5-4b65-8348-f6e3446e1f1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:30.982822 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9414dad-fdb5-4b65-8348-f6e3446e1f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:30.983191 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9414dad-fdb5-4b65-8348-f6e3446e1f1a admin admin] PATH_INFO: `/v3/projects/8dbb71fd69484a7baac1a02384075b3f/users/b4b9f4b727ac40888ebb0fecde3ef258/roles/9252c356af254127896f3626d925a88a` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:31.027667 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9414dad-fdb5-4b65-8348-f6e3446e1f1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dbb71fd69484a7baac1a02384075b3f, user_id=b4b9f4b727ac40888ebb0fecde3ef258, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:31.029184 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:31.041567 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9414dad-fdb5-4b65-8348-f6e3446e1f1a admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:31.064108 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-e0facc15-b90d-4a9c-bb7d-86017ae6e8e8 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:31.065674 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e0facc15-b90d-4a9c-bb7d-86017ae6e8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:31.099738 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 737/1464] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:31.100862 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0facc15-b90d-4a9c-bb7d-86017ae6e8e8 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:31.108492 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e0facc15-b90d-4a9c-bb7d-86017ae6e8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:31.146919 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0facc15-b90d-4a9c-bb7d-86017ae6e8e8 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:31.155698 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e244c-42f2-4e1b-9cb7-73ba0b31f2e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:31.168616 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e244c-42f2-4e1b-9cb7-73ba0b31f2e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:31.169028 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e244c-42f2-4e1b-9cb7-73ba0b31f2e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:31.169507 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e244c-42f2-4e1b-9cb7-73ba0b31f2e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:31.203164 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e244c-42f2-4e1b-9cb7-73ba0b31f2e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:31.206842 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e244c-42f2-4e1b-9cb7-73ba0b31f2e1 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:31.215001 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 728/1465] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:30 2022] PUT /identity/v3/projects/8dbb71fd69484a7baac1a02384075b3f/users/b4b9f4b727ac40888ebb0fecde3ef258/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:31.216129 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9414dad-fdb5-4b65-8348-f6e3446e1f1a admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:31.226263 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 738/1466] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:31.228194 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44849f-e347-40d4-acc5-5f1bf3eea71d None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:31.229202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44849f-e347-40d4-acc5-5f1bf3eea71d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:31.229762 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44849f-e347-40d4-acc5-5f1bf3eea71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:31.255641 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-dd44849f-e347-40d4-acc5-5f1bf3eea71d None None] MFA Rules not processed for user `6fc9296c011d4712949ec015ea157762`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:31.257559 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-dd44849f-e347-40d4-acc5-5f1bf3eea71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:31.357716 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9414dad-fdb5-4b65-8348-f6e3446e1f1a admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:31.371091 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56eb64-7f45-41a3-92c6-b474a23def05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:31.372013 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56eb64-7f45-41a3-92c6-b474a23def05 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:31.372536 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56eb64-7f45-41a3-92c6-b474a23def05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:31.373182 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56eb64-7f45-41a3-92c6-b474a23def05 admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:31.374033 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56eb64-7f45-41a3-92c6-b474a23def05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:41:31.374545 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56eb64-7f45-41a3-92c6-b474a23def05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:31.377611 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56eb64-7f45-41a3-92c6-b474a23def05 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:31.395845 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 729/1467] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:41:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:41:31.397096 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56eb64-7f45-41a3-92c6-b474a23def05 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:31.414065 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56eb64-7f45-41a3-92c6-b474a23def05 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:31.422589 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc991de-f7d8-4690-85a9-c8232c3692c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:31.423509 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc991de-f7d8-4690-85a9-c8232c3692c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:31.424147 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc991de-f7d8-4690-85a9-c8232c3692c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:31.424880 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc991de-f7d8-4690-85a9-c8232c3692c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:31.425950 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc991de-f7d8-4690-85a9-c8232c3692c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:31.428593 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc991de-f7d8-4690-85a9-c8232c3692c7 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:31.447303 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 730/1468] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:31.447303 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc991de-f7d8-4690-85a9-c8232c3692c7 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:31.448894 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 739/1469] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:31.449960 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44849f-e347-40d4-acc5-5f1bf3eea71d None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:31.460890 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc991de-f7d8-4690-85a9-c8232c3692c7 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:31.467824 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44849f-e347-40d4-acc5-5f1bf3eea71d None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:31.499546 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4d266-af63-4bdd-a762-c04fea4ba210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:31.500796 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4d266-af63-4bdd-a762-c04fea4ba210 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:31.501870 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4d266-af63-4bdd-a762-c04fea4ba210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:31.502784 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4d266-af63-4bdd-a762-c04fea4ba210 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:31.504836 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd4d266-af63-4bdd-a762-c04fea4ba210 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:31.507910 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430e9b8-6ab4-4459-b182-beffed254608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:31.508331 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd4d266-af63-4bdd-a762-c04fea4ba210 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:31.509091 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430e9b8-6ab4-4459-b182-beffed254608 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:31.509276 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430e9b8-6ab4-4459-b182-beffed254608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:31.509550 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430e9b8-6ab4-4459-b182-beffed254608 admin admin] PATH_INFO: `/v3/projects/8dbb71fd69484a7baac1a02384075b3f/users/b4b9f4b727ac40888ebb0fecde3ef258/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:31.518802 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f430e9b8-6ab4-4459-b182-beffed254608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dbb71fd69484a7baac1a02384075b3f, user_id=b4b9f4b727ac40888ebb0fecde3ef258, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:31.521578 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f430e9b8-6ab4-4459-b182-beffed254608 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:31.559242 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 740/1470] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:31 2022] PUT /identity/v3/projects/8dbb71fd69484a7baac1a02384075b3f/users/b4b9f4b727ac40888ebb0fecde3ef258/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:31.560945 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaff6de-0e42-45ec-9122-28e1b4606ba6 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:31.561131 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaff6de-0e42-45ec-9122-28e1b4606ba6 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:31.561612 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaff6de-0e42-45ec-9122-28e1b4606ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:31.629186 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-cbaff6de-0e42-45ec-9122-28e1b4606ba6 None None] MFA Rules not processed for user `b4b9f4b727ac40888ebb0fecde3ef258`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:31.630450 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-cbaff6de-0e42-45ec-9122-28e1b4606ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:31.637896 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 731/1471] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:31 2022] POST /identity/v3/projects => generated 405 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:31.639465 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4d266-af63-4bdd-a762-c04fea4ba210 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:31.864348 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4d266-af63-4bdd-a762-c04fea4ba210 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:31.895469 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a11ef-ff6c-4a43-944b-25060c25c58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:31.896585 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a11ef-ff6c-4a43-944b-25060c25c58b admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:31.897018 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a11ef-ff6c-4a43-944b-25060c25c58b admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:31.897547 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a11ef-ff6c-4a43-944b-25060c25c58b admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:31.898474 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a11ef-ff6c-4a43-944b-25060c25c58b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:31.902291 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a11ef-ff6c-4a43-944b-25060c25c58b admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:31.918643 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 741/1472] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:31 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:41:31.936672 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaff6de-0e42-45ec-9122-28e1b4606ba6 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:31.939340 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-cbaff6de-0e42-45ec-9122-28e1b4606ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:32.098260 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 732/1473] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:31 2022] POST /identity/v3/users => generated 303 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:32.098260 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a11ef-ff6c-4a43-944b-25060c25c58b admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:32.137195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a11ef-ff6c-4a43-944b-25060c25c58b admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:32.142717 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaff6de-0e42-45ec-9122-28e1b4606ba6 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:32.151245 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88ed4a-44ed-4479-a259-ebba3aa4153d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:32.152764 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4232e-dfdf-4898-ac7d-a74fee02103a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:32.153946 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88ed4a-44ed-4479-a259-ebba3aa4153d admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:32.154200 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88ed4a-44ed-4479-a259-ebba3aa4153d admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:32.154545 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4232e-dfdf-4898-ac7d-a74fee02103a service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:32.154774 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88ed4a-44ed-4479-a259-ebba3aa4153d admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:32.155243 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4232e-dfdf-4898-ac7d-a74fee02103a service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:32.155562 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4232e-dfdf-4898-ac7d-a74fee02103a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:32.160102 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b88ed4a-44ed-4479-a259-ebba3aa4153d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:32.160102 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b88ed4a-44ed-4479-a259-ebba3aa4153d admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:32.192041 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 733/1474] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:32 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:32.193209 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4232e-dfdf-4898-ac7d-a74fee02103a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:32.196701 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88ed4a-44ed-4479-a259-ebba3aa4153d admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:32.198115 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4232e-dfdf-4898-ac7d-a74fee02103a service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:32.252446 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 742/1475] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:31 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:41:32.253028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88ed4a-44ed-4479-a259-ebba3aa4153d admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:32.253028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f5fc2-1549-424e-92ac-acce9cce84a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:32.253028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f5fc2-1549-424e-92ac-acce9cce84a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:32.253028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f5fc2-1549-424e-92ac-acce9cce84a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:32.253583 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f5fc2-1549-424e-92ac-acce9cce84a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:32.253583 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f5fc2-1549-424e-92ac-acce9cce84a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:32.253583 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f5fc2-1549-424e-92ac-acce9cce84a7 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:32.262706 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 734/1476] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:32 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:41:32.268607 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4232e-dfdf-4898-ac7d-a74fee02103a service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:32.284025 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4232e-dfdf-4898-ac7d-a74fee02103a service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:32.300623 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2dbaaf-6795-4710-93ca-a023a21839af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:32.301348 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2dbaaf-6795-4710-93ca-a023a21839af admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:32.301629 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2dbaaf-6795-4710-93ca-a023a21839af admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:32.301912 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2dbaaf-6795-4710-93ca-a023a21839af admin admin] PATH_INFO: `/v3/projects/3e4b6dcc4c584fad96dbfa184f21ebf5/users/25e422a3ffa744f79e5a7a6f965629d1/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:32.324368 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2dbaaf-6795-4710-93ca-a023a21839af admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e4b6dcc4c584fad96dbfa184f21ebf5, user_id=25e422a3ffa744f79e5a7a6f965629d1, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:32.327533 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2dbaaf-6795-4710-93ca-a023a21839af admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:32.712490 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 743/1477] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:32 2022] PUT /identity/v3/projects/3e4b6dcc4c584fad96dbfa184f21ebf5/users/25e422a3ffa744f79e5a7a6f965629d1/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:32.725401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec5fe4-d36e-4073-8c92-e006ab138ba9 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:32.725706 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec5fe4-d36e-4073-8c92-e006ab138ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:32.725996 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec5fe4-d36e-4073-8c92-e006ab138ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:32.826950 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-47ec5fe4-d36e-4073-8c92-e006ab138ba9 None None] MFA Rules not processed for user `25e422a3ffa744f79e5a7a6f965629d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:32.828501 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-47ec5fe4-d36e-4073-8c92-e006ab138ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:32.876389 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2dbaaf-6795-4710-93ca-a023a21839af admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:33.115888 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 735/1478] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:32 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:41:33.121815 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec5fe4-d36e-4073-8c92-e006ab138ba9 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:33.145201 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2dbaaf-6795-4710-93ca-a023a21839af admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:33.163794 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945c185-7729-4cda-8178-24acaf31c4b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:33.168707 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945c185-7729-4cda-8178-24acaf31c4b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:33.168994 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945c185-7729-4cda-8178-24acaf31c4b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:33.169314 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945c185-7729-4cda-8178-24acaf31c4b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:33.179572 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c945c185-7729-4cda-8178-24acaf31c4b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:33.322202 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec5fe4-d36e-4073-8c92-e006ab138ba9 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:33.337850 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6ac50-2d7d-4a48-b9f6-ca945eb637dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:33.339163 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6ac50-2d7d-4a48-b9f6-ca945eb637dc admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:33.339643 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6ac50-2d7d-4a48-b9f6-ca945eb637dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:33.340010 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6ac50-2d7d-4a48-b9f6-ca945eb637dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:33.340801 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6ac50-2d7d-4a48-b9f6-ca945eb637dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:33.343343 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6ac50-2d7d-4a48-b9f6-ca945eb637dc admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:33.349374 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:33.441411 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 736/1479] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:33 2022] POST /identity/v3/projects => generated 409 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:33.442822 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6ac50-2d7d-4a48-b9f6-ca945eb637dc admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:33.487773 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:33.503844 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945c185-7729-4cda-8178-24acaf31c4b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:33.505972 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945c185-7729-4cda-8178-24acaf31c4b8 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:33.562686 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 744/1480] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 687 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:41:33.692487 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6ac50-2d7d-4a48-b9f6-ca945eb637dc admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:33.731243 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f839f12-968c-412e-86a7-23c291459995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:33.731884 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f839f12-968c-412e-86a7-23c291459995 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:33.732191 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f839f12-968c-412e-86a7-23c291459995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:33.732470 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f839f12-968c-412e-86a7-23c291459995 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:33.733098 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f839f12-968c-412e-86a7-23c291459995 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:33.750053 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f839f12-968c-412e-86a7-23c291459995 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:33.949154 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 737/1481] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:33 2022] POST /identity/v3/users => generated 311 bytes in 507 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:33.952947 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945c185-7729-4cda-8178-24acaf31c4b8 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:33.986676 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945c185-7729-4cda-8178-24acaf31c4b8 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:34.027440 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76f5b8-88c7-4c62-9b99-7f214d9d0c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:34.030915 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76f5b8-88c7-4c62-9b99-7f214d9d0c6b admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:34.030915 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76f5b8-88c7-4c62-9b99-7f214d9d0c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:34.030915 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76f5b8-88c7-4c62-9b99-7f214d9d0c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:34.034885 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a76f5b8-88c7-4c62-9b99-7f214d9d0c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:34.038936 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a76f5b8-88c7-4c62-9b99-7f214d9d0c6b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:34.105475 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 745/1482] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:33 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:34.109291 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f839f12-968c-412e-86a7-23c291459995 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:34.144294 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f839f12-968c-412e-86a7-23c291459995 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:34.171079 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698ae17-7abe-4057-b074-c94f3c8f72bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:34.171940 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698ae17-7abe-4057-b074-c94f3c8f72bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:34.172764 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698ae17-7abe-4057-b074-c94f3c8f72bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:34.172764 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698ae17-7abe-4057-b074-c94f3c8f72bc admin admin] PATH_INFO: `/v3/projects/2a1ba136cbcc485fa1aca7decc7cf283/users/788da7c70c8e4d7ebeba17377c29d728/roles/9252c356af254127896f3626d925a88a` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:34.224846 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a698ae17-7abe-4057-b074-c94f3c8f72bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a1ba136cbcc485fa1aca7decc7cf283, user_id=788da7c70c8e4d7ebeba17377c29d728, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:34.227908 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a698ae17-7abe-4057-b074-c94f3c8f72bc admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:34.379578 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 738/1483] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:34 2022] PUT /identity/v3/projects/2a1ba136cbcc485fa1aca7decc7cf283/users/788da7c70c8e4d7ebeba17377c29d728/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:34.385429 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76f5b8-88c7-4c62-9b99-7f214d9d0c6b admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:34.406813 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76f5b8-88c7-4c62-9b99-7f214d9d0c6b admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:34.703050 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ceb2d6-8bf9-40e5-bf05-6b63d1e0bd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:34.703050 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ceb2d6-8bf9-40e5-bf05-6b63d1e0bd52 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:34.703050 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ceb2d6-8bf9-40e5-bf05-6b63d1e0bd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:34.706832 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ceb2d6-8bf9-40e5-bf05-6b63d1e0bd52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:34.707552 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ceb2d6-8bf9-40e5-bf05-6b63d1e0bd52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:34.709204 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ceb2d6-8bf9-40e5-bf05-6b63d1e0bd52 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:34.748966 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 746/1484] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:34.750232 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698ae17-7abe-4057-b074-c94f3c8f72bc admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:34.766373 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698ae17-7abe-4057-b074-c94f3c8f72bc admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:34.788801 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e95d3-4fd2-4926-9113-ec6751136f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:34.789390 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e95d3-4fd2-4926-9113-ec6751136f78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:34.789846 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e95d3-4fd2-4926-9113-ec6751136f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:34.790287 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e95d3-4fd2-4926-9113-ec6751136f78 admin admin] PATH_INFO: `/v3/projects/2a1ba136cbcc485fa1aca7decc7cf283/users/788da7c70c8e4d7ebeba17377c29d728/roles/9252c356af254127896f3626d925a88a` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:34.798820 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e95d3-4fd2-4926-9113-ec6751136f78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a1ba136cbcc485fa1aca7decc7cf283, user_id=788da7c70c8e4d7ebeba17377c29d728, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:34.801817 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e95d3-4fd2-4926-9113-ec6751136f78 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:34.878377 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d757d-87f5-46b3-b3b7-f85706da7c06 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:34.878711 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d757d-87f5-46b3-b3b7-f85706da7c06 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:34.878993 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d757d-87f5-46b3-b3b7-f85706da7c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:34.881813 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 739/1485] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:34 2022] PUT /identity/v3/projects/2a1ba136cbcc485fa1aca7decc7cf283/users/788da7c70c8e4d7ebeba17377c29d728/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:34.986829 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-d96d757d-87f5-46b3-b3b7-f85706da7c06 None None] MFA Rules not processed for user `788da7c70c8e4d7ebeba17377c29d728`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:34.994494 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d70fa2-8f1a-43eb-a503-9d9b824b1dc4 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:34.994999 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d70fa2-8f1a-43eb-a503-9d9b824b1dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:35.000417 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d70fa2-8f1a-43eb-a503-9d9b824b1dc4 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:35.000417 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 740/1486] 10.222.0.16 () {54 vars in 921 bytes} [Wed Nov 2 07:41:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:41:35.000672 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d96d757d-87f5-46b3-b3b7-f85706da7c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:35.196794 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 747/1487] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:34 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:41:35.203271 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb45989-6a63-4eb8-b7ce-7cabf46bfd29 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:35.203730 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb45989-6a63-4eb8-b7ce-7cabf46bfd29 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:35.203931 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb45989-6a63-4eb8-b7ce-7cabf46bfd29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:35.216559 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d757d-87f5-46b3-b3b7-f85706da7c06 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:35.225172 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d96d757d-87f5-46b3-b3b7-f85706da7c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:35.253674 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-beb45989-6a63-4eb8-b7ce-7cabf46bfd29 None None] MFA Rules not processed for user `232210eabdfd4969a348d7333c50c438`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:35.255773 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-beb45989-6a63-4eb8-b7ce-7cabf46bfd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:35.377959 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d757d-87f5-46b3-b3b7-f85706da7c06 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:35.383535 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cfd9d0-5942-4cf3-ba2a-686969bedc24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:35.384708 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cfd9d0-5942-4cf3-ba2a-686969bedc24 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:35.385023 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cfd9d0-5942-4cf3-ba2a-686969bedc24 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:35.385309 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cfd9d0-5942-4cf3-ba2a-686969bedc24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:35.390882 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 741/1488] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Nov 2 07:41:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:35.410781 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb45989-6a63-4eb8-b7ce-7cabf46bfd29 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:35.411340 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cfd9d0-5942-4cf3-ba2a-686969bedc24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:35.412721 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-beb45989-6a63-4eb8-b7ce-7cabf46bfd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:35.412851 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cfd9d0-5942-4cf3-ba2a-686969bedc24 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:35.433714 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 748/1489] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:35 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:35.466500 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb45989-6a63-4eb8-b7ce-7cabf46bfd29 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:35.512773 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160e0ae-70d6-4d65-8f0e-3197d525e5ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:35.513484 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160e0ae-70d6-4d65-8f0e-3197d525e5ae service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:35.513792 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160e0ae-70d6-4d65-8f0e-3197d525e5ae service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:35.514024 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160e0ae-70d6-4d65-8f0e-3197d525e5ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:35.542818 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160e0ae-70d6-4d65-8f0e-3197d525e5ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:35.545515 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160e0ae-70d6-4d65-8f0e-3197d525e5ae service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:35.571650 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:35.613123 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 742/1490] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:41:36.063052 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cfd9d0-5942-4cf3-ba2a-686969bedc24 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:36.072931 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:36.076463 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cfd9d0-5942-4cf3-ba2a-686969bedc24 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:36.087085 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a0630-a10e-49e5-8c93-02a207e47624 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:36.088311 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a0630-a10e-49e5-8c93-02a207e47624 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:36.088612 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a0630-a10e-49e5-8c93-02a207e47624 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:36.088889 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a0630-a10e-49e5-8c93-02a207e47624 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:36.211007 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a0630-a10e-49e5-8c93-02a207e47624 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:36.212762 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a0630-a10e-49e5-8c93-02a207e47624 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:36.223423 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 749/1491] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:36 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:37.591290 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160e0ae-70d6-4d65-8f0e-3197d525e5ae service nova] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:37.592900 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-4160e0ae-70d6-4d65-8f0e-3197d525e5ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:37.772313 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160e0ae-70d6-4d65-8f0e-3197d525e5ae service nova] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:37.784390 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20de436-207f-47dd-a5ad-cfb4be08356b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:37.785522 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20de436-207f-47dd-a5ad-cfb4be08356b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:37.786283 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20de436-207f-47dd-a5ad-cfb4be08356b admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:37.787175 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20de436-207f-47dd-a5ad-cfb4be08356b admin admin] PATH_INFO: `/v3/users/70cf580b61b544258a30d9c27e8999ff` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:37.789919 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20de436-207f-47dd-a5ad-cfb4be08356b admin admin] RBAC: Authorizing `identity:delete_user(user_id=70cf580b61b544258a30d9c27e8999ff)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:37.793353 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20de436-207f-47dd-a5ad-cfb4be08356b admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:38.065188 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c20de436-207f-47dd-a5ad-cfb4be08356b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70cf580b61b544258a30d9c27e8999ff'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:38.145156 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c20de436-207f-47dd-a5ad-cfb4be08356b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70cf580b61b544258a30d9c27e8999ff'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:38.154843 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:38.160019 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c20de436-207f-47dd-a5ad-cfb4be08356b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70cf580b61b544258a30d9c27e8999ff'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:38.160019 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c20de436-207f-47dd-a5ad-cfb4be08356b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70cf580b61b544258a30d9c27e8999ff'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:38.160793 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c20de436-207f-47dd-a5ad-cfb4be08356b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70cf580b61b544258a30d9c27e8999ff'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:38.275677 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 743/1492] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:41:37 2022] DELETE /identity/v3/users/70cf580b61b544258a30d9c27e8999ff => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:41:38.280527 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6354d14-025e-4c90-accf-8f4ec03e30e1 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:38.281516 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6354d14-025e-4c90-accf-8f4ec03e30e1 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:38.281973 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6354d14-025e-4c90-accf-8f4ec03e30e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:38.349059 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-b6354d14-025e-4c90-accf-8f4ec03e30e1 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:38.351685 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b6354d14-025e-4c90-accf-8f4ec03e30e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:38.579812 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 750/1493] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:38.590206 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20de436-207f-47dd-a5ad-cfb4be08356b admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:38.594062 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c20de436-207f-47dd-a5ad-cfb4be08356b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:38.786821 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20de436-207f-47dd-a5ad-cfb4be08356b admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:38.799317 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c13a01-55a1-41ac-b365-b7ebd34580cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:38.799317 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c13a01-55a1-41ac-b365-b7ebd34580cb service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:38.799317 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c13a01-55a1-41ac-b365-b7ebd34580cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:38.799317 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c13a01-55a1-41ac-b365-b7ebd34580cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:38.811042 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c13a01-55a1-41ac-b365-b7ebd34580cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:38.812896 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c13a01-55a1-41ac-b365-b7ebd34580cb service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:38.828229 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 744/1494] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:39.287557 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:39.988850 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:40.041328 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6354d14-025e-4c90-accf-8f4ec03e30e1 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:40.044766 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b6354d14-025e-4c90-accf-8f4ec03e30e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:40.140711 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6354d14-025e-4c90-accf-8f4ec03e30e1 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:40.170542 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485240a5-078e-4723-b726-c53ad89d8dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:40.172957 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485240a5-078e-4723-b726-c53ad89d8dfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:40.174031 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485240a5-078e-4723-b726-c53ad89d8dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:40.175012 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485240a5-078e-4723-b726-c53ad89d8dfa admin admin] PATH_INFO: `/v3/projects/72f386d1e565487aa4fc51cf0aa32338` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:40.179534 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485240a5-078e-4723-b726-c53ad89d8dfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=72f386d1e565487aa4fc51cf0aa32338)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:40.185866 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485240a5-078e-4723-b726-c53ad89d8dfa admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:40.545388 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-485240a5-078e-4723-b726-c53ad89d8dfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72f386d1e565487aa4fc51cf0aa32338', 'request_id': 'req-485240a5-078e-4723-b726-c53ad89d8dfa'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:40.573361 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-485240a5-078e-4723-b726-c53ad89d8dfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72f386d1e565487aa4fc51cf0aa32338', 'request_id': 'req-485240a5-078e-4723-b726-c53ad89d8dfa'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:40.611985 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-485240a5-078e-4723-b726-c53ad89d8dfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72f386d1e565487aa4fc51cf0aa32338', 'request_id': 'req-485240a5-078e-4723-b726-c53ad89d8dfa'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:40.695732 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-485240a5-078e-4723-b726-c53ad89d8dfa admin admin] The token cache is being invalidate because project 72f386d1e565487aa4fc51cf0aa32338 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:41:40.696248 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-485240a5-078e-4723-b726-c53ad89d8dfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:40.697499 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-485240a5-078e-4723-b726-c53ad89d8dfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:40.711900 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 751/1495] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:41:40 2022] DELETE /identity/v3/projects/72f386d1e565487aa4fc51cf0aa32338 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:40.716836 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c13a01-55a1-41ac-b365-b7ebd34580cb service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:40.749978 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c13a01-55a1-41ac-b365-b7ebd34580cb service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:40.824768 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485240a5-078e-4723-b726-c53ad89d8dfa admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:40.826462 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-485240a5-078e-4723-b726-c53ad89d8dfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:40.960862 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:41.080791 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485240a5-078e-4723-b726-c53ad89d8dfa admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:41.085283 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5aa39-2959-400d-a676-beb3eec06233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:41.090678 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5aa39-2959-400d-a676-beb3eec06233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:41.091925 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5aa39-2959-400d-a676-beb3eec06233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:41.092284 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5aa39-2959-400d-a676-beb3eec06233 admin admin] PATH_INFO: `/v3/users/5f5afccce6164732b78e91bf8e731149` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:41.097948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5aa39-2959-400d-a676-beb3eec06233 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f5afccce6164732b78e91bf8e731149)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:41.097948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5aa39-2959-400d-a676-beb3eec06233 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:41.098336 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c8a54-8ae3-4eee-a955-fab1000fd47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:41.098336 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c8a54-8ae3-4eee-a955-fab1000fd47f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:41.098336 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c8a54-8ae3-4eee-a955-fab1000fd47f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:41.098336 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c8a54-8ae3-4eee-a955-fab1000fd47f admin admin] PATH_INFO: `/v3/users/5bc29c9a3f2742e2a1a71e7e81cf50d9` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:41.098913 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c8a54-8ae3-4eee-a955-fab1000fd47f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bc29c9a3f2742e2a1a71e7e81cf50d9)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:41.101197 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c8a54-8ae3-4eee-a955-fab1000fd47f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:41.344068 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a2d5aa39-2959-400d-a676-beb3eec06233 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f5afccce6164732b78e91bf8e731149'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:41.424015 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a2d5aa39-2959-400d-a676-beb3eec06233 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f5afccce6164732b78e91bf8e731149'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:41.447578 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a2d5aa39-2959-400d-a676-beb3eec06233 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f5afccce6164732b78e91bf8e731149'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:41.448560 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a2d5aa39-2959-400d-a676-beb3eec06233 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f5afccce6164732b78e91bf8e731149'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:41.449850 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a2d5aa39-2959-400d-a676-beb3eec06233 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f5afccce6164732b78e91bf8e731149'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:41.453076 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e07c8a54-8ae3-4eee-a955-fab1000fd47f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bc29c9a3f2742e2a1a71e7e81cf50d9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:41.477187 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e07c8a54-8ae3-4eee-a955-fab1000fd47f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bc29c9a3f2742e2a1a71e7e81cf50d9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:41.478399 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e07c8a54-8ae3-4eee-a955-fab1000fd47f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bc29c9a3f2742e2a1a71e7e81cf50d9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:41.489038 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e07c8a54-8ae3-4eee-a955-fab1000fd47f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bc29c9a3f2742e2a1a71e7e81cf50d9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:41.495777 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e07c8a54-8ae3-4eee-a955-fab1000fd47f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bc29c9a3f2742e2a1a71e7e81cf50d9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:41.577471 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 745/1496] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:41:40 2022] DELETE /identity/v3/users/5f5afccce6164732b78e91bf8e731149 => generated 0 bytes in 859 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:41.733696 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 752/1497] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:41:40 2022] DELETE /identity/v3/users/5bc29c9a3f2742e2a1a71e7e81cf50d9 => generated 0 bytes in 909 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:41.761997 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39bd0a3-2431-4156-8381-5a91670dab40 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:41.767916 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39bd0a3-2431-4156-8381-5a91670dab40 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:41.767916 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39bd0a3-2431-4156-8381-5a91670dab40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:41.801111 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-e39bd0a3-2431-4156-8381-5a91670dab40 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:41.802784 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e39bd0a3-2431-4156-8381-5a91670dab40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:41.947116 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 746/1498] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:41.958128 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c8a54-8ae3-4eee-a955-fab1000fd47f admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:41.960006 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e07c8a54-8ae3-4eee-a955-fab1000fd47f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:41.969771 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:42.061568 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c8a54-8ae3-4eee-a955-fab1000fd47f admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:42.065979 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d1e03-2239-487d-a37f-2b0f11ef0b52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:42.067214 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d1e03-2239-487d-a37f-2b0f11ef0b52 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:42.067214 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d1e03-2239-487d-a37f-2b0f11ef0b52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:42.069635 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d1e03-2239-487d-a37f-2b0f11ef0b52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:42.093760 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d1e03-2239-487d-a37f-2b0f11ef0b52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:42.096342 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d1e03-2239-487d-a37f-2b0f11ef0b52 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:42.108962 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 753/1499] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:42.337433 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:42.655176 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39bd0a3-2431-4156-8381-5a91670dab40 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:42.657247 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e39bd0a3-2431-4156-8381-5a91670dab40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:42.673386 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39bd0a3-2431-4156-8381-5a91670dab40 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:42.684442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eaf7ee-dcb4-4215-8a01-01291218bc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:42.684442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eaf7ee-dcb4-4215-8a01-01291218bc87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:42.684442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eaf7ee-dcb4-4215-8a01-01291218bc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:42.684442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eaf7ee-dcb4-4215-8a01-01291218bc87 admin admin] PATH_INFO: `/v3/projects/7ac325c466a84c14b2c00e2de6d1514c` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:42.684971 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eaf7ee-dcb4-4215-8a01-01291218bc87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ac325c466a84c14b2c00e2de6d1514c)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:42.695726 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eaf7ee-dcb4-4215-8a01-01291218bc87 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:42.878273 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d5eaf7ee-dcb4-4215-8a01-01291218bc87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ac325c466a84c14b2c00e2de6d1514c', 'request_id': 'req-d5eaf7ee-dcb4-4215-8a01-01291218bc87'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:42.885233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2efa23-c120-4d98-9dce-cc52cc193bd2 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:42.886397 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2efa23-c120-4d98-9dce-cc52cc193bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:42.886941 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2efa23-c120-4d98-9dce-cc52cc193bd2 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:42.889002 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 754/1500] 10.222.0.16 () {54 vars in 921 bytes} [Wed Nov 2 07:41:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:41:42.905071 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d5eaf7ee-dcb4-4215-8a01-01291218bc87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ac325c466a84c14b2c00e2de6d1514c', 'request_id': 'req-d5eaf7ee-dcb4-4215-8a01-01291218bc87'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:42.917387 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d5eaf7ee-dcb4-4215-8a01-01291218bc87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ac325c466a84c14b2c00e2de6d1514c', 'request_id': 'req-d5eaf7ee-dcb4-4215-8a01-01291218bc87'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:42.970411 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5250c2-7bfd-42ae-b358-e36e4517b86e None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:42.971065 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5250c2-7bfd-42ae-b358-e36e4517b86e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:42.971932 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5250c2-7bfd-42ae-b358-e36e4517b86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:43.008269 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-bf5250c2-7bfd-42ae-b358-e36e4517b86e None None] MFA Rules not processed for user `232210eabdfd4969a348d7333c50c438`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:43.009857 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-bf5250c2-7bfd-42ae-b358-e36e4517b86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:43.088507 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d5eaf7ee-dcb4-4215-8a01-01291218bc87 admin admin] The token cache is being invalidate because project 7ac325c466a84c14b2c00e2de6d1514c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:41:43.088749 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d5eaf7ee-dcb4-4215-8a01-01291218bc87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:43.095628 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d5eaf7ee-dcb4-4215-8a01-01291218bc87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:43.097440 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 747/1501] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:41:42 2022] DELETE /identity/v3/projects/7ac325c466a84c14b2c00e2de6d1514c => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:43.102519 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f95b9d-1478-4b45-adcb-5a6b0582f8f4 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:43.102797 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f95b9d-1478-4b45-adcb-5a6b0582f8f4 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:43.103044 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 755/1502] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Nov 2 07:41:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:43.103161 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f95b9d-1478-4b45-adcb-5a6b0582f8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:43.118529 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5250c2-7bfd-42ae-b358-e36e4517b86e None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:43.120147 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-bf5250c2-7bfd-42ae-b358-e36e4517b86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:43.133240 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-c1f95b9d-1478-4b45-adcb-5a6b0582f8f4 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:43.134770 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c1f95b9d-1478-4b45-adcb-5a6b0582f8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:43.136324 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5250c2-7bfd-42ae-b358-e36e4517b86e None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:43.144865 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddcfa83-c256-4a2b-bc58-1bec344422ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:43.145478 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcfa83-c256-4a2b-bc58-1bec344422ac service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:43.145903 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcfa83-c256-4a2b-bc58-1bec344422ac service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:43.146352 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcfa83-c256-4a2b-bc58-1bec344422ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:43.161731 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddcfa83-c256-4a2b-bc58-1bec344422ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:43.163347 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddcfa83-c256-4a2b-bc58-1bec344422ac service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:43.171931 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:43.177016 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 756/1503] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:43.225342 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 748/1504] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:43.234258 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24f067-b9ed-419b-b138-c6f0a7bd99e0 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:43.234723 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24f067-b9ed-419b-b138-c6f0a7bd99e0 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:43.235125 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24f067-b9ed-419b-b138-c6f0a7bd99e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:43.262014 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-8e24f067-b9ed-419b-b138-c6f0a7bd99e0 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:43.263233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8e24f067-b9ed-419b-b138-c6f0a7bd99e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:43.272231 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 757/1505] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:43.276308 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f95b9d-1478-4b45-adcb-5a6b0582f8f4 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:43.287010 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f95b9d-1478-4b45-adcb-5a6b0582f8f4 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:43.291928 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f398b16-c352-4c40-84c4-fa6c4fe365be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:43.292640 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f398b16-c352-4c40-84c4-fa6c4fe365be admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:43.292990 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f398b16-c352-4c40-84c4-fa6c4fe365be admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:43.293332 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f398b16-c352-4c40-84c4-fa6c4fe365be admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:43.294044 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f398b16-c352-4c40-84c4-fa6c4fe365be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:41:43.294417 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f398b16-c352-4c40-84c4-fa6c4fe365be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:43.296182 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f398b16-c352-4c40-84c4-fa6c4fe365be admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:43.312732 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 749/1506] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:41:43.319712 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24f067-b9ed-419b-b138-c6f0a7bd99e0 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:43.334537 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24f067-b9ed-419b-b138-c6f0a7bd99e0 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:43.339431 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf06de-6dcc-47a8-80a1-7559b5bcfe94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:43.340290 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf06de-6dcc-47a8-80a1-7559b5bcfe94 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:43.340565 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf06de-6dcc-47a8-80a1-7559b5bcfe94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:43.341025 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf06de-6dcc-47a8-80a1-7559b5bcfe94 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:43.341875 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf06de-6dcc-47a8-80a1-7559b5bcfe94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:43.344028 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf06de-6dcc-47a8-80a1-7559b5bcfe94 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:43.351067 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f398b16-c352-4c40-84c4-fa6c4fe365be admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:43.353495 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-4f398b16-c352-4c40-84c4-fa6c4fe365be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:43.372037 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f398b16-c352-4c40-84c4-fa6c4fe365be admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:43.388909 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c42ae-22fa-4897-a4a0-1b073acd4e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:43.396634 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c42ae-22fa-4897-a4a0-1b073acd4e4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:43.396634 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c42ae-22fa-4897-a4a0-1b073acd4e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:43.396634 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c42ae-22fa-4897-a4a0-1b073acd4e4e admin admin] PATH_INFO: `/v3/projects/10eb3ac9fd3e4bb5b06a288bf0b1ce8e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:43.396634 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c42ae-22fa-4897-a4a0-1b073acd4e4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=10eb3ac9fd3e4bb5b06a288bf0b1ce8e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:43.396634 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c42ae-22fa-4897-a4a0-1b073acd4e4e admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:43.440851 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:43.471358 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 758/1507] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:43 2022] POST /identity/v3/projects => generated 373 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:43.476298 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf06de-6dcc-47a8-80a1-7559b5bcfe94 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:43.547874 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2a3c42ae-22fa-4897-a4a0-1b073acd4e4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10eb3ac9fd3e4bb5b06a288bf0b1ce8e', 'request_id': 'req-2a3c42ae-22fa-4897-a4a0-1b073acd4e4e'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:43.557044 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2a3c42ae-22fa-4897-a4a0-1b073acd4e4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10eb3ac9fd3e4bb5b06a288bf0b1ce8e', 'request_id': 'req-2a3c42ae-22fa-4897-a4a0-1b073acd4e4e'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:43.569647 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2a3c42ae-22fa-4897-a4a0-1b073acd4e4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10eb3ac9fd3e4bb5b06a288bf0b1ce8e', 'request_id': 'req-2a3c42ae-22fa-4897-a4a0-1b073acd4e4e'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:43.577033 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf06de-6dcc-47a8-80a1-7559b5bcfe94 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:43.634333 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2a3c42ae-22fa-4897-a4a0-1b073acd4e4e admin admin] The token cache is being invalidate because project 10eb3ac9fd3e4bb5b06a288bf0b1ce8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:41:43.634333 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2a3c42ae-22fa-4897-a4a0-1b073acd4e4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:43.634333 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2a3c42ae-22fa-4897-a4a0-1b073acd4e4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:43.634333 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 750/1508] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:41:43 2022] DELETE /identity/v3/projects/10eb3ac9fd3e4bb5b06a288bf0b1ce8e => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:43.637571 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c42ae-22fa-4897-a4a0-1b073acd4e4e admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:43.639042 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-2a3c42ae-22fa-4897-a4a0-1b073acd4e4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:43.659787 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c9c48-98d5-4481-a908-76abd896f992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:43.659787 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c9c48-98d5-4481-a908-76abd896f992 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:43.659787 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c9c48-98d5-4481-a908-76abd896f992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:43.659787 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c9c48-98d5-4481-a908-76abd896f992 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:43.660176 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c9c48-98d5-4481-a908-76abd896f992 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:43.660773 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c9c48-98d5-4481-a908-76abd896f992 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:43.728954 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c42ae-22fa-4897-a4a0-1b073acd4e4e admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:43.734156 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78702f0e-926d-4f5f-9dd4-98ab505e3999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:43.734802 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78702f0e-926d-4f5f-9dd4-98ab505e3999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:43.735077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78702f0e-926d-4f5f-9dd4-98ab505e3999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:43.736068 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78702f0e-926d-4f5f-9dd4-98ab505e3999 admin admin] PATH_INFO: `/v3/users/8d1f732e25194de8961b5bb7a9d9a827` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:43.737199 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78702f0e-926d-4f5f-9dd4-98ab505e3999 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d1f732e25194de8961b5bb7a9d9a827)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:43.739186 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78702f0e-926d-4f5f-9dd4-98ab505e3999 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:43.747573 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 759/1509] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:43 2022] POST /identity/v3/users => generated 287 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:43.750528 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c9c48-98d5-4481-a908-76abd896f992 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:43.753611 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-634c9c48-98d5-4481-a908-76abd896f992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:43.766324 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c9c48-98d5-4481-a908-76abd896f992 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:43.777044 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7548407-37fb-4df8-8d1f-f7937fb25801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:43.777689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7548407-37fb-4df8-8d1f-f7937fb25801 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:43.777966 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7548407-37fb-4df8-8d1f-f7937fb25801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:43.778232 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7548407-37fb-4df8-8d1f-f7937fb25801 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:43.779316 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7548407-37fb-4df8-8d1f-f7937fb25801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:43.781040 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7548407-37fb-4df8-8d1f-f7937fb25801 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:43.795593 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 760/1510] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:43 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:43.796572 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7548407-37fb-4df8-8d1f-f7937fb25801 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:43.808146 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7548407-37fb-4df8-8d1f-f7937fb25801 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:43.815128 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc35e19-86ea-4edc-bc82-6344ab58deb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:43.815759 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc35e19-86ea-4edc-bc82-6344ab58deb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:43.816067 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc35e19-86ea-4edc-bc82-6344ab58deb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:43.816379 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc35e19-86ea-4edc-bc82-6344ab58deb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:43.817047 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc35e19-86ea-4edc-bc82-6344ab58deb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:43.818705 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc35e19-86ea-4edc-bc82-6344ab58deb8 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:43.834148 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 761/1511] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:43.838398 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc35e19-86ea-4edc-bc82-6344ab58deb8 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:43.855442 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc35e19-86ea-4edc-bc82-6344ab58deb8 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:43.864244 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9033e8-e627-46df-829f-0732ce214b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:43.868545 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9033e8-e627-46df-829f-0732ce214b34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:43.868545 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9033e8-e627-46df-829f-0732ce214b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:43.868545 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9033e8-e627-46df-829f-0732ce214b34 admin admin] PATH_INFO: `/v3/projects/50a62fd921af43acb22183c91493524b/users/b19d42266bc5423db6daf4f08f928b77/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:43.882227 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9033e8-e627-46df-829f-0732ce214b34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50a62fd921af43acb22183c91493524b, user_id=b19d42266bc5423db6daf4f08f928b77, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:43.884948 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9033e8-e627-46df-829f-0732ce214b34 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:43.979688 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-78702f0e-926d-4f5f-9dd4-98ab505e3999 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d1f732e25194de8961b5bb7a9d9a827'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:43.995040 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-78702f0e-926d-4f5f-9dd4-98ab505e3999 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d1f732e25194de8961b5bb7a9d9a827'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:43.995216 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 762/1512] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:43 2022] PUT /identity/v3/projects/50a62fd921af43acb22183c91493524b/users/b19d42266bc5423db6daf4f08f928b77/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:43.999785 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319838b-ad83-4d32-8e96-59f61c7c6931 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:44.000133 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319838b-ad83-4d32-8e96-59f61c7c6931 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:44.000408 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319838b-ad83-4d32-8e96-59f61c7c6931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:44.007232 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-78702f0e-926d-4f5f-9dd4-98ab505e3999 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d1f732e25194de8961b5bb7a9d9a827'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:44.008240 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-78702f0e-926d-4f5f-9dd4-98ab505e3999 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d1f732e25194de8961b5bb7a9d9a827'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:44.009044 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-78702f0e-926d-4f5f-9dd4-98ab505e3999 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d1f732e25194de8961b5bb7a9d9a827'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:44.027615 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-4319838b-ad83-4d32-8e96-59f61c7c6931 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:44.029177 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4319838b-ad83-4d32-8e96-59f61c7c6931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:44.102970 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 763/1513] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:41:44.123618 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 751/1514] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:41:43 2022] DELETE /identity/v3/users/8d1f732e25194de8961b5bb7a9d9a827 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:41:44.130811 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319838b-ad83-4d32-8e96-59f61c7c6931 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:44.134730 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4319838b-ad83-4d32-8e96-59f61c7c6931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:44.215364 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319838b-ad83-4d32-8e96-59f61c7c6931 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:44.229760 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:44.328598 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20141b-63be-4f88-aba5-172be3c69cc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:44.330343 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20141b-63be-4f88-aba5-172be3c69cc3 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:44.330823 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20141b-63be-4f88-aba5-172be3c69cc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:44.331305 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20141b-63be-4f88-aba5-172be3c69cc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:44.425397 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20141b-63be-4f88-aba5-172be3c69cc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:44.427862 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20141b-63be-4f88-aba5-172be3c69cc3 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:44.441434 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 764/1515] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:44.623043 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:44.902120 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:45.103345 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:45.682669 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78702f0e-926d-4f5f-9dd4-98ab505e3999 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:45.684219 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-78702f0e-926d-4f5f-9dd4-98ab505e3999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:45.699476 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78702f0e-926d-4f5f-9dd4-98ab505e3999 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:45.705066 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b721c1-d06a-4d72-9533-9894196ca9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:45.705619 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b721c1-d06a-4d72-9533-9894196ca9c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:45.705904 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b721c1-d06a-4d72-9533-9894196ca9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:45.706174 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b721c1-d06a-4d72-9533-9894196ca9c6 admin admin] PATH_INFO: `/v3/projects/580505cf91054ae19ea944938ee3c750` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:45.707312 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b721c1-d06a-4d72-9533-9894196ca9c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=580505cf91054ae19ea944938ee3c750)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:45.709367 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b721c1-d06a-4d72-9533-9894196ca9c6 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:45.853142 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c5b721c1-d06a-4d72-9533-9894196ca9c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '580505cf91054ae19ea944938ee3c750', 'request_id': 'req-c5b721c1-d06a-4d72-9533-9894196ca9c6'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:45.859571 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c5b721c1-d06a-4d72-9533-9894196ca9c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '580505cf91054ae19ea944938ee3c750', 'request_id': 'req-c5b721c1-d06a-4d72-9533-9894196ca9c6'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:45.865973 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c5b721c1-d06a-4d72-9533-9894196ca9c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '580505cf91054ae19ea944938ee3c750', 'request_id': 'req-c5b721c1-d06a-4d72-9533-9894196ca9c6'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:45.909139 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:45.953267 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c5b721c1-d06a-4d72-9533-9894196ca9c6 admin admin] The token cache is being invalidate because project 580505cf91054ae19ea944938ee3c750 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:41:45.953267 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c5b721c1-d06a-4d72-9533-9894196ca9c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:45.953857 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c5b721c1-d06a-4d72-9533-9894196ca9c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:45.955539 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 752/1516] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:41:45 2022] DELETE /identity/v3/projects/580505cf91054ae19ea944938ee3c750 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:45.960043 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20141b-63be-4f88-aba5-172be3c69cc3 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:45.975860 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20141b-63be-4f88-aba5-172be3c69cc3 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:46.060188 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a2b87-4b8e-48a6-978b-6fa5a0f4eb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:46.061193 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a2b87-4b8e-48a6-978b-6fa5a0f4eb7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:46.061640 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a2b87-4b8e-48a6-978b-6fa5a0f4eb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:46.062064 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a2b87-4b8e-48a6-978b-6fa5a0f4eb7b admin admin] PATH_INFO: `/v3/users/b4b9f4b727ac40888ebb0fecde3ef258` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:46.063431 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a2b87-4b8e-48a6-978b-6fa5a0f4eb7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4b9f4b727ac40888ebb0fecde3ef258)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:46.067497 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a2b87-4b8e-48a6-978b-6fa5a0f4eb7b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:46.301189 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-729a2b87-4b8e-48a6-978b-6fa5a0f4eb7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4b9f4b727ac40888ebb0fecde3ef258'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:46.335877 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-729a2b87-4b8e-48a6-978b-6fa5a0f4eb7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4b9f4b727ac40888ebb0fecde3ef258'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:46.337008 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-729a2b87-4b8e-48a6-978b-6fa5a0f4eb7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4b9f4b727ac40888ebb0fecde3ef258'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:46.346288 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-729a2b87-4b8e-48a6-978b-6fa5a0f4eb7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4b9f4b727ac40888ebb0fecde3ef258'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:46.347287 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-729a2b87-4b8e-48a6-978b-6fa5a0f4eb7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4b9f4b727ac40888ebb0fecde3ef258'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:46.530786 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 765/1517] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:41:45 2022] DELETE /identity/v3/users/b4b9f4b727ac40888ebb0fecde3ef258 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:46.854394 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:46.874986 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b721c1-d06a-4d72-9533-9894196ca9c6 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:46.876832 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c5b721c1-d06a-4d72-9533-9894196ca9c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:46.906799 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b721c1-d06a-4d72-9533-9894196ca9c6 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:47.009589 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d5818-6713-40ac-aeed-7faa9d6970c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:47.013582 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d5818-6713-40ac-aeed-7faa9d6970c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:47.013582 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d5818-6713-40ac-aeed-7faa9d6970c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:47.013582 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d5818-6713-40ac-aeed-7faa9d6970c4 admin admin] PATH_INFO: `/v3/users/25e422a3ffa744f79e5a7a6f965629d1` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:47.013582 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d5818-6713-40ac-aeed-7faa9d6970c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25e422a3ffa744f79e5a7a6f965629d1)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:47.014665 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d5818-6713-40ac-aeed-7faa9d6970c4 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:47.063353 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:47.119907 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49479f-bc4c-4550-b161-9bcaa9f445c1 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:47.120319 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49479f-bc4c-4550-b161-9bcaa9f445c1 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:47.120864 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49479f-bc4c-4550-b161-9bcaa9f445c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:47.194029 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-8f49479f-bc4c-4550-b161-9bcaa9f445c1 None None] MFA Rules not processed for user `b19d42266bc5423db6daf4f08f928b77`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:47.195424 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8f49479f-bc4c-4550-b161-9bcaa9f445c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:47.305151 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-339d5818-6713-40ac-aeed-7faa9d6970c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25e422a3ffa744f79e5a7a6f965629d1'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:47.323084 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-339d5818-6713-40ac-aeed-7faa9d6970c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25e422a3ffa744f79e5a7a6f965629d1'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:47.343186 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-339d5818-6713-40ac-aeed-7faa9d6970c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25e422a3ffa744f79e5a7a6f965629d1'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:47.345719 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 766/1518] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:41:47.346414 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49479f-bc4c-4550-b161-9bcaa9f445c1 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:47.346950 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-339d5818-6713-40ac-aeed-7faa9d6970c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25e422a3ffa744f79e5a7a6f965629d1'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:47.347998 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-339d5818-6713-40ac-aeed-7faa9d6970c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25e422a3ffa744f79e5a7a6f965629d1'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:47.349801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8f49479f-bc4c-4550-b161-9bcaa9f445c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:47.371588 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49479f-bc4c-4550-b161-9bcaa9f445c1 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:47.376986 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a640682-538d-4314-a930-1da566ae6330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:47.377856 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a640682-538d-4314-a930-1da566ae6330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:47.378274 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a640682-538d-4314-a930-1da566ae6330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:47.378670 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a640682-538d-4314-a930-1da566ae6330 admin admin] PATH_INFO: `/v3/projects/8dbb71fd69484a7baac1a02384075b3f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:47.380189 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a640682-538d-4314-a930-1da566ae6330 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dbb71fd69484a7baac1a02384075b3f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:47.382475 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a640682-538d-4314-a930-1da566ae6330 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:47.441201 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 753/1519] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:41:46 2022] DELETE /identity/v3/users/25e422a3ffa744f79e5a7a6f965629d1 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:47.442161 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d5818-6713-40ac-aeed-7faa9d6970c4 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:47.457899 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-339d5818-6713-40ac-aeed-7faa9d6970c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:47.516607 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d5818-6713-40ac-aeed-7faa9d6970c4 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:47.525163 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7f2cb-2952-4ebe-949b-356d39c5c8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:47.527918 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7f2cb-2952-4ebe-949b-356d39c5c8fb admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:47.527918 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7f2cb-2952-4ebe-949b-356d39c5c8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:47.527918 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7f2cb-2952-4ebe-949b-356d39c5c8fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:47.527918 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c7f2cb-2952-4ebe-949b-356d39c5c8fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:47.529899 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c7f2cb-2952-4ebe-949b-356d39c5c8fb admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:47.567400 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-6a640682-538d-4314-a930-1da566ae6330 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dbb71fd69484a7baac1a02384075b3f', 'request_id': 'req-6a640682-538d-4314-a930-1da566ae6330'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:47.576304 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-6a640682-538d-4314-a930-1da566ae6330 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dbb71fd69484a7baac1a02384075b3f', 'request_id': 'req-6a640682-538d-4314-a930-1da566ae6330'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:47.584349 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-6a640682-538d-4314-a930-1da566ae6330 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dbb71fd69484a7baac1a02384075b3f', 'request_id': 'req-6a640682-538d-4314-a930-1da566ae6330'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:47.652275 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 754/1520] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:47 2022] POST /identity/v3/projects => generated 373 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:47.655714 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771cba15-c9d0-4f28-9cdf-7d2ab84be155 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:47.659662 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771cba15-c9d0-4f28-9cdf-7d2ab84be155 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:47.659972 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771cba15-c9d0-4f28-9cdf-7d2ab84be155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:47.674076 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-6a640682-538d-4314-a930-1da566ae6330 admin admin] The token cache is being invalidate because project 8dbb71fd69484a7baac1a02384075b3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:41:47.674468 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-6a640682-538d-4314-a930-1da566ae6330 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:47.677012 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-6a640682-538d-4314-a930-1da566ae6330 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:47.678780 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 767/1521] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:41:47 2022] DELETE /identity/v3/projects/8dbb71fd69484a7baac1a02384075b3f => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:47.681489 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a640682-538d-4314-a930-1da566ae6330 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:47.686736 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6a640682-538d-4314-a930-1da566ae6330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:47.733839 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-771cba15-c9d0-4f28-9cdf-7d2ab84be155 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:47.737544 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-771cba15-c9d0-4f28-9cdf-7d2ab84be155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:47.848536 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a640682-538d-4314-a930-1da566ae6330 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:47.866720 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 755/1522] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:47.867879 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771cba15-c9d0-4f28-9cdf-7d2ab84be155 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:47.869478 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-771cba15-c9d0-4f28-9cdf-7d2ab84be155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:47.884682 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771cba15-c9d0-4f28-9cdf-7d2ab84be155 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:47.891143 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a233b7e6-4bec-46cf-b607-eb79e456f371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:47.893202 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233b7e6-4bec-46cf-b607-eb79e456f371 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:47.893685 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233b7e6-4bec-46cf-b607-eb79e456f371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:47.894094 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233b7e6-4bec-46cf-b607-eb79e456f371 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:47.894911 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a233b7e6-4bec-46cf-b607-eb79e456f371 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:47.897411 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a233b7e6-4bec-46cf-b607-eb79e456f371 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:47.942940 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0b20f-c9dd-460b-a1f4-c79d600d8c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:47.943988 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0b20f-c9dd-460b-a1f4-c79d600d8c03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:47.945762 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0b20f-c9dd-460b-a1f4-c79d600d8c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:47.946436 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0b20f-c9dd-460b-a1f4-c79d600d8c03 admin admin] PATH_INFO: `/v3/users/a5c89e0efadf4ffdb5e126c95a8273c1` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:47.948548 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0b20f-c9dd-460b-a1f4-c79d600d8c03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5c89e0efadf4ffdb5e126c95a8273c1)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:47.950862 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0b20f-c9dd-460b-a1f4-c79d600d8c03 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:48.029820 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 756/1523] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:47 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:48.034941 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3cc22a-36c2-4b53-8c76-cd16c16c8d41 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:48.035256 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3cc22a-36c2-4b53-8c76-cd16c16c8d41 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:48.035625 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3cc22a-36c2-4b53-8c76-cd16c16c8d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:48.061889 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-4b3cc22a-36c2-4b53-8c76-cd16c16c8d41 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:48.063308 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-4b3cc22a-36c2-4b53-8c76-cd16c16c8d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:48.072857 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 757/1524] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:48.073870 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3cc22a-36c2-4b53-8c76-cd16c16c8d41 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:48.075270 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-4b3cc22a-36c2-4b53-8c76-cd16c16c8d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:48.149062 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3cc22a-36c2-4b53-8c76-cd16c16c8d41 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:48.152516 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3ba0b20f-c9dd-460b-a1f4-c79d600d8c03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5c89e0efadf4ffdb5e126c95a8273c1'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:48.156287 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aba81f-3fd3-4b9a-87f0-f6ed325f008f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:48.158311 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aba81f-3fd3-4b9a-87f0-f6ed325f008f service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:48.158817 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aba81f-3fd3-4b9a-87f0-f6ed325f008f service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:48.159301 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aba81f-3fd3-4b9a-87f0-f6ed325f008f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:48.167097 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3ba0b20f-c9dd-460b-a1f4-c79d600d8c03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5c89e0efadf4ffdb5e126c95a8273c1'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:48.167964 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3ba0b20f-c9dd-460b-a1f4-c79d600d8c03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5c89e0efadf4ffdb5e126c95a8273c1'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:48.177040 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aba81f-3fd3-4b9a-87f0-f6ed325f008f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:48.178826 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aba81f-3fd3-4b9a-87f0-f6ed325f008f service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:48.179897 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3ba0b20f-c9dd-460b-a1f4-c79d600d8c03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5c89e0efadf4ffdb5e126c95a8273c1'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:48.180852 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3ba0b20f-c9dd-460b-a1f4-c79d600d8c03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5c89e0efadf4ffdb5e126c95a8273c1'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:48.194549 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 758/1525] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:48.194549 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aba81f-3fd3-4b9a-87f0-f6ed325f008f service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:48.208484 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aba81f-3fd3-4b9a-87f0-f6ed325f008f service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:48.216986 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ed459-1ae4-4a5e-97e1-2efff5f7a4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:48.216986 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ed459-1ae4-4a5e-97e1-2efff5f7a4fe admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:48.216986 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ed459-1ae4-4a5e-97e1-2efff5f7a4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:48.216986 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ed459-1ae4-4a5e-97e1-2efff5f7a4fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:48.217535 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ed459-1ae4-4a5e-97e1-2efff5f7a4fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:48.219555 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ed459-1ae4-4a5e-97e1-2efff5f7a4fe admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:48.237043 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 759/1526] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:48.239166 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696acd7-adbe-40fe-809b-ccdf5a8bbc82 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:48.239574 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696acd7-adbe-40fe-809b-ccdf5a8bbc82 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:48.239853 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696acd7-adbe-40fe-809b-ccdf5a8bbc82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:48.261206 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-2696acd7-adbe-40fe-809b-ccdf5a8bbc82 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:48.262960 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-2696acd7-adbe-40fe-809b-ccdf5a8bbc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:48.283465 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 768/1527] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:41:47 2022] DELETE /identity/v3/users/a5c89e0efadf4ffdb5e126c95a8273c1 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:48.284306 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0b20f-c9dd-460b-a1f4-c79d600d8c03 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:48.287619 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3ba0b20f-c9dd-460b-a1f4-c79d600d8c03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:48.300607 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 760/1528] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:48.301951 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e46588-898e-4de3-8db4-400852635044 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:48.302236 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e46588-898e-4de3-8db4-400852635044 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:48.302507 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e46588-898e-4de3-8db4-400852635044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:48.342392 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-f4e46588-898e-4de3-8db4-400852635044 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:48.343733 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f4e46588-898e-4de3-8db4-400852635044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:48.430293 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0b20f-c9dd-460b-a1f4-c79d600d8c03 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:48.442484 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b90c8-0a15-4605-ba85-eb5c8a2ffe91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:48.443165 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b90c8-0a15-4605-ba85-eb5c8a2ffe91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:48.443437 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b90c8-0a15-4605-ba85-eb5c8a2ffe91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:48.443769 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b90c8-0a15-4605-ba85-eb5c8a2ffe91 admin admin] PATH_INFO: `/v3/projects/0e8baf3f193a456493b264c37f080785/users/f6e460143930423c850e73f97c315262/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:48.449111 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 761/1529] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:48.449989 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e46588-898e-4de3-8db4-400852635044 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:48.460462 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e46588-898e-4de3-8db4-400852635044 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:48.465369 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8df8a-567b-4cef-b2e3-18735c7993ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:48.466068 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8df8a-567b-4cef-b2e3-18735c7993ef admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:48.466346 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8df8a-567b-4cef-b2e3-18735c7993ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:48.466610 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8df8a-567b-4cef-b2e3-18735c7993ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:48.467293 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e8df8a-567b-4cef-b2e3-18735c7993ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:41:48.467593 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e8df8a-567b-4cef-b2e3-18735c7993ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:48.469532 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e8df8a-567b-4cef-b2e3-18735c7993ef admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:48.474218 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b90c8-0a15-4605-ba85-eb5c8a2ffe91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e8baf3f193a456493b264c37f080785, user_id=f6e460143930423c850e73f97c315262, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:48.483242 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 762/1530] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:41:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:41:48.484650 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8df8a-567b-4cef-b2e3-18735c7993ef admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:48.488662 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f7e8df8a-567b-4cef-b2e3-18735c7993ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:48.496112 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b90c8-0a15-4605-ba85-eb5c8a2ffe91 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:48.568367 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8df8a-567b-4cef-b2e3-18735c7993ef admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:48.572117 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac65d81-e5e6-45e9-b04a-318faaf5b648 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:48.572720 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac65d81-e5e6-45e9-b04a-318faaf5b648 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:48.572998 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac65d81-e5e6-45e9-b04a-318faaf5b648 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:48.573267 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac65d81-e5e6-45e9-b04a-318faaf5b648 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:48.583234 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac65d81-e5e6-45e9-b04a-318faaf5b648 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:48.586761 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 769/1531] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:48 2022] PUT /identity/v3/projects/0e8baf3f193a456493b264c37f080785/users/f6e460143930423c850e73f97c315262/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:48.586761 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b90c8-0a15-4605-ba85-eb5c8a2ffe91 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:48.590895 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac65d81-e5e6-45e9-b04a-318faaf5b648 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:48.598294 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 763/1532] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:48.599190 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac65d81-e5e6-45e9-b04a-318faaf5b648 service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:48.616695 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac65d81-e5e6-45e9-b04a-318faaf5b648 service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:48.663941 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b90c8-0a15-4605-ba85-eb5c8a2ffe91 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:48.678479 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d46e0-60d5-413e-84a6-2e18a9bf3171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:48.680475 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d46e0-60d5-413e-84a6-2e18a9bf3171 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:48.680922 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d46e0-60d5-413e-84a6-2e18a9bf3171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:48.682079 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d46e0-60d5-413e-84a6-2e18a9bf3171 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:48.683598 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d46e0-60d5-413e-84a6-2e18a9bf3171 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:48.684615 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f3733-d383-4854-bb86-f7442e36c111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:48.685135 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f3733-d383-4854-bb86-f7442e36c111 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:48.686271 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f3733-d383-4854-bb86-f7442e36c111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:48.686271 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f3733-d383-4854-bb86-f7442e36c111 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:48.686449 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f3733-d383-4854-bb86-f7442e36c111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:48.688321 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f3733-d383-4854-bb86-f7442e36c111 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:48.689034 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d46e0-60d5-413e-84a6-2e18a9bf3171 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:48.702770 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 764/1533] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:48.706811 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f3733-d383-4854-bb86-f7442e36c111 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:48.718562 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f3733-d383-4854-bb86-f7442e36c111 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:48.724309 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4187bf3c-1528-4dd4-8f16-bdff3feaedad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:48.725011 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187bf3c-1528-4dd4-8f16-bdff3feaedad admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:48.725295 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187bf3c-1528-4dd4-8f16-bdff3feaedad admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:48.725567 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187bf3c-1528-4dd4-8f16-bdff3feaedad admin admin] PATH_INFO: `/v3/projects/0e8baf3f193a456493b264c37f080785/users/f6e460143930423c850e73f97c315262/roles/9252c356af254127896f3626d925a88a` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:48.727522 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4187bf3c-1528-4dd4-8f16-bdff3feaedad admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e8baf3f193a456493b264c37f080785, user_id=f6e460143930423c850e73f97c315262, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:48.730313 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4187bf3c-1528-4dd4-8f16-bdff3feaedad admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:48.742969 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 765/1534] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:48 2022] PUT /identity/v3/projects/0e8baf3f193a456493b264c37f080785/users/f6e460143930423c850e73f97c315262/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:41:48.875253 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 770/1535] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:48 2022] POST /identity/v3/projects => generated 375 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:48.880948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4187bf3c-1528-4dd4-8f16-bdff3feaedad admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:48.966887 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d46e0-60d5-413e-84a6-2e18a9bf3171 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:48.969075 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-554d46e0-60d5-413e-84a6-2e18a9bf3171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:48.981113 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4187bf3c-1528-4dd4-8f16-bdff3feaedad admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:49.066437 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d91fa3-965d-4f8f-b7be-ebb6294dff20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:49.071640 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d91fa3-965d-4f8f-b7be-ebb6294dff20 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:49.071640 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d91fa3-965d-4f8f-b7be-ebb6294dff20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:49.071640 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d91fa3-965d-4f8f-b7be-ebb6294dff20 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:49.071640 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d91fa3-965d-4f8f-b7be-ebb6294dff20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:49.071640 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d91fa3-965d-4f8f-b7be-ebb6294dff20 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:49.078564 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d46e0-60d5-413e-84a6-2e18a9bf3171 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:49.087979 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcaa1b3-f88f-4bf7-86a7-d4e05a7c17fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:49.088700 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcaa1b3-f88f-4bf7-86a7-d4e05a7c17fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:49.088977 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcaa1b3-f88f-4bf7-86a7-d4e05a7c17fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:49.089245 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcaa1b3-f88f-4bf7-86a7-d4e05a7c17fe admin admin] PATH_INFO: `/v3/projects/3e4b6dcc4c584fad96dbfa184f21ebf5` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:49.090543 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcaa1b3-f88f-4bf7-86a7-d4e05a7c17fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e4b6dcc4c584fad96dbfa184f21ebf5)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:49.093081 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcaa1b3-f88f-4bf7-86a7-d4e05a7c17fe admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:49.167859 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:49.174377 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 766/1536] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:48 2022] POST /identity/v3/users => generated 288 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:49.178667 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d91fa3-965d-4f8f-b7be-ebb6294dff20 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:49.188321 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d91fa3-965d-4f8f-b7be-ebb6294dff20 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:49.194351 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6dc43b-64da-4429-a895-88c257b5eb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:49.194959 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6dc43b-64da-4429-a895-88c257b5eb1b admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:49.195242 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6dc43b-64da-4429-a895-88c257b5eb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:49.195517 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6dc43b-64da-4429-a895-88c257b5eb1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:49.196209 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6dc43b-64da-4429-a895-88c257b5eb1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:49.198314 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6dc43b-64da-4429-a895-88c257b5eb1b admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:49.213225 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 767/1537] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:41:49.213876 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3bcaa1b3-f88f-4bf7-86a7-d4e05a7c17fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e4b6dcc4c584fad96dbfa184f21ebf5', 'request_id': 'req-3bcaa1b3-f88f-4bf7-86a7-d4e05a7c17fe'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:49.214011 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6dc43b-64da-4429-a895-88c257b5eb1b admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:49.222085 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3bcaa1b3-f88f-4bf7-86a7-d4e05a7c17fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e4b6dcc4c584fad96dbfa184f21ebf5', 'request_id': 'req-3bcaa1b3-f88f-4bf7-86a7-d4e05a7c17fe'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:49.225693 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6dc43b-64da-4429-a895-88c257b5eb1b admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:49.230118 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3bcaa1b3-f88f-4bf7-86a7-d4e05a7c17fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e4b6dcc4c584fad96dbfa184f21ebf5', 'request_id': 'req-3bcaa1b3-f88f-4bf7-86a7-d4e05a7c17fe'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:49.312156 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0dc26f-5021-4d6d-9273-98c2418a387d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:49.312945 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dc26f-5021-4d6d-9273-98c2418a387d admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:49.313229 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dc26f-5021-4d6d-9273-98c2418a387d admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:49.313501 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dc26f-5021-4d6d-9273-98c2418a387d admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:49.316423 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0dc26f-5021-4d6d-9273-98c2418a387d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:49.328895 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0dc26f-5021-4d6d-9273-98c2418a387d admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:49.347617 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 768/1538] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:41:49.348630 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0dc26f-5021-4d6d-9273-98c2418a387d admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:49.350358 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-6b0dc26f-5021-4d6d-9273-98c2418a387d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:49.365091 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0dc26f-5021-4d6d-9273-98c2418a387d admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:49.372004 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263b3e4-a62a-4f55-a7f3-47f53072aebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:49.383658 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263b3e4-a62a-4f55-a7f3-47f53072aebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:49.383658 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263b3e4-a62a-4f55-a7f3-47f53072aebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:49.383658 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263b3e4-a62a-4f55-a7f3-47f53072aebf admin admin] PATH_INFO: `/v3/projects/57e25d8be58947809c9ec9041fbc736e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:49.383658 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7263b3e4-a62a-4f55-a7f3-47f53072aebf admin admin] RBAC: Authorizing `identity:delete_project(project_id=57e25d8be58947809c9ec9041fbc736e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:49.383658 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7263b3e4-a62a-4f55-a7f3-47f53072aebf admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:49.384037 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3bcaa1b3-f88f-4bf7-86a7-d4e05a7c17fe admin admin] The token cache is being invalidate because project 3e4b6dcc4c584fad96dbfa184f21ebf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:41:49.384037 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3bcaa1b3-f88f-4bf7-86a7-d4e05a7c17fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:49.384037 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3bcaa1b3-f88f-4bf7-86a7-d4e05a7c17fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:49.384898 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 771/1539] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:41:48 2022] DELETE /identity/v3/projects/3e4b6dcc4c584fad96dbfa184f21ebf5 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:49.388283 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcaa1b3-f88f-4bf7-86a7-d4e05a7c17fe admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:49.393836 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3bcaa1b3-f88f-4bf7-86a7-d4e05a7c17fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:49.457946 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcaa1b3-f88f-4bf7-86a7-d4e05a7c17fe admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:49.469405 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b20b4-d685-40ae-be29-e8f152fad199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:49.472719 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b20b4-d685-40ae-be29-e8f152fad199 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:49.473282 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b20b4-d685-40ae-be29-e8f152fad199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:49.473766 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b20b4-d685-40ae-be29-e8f152fad199 admin admin] PATH_INFO: `/v3/projects/d98fb90f84494767b775a4a055ef59ab/users/6a087e23dcd04756ac9837d080812f87/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:49.500509 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b20b4-d685-40ae-be29-e8f152fad199 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d98fb90f84494767b775a4a055ef59ab, user_id=6a087e23dcd04756ac9837d080812f87, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:49.503758 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b20b4-d685-40ae-be29-e8f152fad199 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:49.534480 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-7263b3e4-a62a-4f55-a7f3-47f53072aebf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57e25d8be58947809c9ec9041fbc736e', 'request_id': 'req-7263b3e4-a62a-4f55-a7f3-47f53072aebf'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:49.543488 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-7263b3e4-a62a-4f55-a7f3-47f53072aebf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57e25d8be58947809c9ec9041fbc736e', 'request_id': 'req-7263b3e4-a62a-4f55-a7f3-47f53072aebf'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:49.550526 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-7263b3e4-a62a-4f55-a7f3-47f53072aebf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57e25d8be58947809c9ec9041fbc736e', 'request_id': 'req-7263b3e4-a62a-4f55-a7f3-47f53072aebf'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:49.596686 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 772/1540] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:49 2022] PUT /identity/v3/projects/d98fb90f84494767b775a4a055ef59ab/users/6a087e23dcd04756ac9837d080812f87/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:49.609252 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b20b4-d685-40ae-be29-e8f152fad199 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:49.611178 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d82b20b4-d685-40ae-be29-e8f152fad199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:49.628235 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-7263b3e4-a62a-4f55-a7f3-47f53072aebf admin admin] The token cache is being invalidate because project 57e25d8be58947809c9ec9041fbc736e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:41:49.630372 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-7263b3e4-a62a-4f55-a7f3-47f53072aebf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:49.631456 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-7263b3e4-a62a-4f55-a7f3-47f53072aebf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:49.634175 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 769/1541] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:41:49 2022] DELETE /identity/v3/projects/57e25d8be58947809c9ec9041fbc736e => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:49.635655 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256be37-5946-4501-b189-45aa935b7b49 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:49.636127 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256be37-5946-4501-b189-45aa935b7b49 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:49.636532 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256be37-5946-4501-b189-45aa935b7b49 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:49.638795 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 770/1542] 10.222.0.16 () {54 vars in 921 bytes} [Wed Nov 2 07:41:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:41:49.640431 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df49dee-34ad-4796-901d-542ca39fc93f None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:49.640875 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df49dee-34ad-4796-901d-542ca39fc93f None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:49.641333 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df49dee-34ad-4796-901d-542ca39fc93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:49.683941 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-3df49dee-34ad-4796-901d-542ca39fc93f None None] MFA Rules not processed for user `6a087e23dcd04756ac9837d080812f87`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:49.686621 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-3df49dee-34ad-4796-901d-542ca39fc93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:49.722196 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b20b4-d685-40ae-be29-e8f152fad199 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:49.742267 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a2142-57dd-4e0a-b827-bbc7e6fc5b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:49.743041 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a2142-57dd-4e0a-b827-bbc7e6fc5b6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:49.743380 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a2142-57dd-4e0a-b827-bbc7e6fc5b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:49.746400 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a2142-57dd-4e0a-b827-bbc7e6fc5b6a admin admin] PATH_INFO: `/v3/users/788da7c70c8e4d7ebeba17377c29d728` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:49.746400 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a2142-57dd-4e0a-b827-bbc7e6fc5b6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=788da7c70c8e4d7ebeba17377c29d728)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:49.748934 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a2142-57dd-4e0a-b827-bbc7e6fc5b6a admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:49.804825 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 771/1543] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:49.804825 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df49dee-34ad-4796-901d-542ca39fc93f None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:49.819067 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-3df49dee-34ad-4796-901d-542ca39fc93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:49.852241 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df49dee-34ad-4796-901d-542ca39fc93f None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:49.863734 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ffd80-35aa-406b-94de-c990b87908de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:49.864420 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ffd80-35aa-406b-94de-c990b87908de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:49.865175 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ffd80-35aa-406b-94de-c990b87908de admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:49.865175 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ffd80-35aa-406b-94de-c990b87908de admin admin] PATH_INFO: `/v3/users/ace8fbdaa0724388a159cda894cbee69` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:49.866271 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ffd80-35aa-406b-94de-c990b87908de admin admin] RBAC: Authorizing `identity:delete_user(user_id=ace8fbdaa0724388a159cda894cbee69)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:49.868734 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ffd80-35aa-406b-94de-c990b87908de admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:49.920444 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:50.045379 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a26a2142-57dd-4e0a-b827-bbc7e6fc5b6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '788da7c70c8e4d7ebeba17377c29d728'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:50.078345 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a26a2142-57dd-4e0a-b827-bbc7e6fc5b6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '788da7c70c8e4d7ebeba17377c29d728'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:50.078345 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a26a2142-57dd-4e0a-b827-bbc7e6fc5b6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '788da7c70c8e4d7ebeba17377c29d728'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:50.084739 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a26a2142-57dd-4e0a-b827-bbc7e6fc5b6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '788da7c70c8e4d7ebeba17377c29d728'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:50.085591 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a26a2142-57dd-4e0a-b827-bbc7e6fc5b6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '788da7c70c8e4d7ebeba17377c29d728'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:50.104504 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-0b5ffd80-35aa-406b-94de-c990b87908de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ace8fbdaa0724388a159cda894cbee69'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:50.120852 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-0b5ffd80-35aa-406b-94de-c990b87908de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ace8fbdaa0724388a159cda894cbee69'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:50.133080 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-0b5ffd80-35aa-406b-94de-c990b87908de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ace8fbdaa0724388a159cda894cbee69'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:50.133953 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-0b5ffd80-35aa-406b-94de-c990b87908de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ace8fbdaa0724388a159cda894cbee69'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:50.134725 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-0b5ffd80-35aa-406b-94de-c990b87908de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ace8fbdaa0724388a159cda894cbee69'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:50.172195 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 773/1544] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:41:49 2022] DELETE /identity/v3/users/788da7c70c8e4d7ebeba17377c29d728 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:50.174117 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c599115-8363-4f75-8e4e-21a94fca0ff4 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:50.174608 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c599115-8363-4f75-8e4e-21a94fca0ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:50.175126 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c599115-8363-4f75-8e4e-21a94fca0ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:50.197350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-8c599115-8363-4f75-8e4e-21a94fca0ff4 None None] MFA Rules not processed for user `232210eabdfd4969a348d7333c50c438`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:50.198642 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8c599115-8363-4f75-8e4e-21a94fca0ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:50.282499 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 774/1545] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Nov 2 07:41:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:50.283346 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c599115-8363-4f75-8e4e-21a94fca0ff4 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:50.284834 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8c599115-8363-4f75-8e4e-21a94fca0ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:50.325679 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 772/1546] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:41:49 2022] DELETE /identity/v3/users/ace8fbdaa0724388a159cda894cbee69 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:50.328767 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ffd80-35aa-406b-94de-c990b87908de admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:50.328767 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-0b5ffd80-35aa-406b-94de-c990b87908de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:50.381613 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c599115-8363-4f75-8e4e-21a94fca0ff4 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:50.419619 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ffd80-35aa-406b-94de-c990b87908de admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:50.427504 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbfb1c5-e8e2-488d-aff4-a8fd57e84465 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:50.428317 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfb1c5-e8e2-488d-aff4-a8fd57e84465 service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:50.428518 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfb1c5-e8e2-488d-aff4-a8fd57e84465 service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:50.428956 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfb1c5-e8e2-488d-aff4-a8fd57e84465 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:50.440969 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbfb1c5-e8e2-488d-aff4-a8fd57e84465 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:50.442846 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbfb1c5-e8e2-488d-aff4-a8fd57e84465 service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:50.446588 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe5529-2fd3-48ad-84bd-b4d1cd502088 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '475f6e94957a4ae2b1248c8035231ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:50.447514 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe5529-2fd3-48ad-84bd-b4d1cd502088 service glance] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:50.448080 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe5529-2fd3-48ad-84bd-b4d1cd502088 service glance] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:50.456433 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe5529-2fd3-48ad-84bd-b4d1cd502088 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:50.456433 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c9fe5529-2fd3-48ad-84bd-b4d1cd502088 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:50.456618 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 773/1547] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:50.544634 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe5529-2fd3-48ad-84bd-b4d1cd502088 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:50.546424 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe5529-2fd3-48ad-84bd-b4d1cd502088 service glance] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:50.557760 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 775/1548] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:50.818822 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbfb1c5-e8e2-488d-aff4-a8fd57e84465 service nova] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:50.820649 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-7cbfb1c5-e8e2-488d-aff4-a8fd57e84465 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:50.914843 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbfb1c5-e8e2-488d-aff4-a8fd57e84465 service nova] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:50.921088 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4dd6c-f51c-4174-a485-6ce0581ac028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:50.921748 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4dd6c-f51c-4174-a485-6ce0581ac028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:50.922132 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4dd6c-f51c-4174-a485-6ce0581ac028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:50.922402 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4dd6c-f51c-4174-a485-6ce0581ac028 admin admin] PATH_INFO: `/v3/projects/2a1ba136cbcc485fa1aca7decc7cf283` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:50.923625 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab4dd6c-f51c-4174-a485-6ce0581ac028 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a1ba136cbcc485fa1aca7decc7cf283)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:50.926174 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab4dd6c-f51c-4174-a485-6ce0581ac028 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:50.948906 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea479f-de7d-4563-917a-c79ebc2306c1 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:50.948906 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea479f-de7d-4563-917a-c79ebc2306c1 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:50.948906 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea479f-de7d-4563-917a-c79ebc2306c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:51.012543 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-b7ea479f-de7d-4563-917a-c79ebc2306c1 None None] MFA Rules not processed for user `f6e460143930423c850e73f97c315262`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:51.013927 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b7ea479f-de7d-4563-917a-c79ebc2306c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:51.034525 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:51.121880 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-bab4dd6c-f51c-4174-a485-6ce0581ac028 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a1ba136cbcc485fa1aca7decc7cf283', 'request_id': 'req-bab4dd6c-f51c-4174-a485-6ce0581ac028'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:51.140976 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-bab4dd6c-f51c-4174-a485-6ce0581ac028 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a1ba136cbcc485fa1aca7decc7cf283', 'request_id': 'req-bab4dd6c-f51c-4174-a485-6ce0581ac028'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:51.150944 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-bab4dd6c-f51c-4174-a485-6ce0581ac028 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a1ba136cbcc485fa1aca7decc7cf283', 'request_id': 'req-bab4dd6c-f51c-4174-a485-6ce0581ac028'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:51.167595 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 776/1549] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:51.168773 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea479f-de7d-4563-917a-c79ebc2306c1 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:51.177368 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b7ea479f-de7d-4563-917a-c79ebc2306c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:51.207040 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea479f-de7d-4563-917a-c79ebc2306c1 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:51.283989 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a3150-8165-4e70-a351-2da24a5839e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:51.284977 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a3150-8165-4e70-a351-2da24a5839e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:51.285358 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a3150-8165-4e70-a351-2da24a5839e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:51.285758 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a3150-8165-4e70-a351-2da24a5839e5 admin admin] PATH_INFO: `/v3/projects/884d6fe9ae48498998a04cba7fc452ff` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:51.289646 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a3150-8165-4e70-a351-2da24a5839e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=884d6fe9ae48498998a04cba7fc452ff)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:51.292905 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-bab4dd6c-f51c-4174-a485-6ce0581ac028 admin admin] The token cache is being invalidate because project 2a1ba136cbcc485fa1aca7decc7cf283 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:41:51.293422 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-bab4dd6c-f51c-4174-a485-6ce0581ac028 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:51.294201 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-bab4dd6c-f51c-4174-a485-6ce0581ac028 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:51.295242 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a3150-8165-4e70-a351-2da24a5839e5 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:51.296131 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 774/1550] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:41:50 2022] DELETE /identity/v3/projects/2a1ba136cbcc485fa1aca7decc7cf283 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:41:51.301981 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c069238-25fb-4e6c-92bf-fc4c243cf789 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:51.302911 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c069238-25fb-4e6c-92bf-fc4c243cf789 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:51.303462 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c069238-25fb-4e6c-92bf-fc4c243cf789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:51.330479 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-3c069238-25fb-4e6c-92bf-fc4c243cf789 None None] MFA Rules not processed for user `b19d42266bc5423db6daf4f08f928b77`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:51.331807 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-3c069238-25fb-4e6c-92bf-fc4c243cf789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:51.434324 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 775/1551] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:51.438452 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3084f8-7214-45a7-b10e-d780ccd6d7de None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:51.438452 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3084f8-7214-45a7-b10e-d780ccd6d7de None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:51.438452 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3084f8-7214-45a7-b10e-d780ccd6d7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:51.448780 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4e6a3150-8165-4e70-a351-2da24a5839e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '884d6fe9ae48498998a04cba7fc452ff', 'request_id': 'req-4e6a3150-8165-4e70-a351-2da24a5839e5'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:51.466662 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4e6a3150-8165-4e70-a351-2da24a5839e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '884d6fe9ae48498998a04cba7fc452ff', 'request_id': 'req-4e6a3150-8165-4e70-a351-2da24a5839e5'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:51.473477 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-5d3084f8-7214-45a7-b10e-d780ccd6d7de None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:51.475859 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-5d3084f8-7214-45a7-b10e-d780ccd6d7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:51.478512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4e6a3150-8165-4e70-a351-2da24a5839e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '884d6fe9ae48498998a04cba7fc452ff', 'request_id': 'req-4e6a3150-8165-4e70-a351-2da24a5839e5'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:51.559505 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 776/1552] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:51.560551 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3084f8-7214-45a7-b10e-d780ccd6d7de None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:51.562310 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-5d3084f8-7214-45a7-b10e-d780ccd6d7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:51.613360 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4e6a3150-8165-4e70-a351-2da24a5839e5 admin admin] The token cache is being invalidate because project 884d6fe9ae48498998a04cba7fc452ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:41:51.613899 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4e6a3150-8165-4e70-a351-2da24a5839e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:51.617954 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4e6a3150-8165-4e70-a351-2da24a5839e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:51.617954 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 777/1553] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:41:51 2022] DELETE /identity/v3/projects/884d6fe9ae48498998a04cba7fc452ff => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:51.617954 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a733e92-8a0f-4d4a-9ec5-8a1a0f3ab49a None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:51.618347 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a733e92-8a0f-4d4a-9ec5-8a1a0f3ab49a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:51.618513 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a733e92-8a0f-4d4a-9ec5-8a1a0f3ab49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:51.641519 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-9a733e92-8a0f-4d4a-9ec5-8a1a0f3ab49a None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:51.643228 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9a733e92-8a0f-4d4a-9ec5-8a1a0f3ab49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:51.645993 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3084f8-7214-45a7-b10e-d780ccd6d7de None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:51.652932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57cc50-727a-4d8a-8e88-ca39f87c6d8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:51.653595 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57cc50-727a-4d8a-8e88-ca39f87c6d8c service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:51.653878 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57cc50-727a-4d8a-8e88-ca39f87c6d8c service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:51.654405 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57cc50-727a-4d8a-8e88-ca39f87c6d8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:51.656401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-5e57cc50-727a-4d8a-8e88-ca39f87c6d8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:51.659202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 778/1554] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:51.660867 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786d990-ead6-4a8e-9e25-e801bdf58ee6 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:51.661154 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786d990-ead6-4a8e-9e25-e801bdf58ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:51.661424 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786d990-ead6-4a8e-9e25-e801bdf58ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:51.683405 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-8786d990-ead6-4a8e-9e25-e801bdf58ee6 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:51.684669 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8786d990-ead6-4a8e-9e25-e801bdf58ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:51.693474 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 779/1555] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:51.700413 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8786d990-ead6-4a8e-9e25-e801bdf58ee6 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:51.711471 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8786d990-ead6-4a8e-9e25-e801bdf58ee6 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:51.713797 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:51.724316 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522710a-c42b-4f6a-9bbb-e8126d8a1cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:51.725121 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522710a-c42b-4f6a-9bbb-e8126d8a1cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:51.728179 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522710a-c42b-4f6a-9bbb-e8126d8a1cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:51.728703 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522710a-c42b-4f6a-9bbb-e8126d8a1cc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:51.729832 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522710a-c42b-4f6a-9bbb-e8126d8a1cc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:41:51.730467 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522710a-c42b-4f6a-9bbb-e8126d8a1cc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:51.733232 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522710a-c42b-4f6a-9bbb-e8126d8a1cc6 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:51.748452 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 780/1556] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:41:51.752023 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662557a8-f9d9-4c6a-afaf-a2c272be10f1 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:51.752523 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662557a8-f9d9-4c6a-afaf-a2c272be10f1 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:51.752793 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662557a8-f9d9-4c6a-afaf-a2c272be10f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:51.770956 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e57cc50-727a-4d8a-8e88-ca39f87c6d8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:51.772877 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e57cc50-727a-4d8a-8e88-ca39f87c6d8c service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:51.785653 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 777/1557] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:51.786813 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57cc50-727a-4d8a-8e88-ca39f87c6d8c service nova] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:51.804030 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-662557a8-f9d9-4c6a-afaf-a2c272be10f1 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:51.805279 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-662557a8-f9d9-4c6a-afaf-a2c272be10f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:51.825134 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 781/1558] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:51.827240 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662557a8-f9d9-4c6a-afaf-a2c272be10f1 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:51.827883 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57cc50-727a-4d8a-8e88-ca39f87c6d8c service nova] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:51.842176 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a486be-b9ab-4a4c-9edc-39970683580f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:51.843939 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a486be-b9ab-4a4c-9edc-39970683580f admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:51.844355 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a486be-b9ab-4a4c-9edc-39970683580f admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:51.844730 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a486be-b9ab-4a4c-9edc-39970683580f admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:51.847238 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a486be-b9ab-4a4c-9edc-39970683580f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:51.851209 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a486be-b9ab-4a4c-9edc-39970683580f admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:51.855376 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662557a8-f9d9-4c6a-afaf-a2c272be10f1 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:51.872836 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345d6b9-7b5c-4602-b83e-f6e6f7b48e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:51.873394 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345d6b9-7b5c-4602-b83e-f6e6f7b48e69 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:51.874384 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345d6b9-7b5c-4602-b83e-f6e6f7b48e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:51.874384 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345d6b9-7b5c-4602-b83e-f6e6f7b48e69 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:51.875149 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7345d6b9-7b5c-4602-b83e-f6e6f7b48e69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:41:51.875452 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7345d6b9-7b5c-4602-b83e-f6e6f7b48e69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:51.877658 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7345d6b9-7b5c-4602-b83e-f6e6f7b48e69 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:51.902788 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 782/1559] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:41:51.903861 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345d6b9-7b5c-4602-b83e-f6e6f7b48e69 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:51.917349 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345d6b9-7b5c-4602-b83e-f6e6f7b48e69 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:51.931971 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61f286-68db-49ce-a942-d24169d3e4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:51.932626 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61f286-68db-49ce-a942-d24169d3e4f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:51.933504 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61f286-68db-49ce-a942-d24169d3e4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:51.933651 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61f286-68db-49ce-a942-d24169d3e4f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:51.934372 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f61f286-68db-49ce-a942-d24169d3e4f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:51.936216 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f61f286-68db-49ce-a942-d24169d3e4f6 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:51.985351 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 778/1560] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:51 2022] POST /identity/v3/projects => generated 375 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:51.989781 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a486be-b9ab-4a4c-9edc-39970683580f admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:52.070678 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a486be-b9ab-4a4c-9edc-39970683580f admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:52.076745 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 783/1561] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:51 2022] POST /identity/v3/projects => generated 393 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:52.077583 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61f286-68db-49ce-a942-d24169d3e4f6 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:52.171434 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb0e17-185d-41ca-8dfe-8febee485d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:52.174682 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb0e17-185d-41ca-8dfe-8febee485d9a admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:52.174995 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb0e17-185d-41ca-8dfe-8febee485d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:52.179079 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb0e17-185d-41ca-8dfe-8febee485d9a admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:52.179837 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb0e17-185d-41ca-8dfe-8febee485d9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:52.181824 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb0e17-185d-41ca-8dfe-8febee485d9a admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:52.182442 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61f286-68db-49ce-a942-d24169d3e4f6 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:52.187312 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52fd26-5cbb-48c9-af77-c7a6795faf63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:52.188013 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52fd26-5cbb-48c9-af77-c7a6795faf63 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:52.188323 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52fd26-5cbb-48c9-af77-c7a6795faf63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:52.189453 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52fd26-5cbb-48c9-af77-c7a6795faf63 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:52.190619 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52fd26-5cbb-48c9-af77-c7a6795faf63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:52.192720 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52fd26-5cbb-48c9-af77-c7a6795faf63 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:52.372959 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 779/1562] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:51 2022] POST /identity/v3/users => generated 288 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:52.373383 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb0e17-185d-41ca-8dfe-8febee485d9a admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:52.374632 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 784/1563] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:52 2022] POST /identity/v3/users => generated 297 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:52.385139 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52fd26-5cbb-48c9-af77-c7a6795faf63 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:52.400461 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb0e17-185d-41ca-8dfe-8febee485d9a admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:52.401722 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52fd26-5cbb-48c9-af77-c7a6795faf63 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:52.412263 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47393a99-6270-4006-b316-b5452caefd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:52.414282 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47393a99-6270-4006-b316-b5452caefd1a admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:52.414282 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47393a99-6270-4006-b316-b5452caefd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:52.414282 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47393a99-6270-4006-b316-b5452caefd1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:52.415163 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817281c8-4169-43de-b321-2c63e236e4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:52.416031 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817281c8-4169-43de-b321-2c63e236e4d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:52.416509 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47393a99-6270-4006-b316-b5452caefd1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:52.416769 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817281c8-4169-43de-b321-2c63e236e4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:52.417173 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817281c8-4169-43de-b321-2c63e236e4d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:52.418623 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817281c8-4169-43de-b321-2c63e236e4d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:52.419836 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47393a99-6270-4006-b316-b5452caefd1a admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:52.422986 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817281c8-4169-43de-b321-2c63e236e4d9 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:52.450774 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 780/1564] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:52.451819 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47393a99-6270-4006-b316-b5452caefd1a admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:52.453100 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 785/1565] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:52.456904 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817281c8-4169-43de-b321-2c63e236e4d9 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:52.475181 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47393a99-6270-4006-b316-b5452caefd1a admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:52.480508 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15625a15-2be9-4754-aa37-cb7d10b58252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:52.481492 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15625a15-2be9-4754-aa37-cb7d10b58252 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:52.481876 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15625a15-2be9-4754-aa37-cb7d10b58252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:52.482093 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817281c8-4169-43de-b321-2c63e236e4d9 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:52.482394 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15625a15-2be9-4754-aa37-cb7d10b58252 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:52.483244 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15625a15-2be9-4754-aa37-cb7d10b58252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:52.488238 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15625a15-2be9-4754-aa37-cb7d10b58252 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:52.493349 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e81a5-cea3-49ce-91a7-2cc8f677836a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:52.494909 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e81a5-cea3-49ce-91a7-2cc8f677836a admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:52.496364 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e81a5-cea3-49ce-91a7-2cc8f677836a admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:52.496773 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e81a5-cea3-49ce-91a7-2cc8f677836a admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:52.497538 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e81a5-cea3-49ce-91a7-2cc8f677836a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:52.502387 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e81a5-cea3-49ce-91a7-2cc8f677836a admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:52.516173 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 781/1566] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:52.517714 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15625a15-2be9-4754-aa37-cb7d10b58252 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:52.531168 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 786/1567] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:52.536000 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e81a5-cea3-49ce-91a7-2cc8f677836a admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:52.540999 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15625a15-2be9-4754-aa37-cb7d10b58252 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:52.552766 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81d5b6-cd9b-4599-9ee0-75759b569fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:52.557966 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e81a5-cea3-49ce-91a7-2cc8f677836a admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:52.558213 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81d5b6-cd9b-4599-9ee0-75759b569fd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:52.558473 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81d5b6-cd9b-4599-9ee0-75759b569fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:52.558828 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81d5b6-cd9b-4599-9ee0-75759b569fd5 admin admin] PATH_INFO: `/v3/projects/40f5c51aaa3a4e3183e08c1e5395ec8e/users/71760172eb924b3bbcb135aec26e0770/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:52.575423 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1def81b-0126-40af-8e67-876d16f07b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:52.576375 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1def81b-0126-40af-8e67-876d16f07b25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:52.576687 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1def81b-0126-40af-8e67-876d16f07b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:52.576969 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1def81b-0126-40af-8e67-876d16f07b25 admin admin] PATH_INFO: `/v3/projects/4c59b8012df8456bb7b59f2eeb4fd321/users/f26fdaa20dc54886b5dcc08794b0b7d8/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:52.594093 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd81d5b6-cd9b-4599-9ee0-75759b569fd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40f5c51aaa3a4e3183e08c1e5395ec8e, user_id=71760172eb924b3bbcb135aec26e0770, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:52.596597 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1def81b-0126-40af-8e67-876d16f07b25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c59b8012df8456bb7b59f2eeb4fd321, user_id=f26fdaa20dc54886b5dcc08794b0b7d8, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:52.597359 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd81d5b6-cd9b-4599-9ee0-75759b569fd5 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:52.600476 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1def81b-0126-40af-8e67-876d16f07b25 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:52.703490 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 782/1568] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:52 2022] PUT /identity/v3/projects/40f5c51aaa3a4e3183e08c1e5395ec8e/users/71760172eb924b3bbcb135aec26e0770/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:52.716615 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee4e67-9717-4080-8b73-4ab817e4aac7 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:52.717150 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee4e67-9717-4080-8b73-4ab817e4aac7 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:52.717598 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee4e67-9717-4080-8b73-4ab817e4aac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:52.734210 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 787/1569] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:52 2022] PUT /identity/v3/projects/4c59b8012df8456bb7b59f2eeb4fd321/users/f26fdaa20dc54886b5dcc08794b0b7d8/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:52.746188 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3b82d-9fdd-4dc3-99a2-bab71eefcffc None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:52.746463 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3b82d-9fdd-4dc3-99a2-bab71eefcffc None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:52.746744 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3b82d-9fdd-4dc3-99a2-bab71eefcffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:52.802795 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-f1ee4e67-9717-4080-8b73-4ab817e4aac7 None None] MFA Rules not processed for user `71760172eb924b3bbcb135aec26e0770`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:52.804609 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f1ee4e67-9717-4080-8b73-4ab817e4aac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:52.809068 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-8ef3b82d-9fdd-4dc3-99a2-bab71eefcffc None None] MFA Rules not processed for user `f26fdaa20dc54886b5dcc08794b0b7d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:52.810473 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8ef3b82d-9fdd-4dc3-99a2-bab71eefcffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:52.957053 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 783/1570] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:41:52.958291 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee4e67-9717-4080-8b73-4ab817e4aac7 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:52.962736 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 788/1571] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:52 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:52.968529 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3b82d-9fdd-4dc3-99a2-bab71eefcffc None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:53.081843 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3b82d-9fdd-4dc3-99a2-bab71eefcffc None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:53.095556 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d199ae-f961-4878-8d4a-3d2ffd8adbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:53.104081 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d199ae-f961-4878-8d4a-3d2ffd8adbf0 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:53.108375 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d199ae-f961-4878-8d4a-3d2ffd8adbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:53.108683 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d199ae-f961-4878-8d4a-3d2ffd8adbf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:53.109332 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d199ae-f961-4878-8d4a-3d2ffd8adbf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:53.112983 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d199ae-f961-4878-8d4a-3d2ffd8adbf0 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:53.187233 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee4e67-9717-4080-8b73-4ab817e4aac7 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:53.192349 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc8e5c-0ce8-4cd1-a1c1-23235de8a126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:53.193038 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc8e5c-0ce8-4cd1-a1c1-23235de8a126 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:53.193387 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc8e5c-0ce8-4cd1-a1c1-23235de8a126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:53.193745 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc8e5c-0ce8-4cd1-a1c1-23235de8a126 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:53.194529 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc8e5c-0ce8-4cd1-a1c1-23235de8a126 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:53.196533 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc8e5c-0ce8-4cd1-a1c1-23235de8a126 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:53.209514 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 789/1572] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:52 2022] POST /identity/v3/projects => generated 393 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:53.213682 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d199ae-f961-4878-8d4a-3d2ffd8adbf0 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:53.331521 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d199ae-f961-4878-8d4a-3d2ffd8adbf0 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:53.336429 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052c285-f3ee-4406-82de-dcd5c8393262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:53.337058 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052c285-f3ee-4406-82de-dcd5c8393262 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:53.337360 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052c285-f3ee-4406-82de-dcd5c8393262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:53.337635 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052c285-f3ee-4406-82de-dcd5c8393262 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:53.338385 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052c285-f3ee-4406-82de-dcd5c8393262 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:53.341161 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052c285-f3ee-4406-82de-dcd5c8393262 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:53.363247 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 784/1573] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:52 2022] POST /identity/v3/projects => generated 375 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:53.367816 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:53.369585 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc8e5c-0ce8-4cd1-a1c1-23235de8a126 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:53.460166 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc8e5c-0ce8-4cd1-a1c1-23235de8a126 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:53.465938 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e60ed32-e11b-45f6-991c-4396281f5eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:53.467201 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60ed32-e11b-45f6-991c-4396281f5eaf admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:53.467478 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60ed32-e11b-45f6-991c-4396281f5eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:53.468231 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60ed32-e11b-45f6-991c-4396281f5eaf admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:53.469041 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e60ed32-e11b-45f6-991c-4396281f5eaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:53.473951 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e60ed32-e11b-45f6-991c-4396281f5eaf admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:53.539829 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 790/1574] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:53 2022] POST /identity/v3/users => generated 303 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:53.543985 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052c285-f3ee-4406-82de-dcd5c8393262 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:53.555490 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052c285-f3ee-4406-82de-dcd5c8393262 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:53.560896 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6a6b1-6ead-4d1f-a0f2-b02f657ffdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:53.561325 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6a6b1-6ead-4d1f-a0f2-b02f657ffdf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:53.561609 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6a6b1-6ead-4d1f-a0f2-b02f657ffdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:53.561929 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6a6b1-6ead-4d1f-a0f2-b02f657ffdf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:53.562555 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6a6b1-6ead-4d1f-a0f2-b02f657ffdf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:53.564251 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6a6b1-6ead-4d1f-a0f2-b02f657ffdf0 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:53.578247 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 791/1575] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:53.579863 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6a6b1-6ead-4d1f-a0f2-b02f657ffdf0 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:53.596567 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 785/1576] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:53 2022] POST /identity/v3/users => generated 294 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:53.597597 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e60ed32-e11b-45f6-991c-4396281f5eaf admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:53.605284 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6a6b1-6ead-4d1f-a0f2-b02f657ffdf0 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:53.608269 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e60ed32-e11b-45f6-991c-4396281f5eaf admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:53.613545 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de52c79-0828-44f0-bade-f59d182d44e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:53.613742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e3a15b-385b-4c94-a5a7-c6b4202a4098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:53.614449 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3a15b-385b-4c94-a5a7-c6b4202a4098 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:53.614833 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3a15b-385b-4c94-a5a7-c6b4202a4098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:53.615082 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de52c79-0828-44f0-bade-f59d182d44e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:53.615292 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3a15b-385b-4c94-a5a7-c6b4202a4098 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:53.615396 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de52c79-0828-44f0-bade-f59d182d44e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:53.615686 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de52c79-0828-44f0-bade-f59d182d44e6 admin admin] PATH_INFO: `/v3/projects/84e22dd7c16442c5807ff6455776dcea/users/9e192a124be4477f8ba3560605af7176/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:53.616242 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e3a15b-385b-4c94-a5a7-c6b4202a4098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:53.618146 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e3a15b-385b-4c94-a5a7-c6b4202a4098 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:53.633425 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 786/1577] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:53.637650 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e3a15b-385b-4c94-a5a7-c6b4202a4098 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:53.639662 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de52c79-0828-44f0-bade-f59d182d44e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84e22dd7c16442c5807ff6455776dcea, user_id=9e192a124be4477f8ba3560605af7176, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:53.643175 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de52c79-0828-44f0-bade-f59d182d44e6 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:53.649683 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e3a15b-385b-4c94-a5a7-c6b4202a4098 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:53.654886 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f81ed-b633-4552-bbd3-f2cc74742a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:53.655727 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f81ed-b633-4552-bbd3-f2cc74742a76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:53.656009 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f81ed-b633-4552-bbd3-f2cc74742a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:53.656314 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f81ed-b633-4552-bbd3-f2cc74742a76 admin admin] PATH_INFO: `/v3/projects/dc28a1b6b8e5467c80f8207077734cec/users/811cf8b562c24c0180b4dd37717313ba/roles/9252c356af254127896f3626d925a88a` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:53.673300 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f81ed-b633-4552-bbd3-f2cc74742a76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc28a1b6b8e5467c80f8207077734cec, user_id=811cf8b562c24c0180b4dd37717313ba, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:53.676086 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f81ed-b633-4552-bbd3-f2cc74742a76 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:53.727075 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 792/1578] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:53 2022] PUT /identity/v3/projects/84e22dd7c16442c5807ff6455776dcea/users/9e192a124be4477f8ba3560605af7176/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:41:53.745828 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de52c79-0828-44f0-bade-f59d182d44e6 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:53.767911 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 787/1579] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:53 2022] PUT /identity/v3/projects/dc28a1b6b8e5467c80f8207077734cec/users/811cf8b562c24c0180b4dd37717313ba/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:41:53.771590 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f81ed-b633-4552-bbd3-f2cc74742a76 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:53.820222 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:53.855243 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de52c79-0828-44f0-bade-f59d182d44e6 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:53.890302 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f81ed-b633-4552-bbd3-f2cc74742a76 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:53.896596 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11336727-e63c-45e4-8f8b-6ffbff8fd554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:53.897324 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11336727-e63c-45e4-8f8b-6ffbff8fd554 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:53.897632 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11336727-e63c-45e4-8f8b-6ffbff8fd554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:53.898610 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11336727-e63c-45e4-8f8b-6ffbff8fd554 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:53.899329 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11336727-e63c-45e4-8f8b-6ffbff8fd554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:53.901037 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11336727-e63c-45e4-8f8b-6ffbff8fd554 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:53.915803 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 788/1580] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:53.924787 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11336727-e63c-45e4-8f8b-6ffbff8fd554 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:53.939520 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11336727-e63c-45e4-8f8b-6ffbff8fd554 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:53.952804 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c36a9-80d4-4d80-8311-012a096e373c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:53.953469 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c36a9-80d4-4d80-8311-012a096e373c admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:53.959595 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c36a9-80d4-4d80-8311-012a096e373c admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:53.959880 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c36a9-80d4-4d80-8311-012a096e373c admin admin] PATH_INFO: `/v3/projects/dc28a1b6b8e5467c80f8207077734cec/users/811cf8b562c24c0180b4dd37717313ba/roles/9252c356af254127896f3626d925a88a` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:53.967121 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c36a9-80d4-4d80-8311-012a096e373c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc28a1b6b8e5467c80f8207077734cec, user_id=811cf8b562c24c0180b4dd37717313ba, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:53.974689 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c36a9-80d4-4d80-8311-012a096e373c admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:53.984353 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e115410-b79b-43fb-b100-851a643ca754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:53.985180 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e115410-b79b-43fb-b100-851a643ca754 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:53.986780 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e115410-b79b-43fb-b100-851a643ca754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:53.987075 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e115410-b79b-43fb-b100-851a643ca754 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:53.990120 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e115410-b79b-43fb-b100-851a643ca754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:53.995147 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e115410-b79b-43fb-b100-851a643ca754 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:54.009265 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 789/1581] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:53 2022] PUT /identity/v3/projects/dc28a1b6b8e5467c80f8207077734cec/users/811cf8b562c24c0180b4dd37717313ba/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:41:54.009265 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb71ff9-f3cb-46e8-b4de-07427fdc4e69 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:54.009265 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb71ff9-f3cb-46e8-b4de-07427fdc4e69 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:54.009265 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb71ff9-f3cb-46e8-b4de-07427fdc4e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:54.018680 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 793/1582] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:54.019922 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e115410-b79b-43fb-b100-851a643ca754 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:54.031274 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e115410-b79b-43fb-b100-851a643ca754 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:54.049050 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-bbb71ff9-f3cb-46e8-b4de-07427fdc4e69 None None] MFA Rules not processed for user `811cf8b562c24c0180b4dd37717313ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:54.050418 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-bbb71ff9-f3cb-46e8-b4de-07427fdc4e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:54.107497 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46728cc9-56d1-41eb-b518-7291055946c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:54.108346 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46728cc9-56d1-41eb-b518-7291055946c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:54.108624 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46728cc9-56d1-41eb-b518-7291055946c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:54.108892 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46728cc9-56d1-41eb-b518-7291055946c7 admin admin] PATH_INFO: `/v3/projects/84e22dd7c16442c5807ff6455776dcea/users/9e192a124be4477f8ba3560605af7176/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:54.111668 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46728cc9-56d1-41eb-b518-7291055946c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84e22dd7c16442c5807ff6455776dcea, user_id=9e192a124be4477f8ba3560605af7176, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:54.114855 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46728cc9-56d1-41eb-b518-7291055946c7 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:54.136013 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 794/1583] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:54 2022] PUT /identity/v3/projects/84e22dd7c16442c5807ff6455776dcea/users/9e192a124be4477f8ba3560605af7176/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:54.138564 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4ae54-80fe-4986-95d9-79b4966fd5ae None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:54.138954 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4ae54-80fe-4986-95d9-79b4966fd5ae None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:54.139325 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4ae54-80fe-4986-95d9-79b4966fd5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:54.151786 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 790/1584] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:54.164712 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb71ff9-f3cb-46e8-b4de-07427fdc4e69 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:54.166321 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-bbb71ff9-f3cb-46e8-b4de-07427fdc4e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:54.190998 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-dce4ae54-80fe-4986-95d9-79b4966fd5ae None None] MFA Rules not processed for user `9e192a124be4477f8ba3560605af7176`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:54.193143 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-dce4ae54-80fe-4986-95d9-79b4966fd5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:54.268611 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb71ff9-f3cb-46e8-b4de-07427fdc4e69 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:54.368804 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 795/1585] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:54 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:54.375561 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec82efa-8872-46d1-b385-7e766ffca2f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:54.376972 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec82efa-8872-46d1-b385-7e766ffca2f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:54.377470 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec82efa-8872-46d1-b385-7e766ffca2f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:54.377734 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec82efa-8872-46d1-b385-7e766ffca2f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:54.380507 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4ae54-80fe-4986-95d9-79b4966fd5ae None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:54.382005 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-dce4ae54-80fe-4986-95d9-79b4966fd5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:54.398085 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4ae54-80fe-4986-95d9-79b4966fd5ae None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:54.401949 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb259e8-abd8-4218-87b3-73862a17b8a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:54.402731 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb259e8-abd8-4218-87b3-73862a17b8a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:54.403016 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb259e8-abd8-4218-87b3-73862a17b8a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:54.403288 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb259e8-abd8-4218-87b3-73862a17b8a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:54.415329 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb259e8-abd8-4218-87b3-73862a17b8a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:54.416877 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb259e8-abd8-4218-87b3-73862a17b8a7 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:54.427190 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 796/1586] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:54 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:54.445789 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec82efa-8872-46d1-b385-7e766ffca2f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:54.447431 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec82efa-8872-46d1-b385-7e766ffca2f2 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:54.458947 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 791/1587] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:55.263911 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb259e8-abd8-4218-87b3-73862a17b8a7 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:55.290701 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb259e8-abd8-4218-87b3-73862a17b8a7 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:55.297418 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78f163-0839-4d21-81be-3eea37ff587b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:55.299316 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78f163-0839-4d21-81be-3eea37ff587b service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:55.299756 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78f163-0839-4d21-81be-3eea37ff587b service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:55.300248 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78f163-0839-4d21-81be-3eea37ff587b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:55.368447 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78f163-0839-4d21-81be-3eea37ff587b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:55.369467 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78f163-0839-4d21-81be-3eea37ff587b service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:55.380756 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 797/1588] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:55 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:57.692114 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:57.994539 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:59.157174 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec82efa-8872-46d1-b385-7e766ffca2f2 service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:59.238805 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec82efa-8872-46d1-b385-7e766ffca2f2 service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:59.243839 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b7182-c62c-4cd0-9290-ca9a9db94b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:59.244508 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b7182-c62c-4cd0-9290-ca9a9db94b70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:59.244782 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b7182-c62c-4cd0-9290-ca9a9db94b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:59.245053 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b7182-c62c-4cd0-9290-ca9a9db94b70 admin admin] PATH_INFO: `/v3/users/71760172eb924b3bbcb135aec26e0770` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:59.246177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b7182-c62c-4cd0-9290-ca9a9db94b70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71760172eb924b3bbcb135aec26e0770)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:59.248267 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b7182-c62c-4cd0-9290-ca9a9db94b70 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:59.435705 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-bf3b7182-c62c-4cd0-9290-ca9a9db94b70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71760172eb924b3bbcb135aec26e0770'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:59.466998 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-bf3b7182-c62c-4cd0-9290-ca9a9db94b70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71760172eb924b3bbcb135aec26e0770'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:59.497577 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-bf3b7182-c62c-4cd0-9290-ca9a9db94b70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71760172eb924b3bbcb135aec26e0770'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:59.500348 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-bf3b7182-c62c-4cd0-9290-ca9a9db94b70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71760172eb924b3bbcb135aec26e0770'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:59.501769 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-bf3b7182-c62c-4cd0-9290-ca9a9db94b70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71760172eb924b3bbcb135aec26e0770'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:59.577984 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 792/1589] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:41:59 2022] DELETE /identity/v3/users/71760172eb924b3bbcb135aec26e0770 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:59.582038 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0699f4f-baf8-4608-97e3-2b9e8137af5c None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:59.582509 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0699f4f-baf8-4608-97e3-2b9e8137af5c None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:59.582638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0699f4f-baf8-4608-97e3-2b9e8137af5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:59.604538 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-c0699f4f-baf8-4608-97e3-2b9e8137af5c None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:59.605888 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c0699f4f-baf8-4608-97e3-2b9e8137af5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:59.665544 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 798/1590] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:59.675437 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b7182-c62c-4cd0-9290-ca9a9db94b70 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:59.676991 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-bf3b7182-c62c-4cd0-9290-ca9a9db94b70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:59.738598 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b7182-c62c-4cd0-9290-ca9a9db94b70 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:59.742347 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a175e5b-13d6-42e6-84f8-a0224e7ef375 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:59.742923 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a175e5b-13d6-42e6-84f8-a0224e7ef375 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:59.743200 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a175e5b-13d6-42e6-84f8-a0224e7ef375 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:59.743496 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a175e5b-13d6-42e6-84f8-a0224e7ef375 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:59.754440 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a175e5b-13d6-42e6-84f8-a0224e7ef375 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:59.755868 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a175e5b-13d6-42e6-84f8-a0224e7ef375 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:59.766432 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 793/1591] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:00.109522 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:00.281245 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:00.452740 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0699f4f-baf8-4608-97e3-2b9e8137af5c None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:00.455008 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c0699f4f-baf8-4608-97e3-2b9e8137af5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:00.467765 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0699f4f-baf8-4608-97e3-2b9e8137af5c None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:00.473419 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7985f-ed1a-4a3b-a24a-87604ed61951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:00.474141 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7985f-ed1a-4a3b-a24a-87604ed61951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:00.474420 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7985f-ed1a-4a3b-a24a-87604ed61951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:00.474692 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7985f-ed1a-4a3b-a24a-87604ed61951 admin admin] PATH_INFO: `/v3/projects/40f5c51aaa3a4e3183e08c1e5395ec8e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:00.476210 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7985f-ed1a-4a3b-a24a-87604ed61951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40f5c51aaa3a4e3183e08c1e5395ec8e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:00.477804 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7985f-ed1a-4a3b-a24a-87604ed61951 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:00.636003 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-59b7985f-ed1a-4a3b-a24a-87604ed61951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40f5c51aaa3a4e3183e08c1e5395ec8e', 'request_id': 'req-59b7985f-ed1a-4a3b-a24a-87604ed61951'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:00.660514 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-59b7985f-ed1a-4a3b-a24a-87604ed61951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40f5c51aaa3a4e3183e08c1e5395ec8e', 'request_id': 'req-59b7985f-ed1a-4a3b-a24a-87604ed61951'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:00.671296 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-59b7985f-ed1a-4a3b-a24a-87604ed61951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40f5c51aaa3a4e3183e08c1e5395ec8e', 'request_id': 'req-59b7985f-ed1a-4a3b-a24a-87604ed61951'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:00.744728 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-59b7985f-ed1a-4a3b-a24a-87604ed61951 admin admin] The token cache is being invalidate because project 40f5c51aaa3a4e3183e08c1e5395ec8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:42:00.745533 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-59b7985f-ed1a-4a3b-a24a-87604ed61951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:00.748214 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-59b7985f-ed1a-4a3b-a24a-87604ed61951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:00.748925 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 799/1592] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:42:00 2022] DELETE /identity/v3/projects/40f5c51aaa3a4e3183e08c1e5395ec8e => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:00.753304 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a175e5b-13d6-42e6-84f8-a0224e7ef375 service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:00.763279 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a175e5b-13d6-42e6-84f8-a0224e7ef375 service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:00.839395 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e9ac0-0e66-45e8-88f4-e6bc5d0f8fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:00.840031 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e9ac0-0e66-45e8-88f4-e6bc5d0f8fd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:00.840404 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e9ac0-0e66-45e8-88f4-e6bc5d0f8fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:00.840672 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e9ac0-0e66-45e8-88f4-e6bc5d0f8fd3 admin admin] PATH_INFO: `/v3/users/811cf8b562c24c0180b4dd37717313ba` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:00.841781 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e9ac0-0e66-45e8-88f4-e6bc5d0f8fd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=811cf8b562c24c0180b4dd37717313ba)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:00.843995 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e9ac0-0e66-45e8-88f4-e6bc5d0f8fd3 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:01.049669 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-6b1e9ac0-0e66-45e8-88f4-e6bc5d0f8fd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '811cf8b562c24c0180b4dd37717313ba'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:01.092025 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-6b1e9ac0-0e66-45e8-88f4-e6bc5d0f8fd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '811cf8b562c24c0180b4dd37717313ba'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:01.099747 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-6b1e9ac0-0e66-45e8-88f4-e6bc5d0f8fd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '811cf8b562c24c0180b4dd37717313ba'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:01.100529 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-6b1e9ac0-0e66-45e8-88f4-e6bc5d0f8fd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '811cf8b562c24c0180b4dd37717313ba'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:01.101176 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-6b1e9ac0-0e66-45e8-88f4-e6bc5d0f8fd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '811cf8b562c24c0180b4dd37717313ba'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:01.165353 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 794/1593] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:42:00 2022] DELETE /identity/v3/users/811cf8b562c24c0180b4dd37717313ba => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:42:01.508997 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:01.668606 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:01.985437 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7985f-ed1a-4a3b-a24a-87604ed61951 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:01.988090 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-59b7985f-ed1a-4a3b-a24a-87604ed61951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:02.012933 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7985f-ed1a-4a3b-a24a-87604ed61951 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:02.184982 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c21d1-aa24-4735-aa1f-c8658ea813e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:02.188112 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c21d1-aa24-4735-aa1f-c8658ea813e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:02.189460 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c21d1-aa24-4735-aa1f-c8658ea813e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:02.190102 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c21d1-aa24-4735-aa1f-c8658ea813e9 admin admin] PATH_INFO: `/v3/projects/dc28a1b6b8e5467c80f8207077734cec` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:02.191732 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c21d1-aa24-4735-aa1f-c8658ea813e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc28a1b6b8e5467c80f8207077734cec)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:02.194374 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c21d1-aa24-4735-aa1f-c8658ea813e9 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:02.330516 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a21c21d1-aa24-4735-aa1f-c8658ea813e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc28a1b6b8e5467c80f8207077734cec', 'request_id': 'req-a21c21d1-aa24-4735-aa1f-c8658ea813e9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:02.339175 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a21c21d1-aa24-4735-aa1f-c8658ea813e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc28a1b6b8e5467c80f8207077734cec', 'request_id': 'req-a21c21d1-aa24-4735-aa1f-c8658ea813e9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:02.346046 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a21c21d1-aa24-4735-aa1f-c8658ea813e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc28a1b6b8e5467c80f8207077734cec', 'request_id': 'req-a21c21d1-aa24-4735-aa1f-c8658ea813e9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:02.483741 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a21c21d1-aa24-4735-aa1f-c8658ea813e9 admin admin] The token cache is being invalidate because project dc28a1b6b8e5467c80f8207077734cec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:42:02.484531 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a21c21d1-aa24-4735-aa1f-c8658ea813e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:02.485387 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a21c21d1-aa24-4735-aa1f-c8658ea813e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:02.488196 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 800/1594] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:42:01 2022] DELETE /identity/v3/projects/dc28a1b6b8e5467c80f8207077734cec => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:02.493299 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243183e7-f53c-4cc7-a917-74c1598425c5 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:02.493866 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243183e7-f53c-4cc7-a917-74c1598425c5 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:02.494995 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243183e7-f53c-4cc7-a917-74c1598425c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:02.518970 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-243183e7-f53c-4cc7-a917-74c1598425c5 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:02.521844 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-243183e7-f53c-4cc7-a917-74c1598425c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:02.618063 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 795/1595] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:02.629860 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7b6fc-303d-4755-bc71-29606a6de257 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:02.631160 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7b6fc-303d-4755-bc71-29606a6de257 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:02.632292 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7b6fc-303d-4755-bc71-29606a6de257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:02.659763 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-01e7b6fc-303d-4755-bc71-29606a6de257 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:02.661416 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-01e7b6fc-303d-4755-bc71-29606a6de257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:02.682980 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 801/1596] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:02.686395 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243183e7-f53c-4cc7-a917-74c1598425c5 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:02.698990 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243183e7-f53c-4cc7-a917-74c1598425c5 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:02.706737 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc92de-b81c-4d3f-a22d-85bc8fcabaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:02.707484 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc92de-b81c-4d3f-a22d-85bc8fcabaf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:02.707855 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc92de-b81c-4d3f-a22d-85bc8fcabaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:02.709215 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc92de-b81c-4d3f-a22d-85bc8fcabaf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:02.709991 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc92de-b81c-4d3f-a22d-85bc8fcabaf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:42:02.710475 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc92de-b81c-4d3f-a22d-85bc8fcabaf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:02.712362 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc92de-b81c-4d3f-a22d-85bc8fcabaf1 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:02.734282 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 796/1597] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:42:02.739500 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7b6fc-303d-4755-bc71-29606a6de257 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:02.754426 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7b6fc-303d-4755-bc71-29606a6de257 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:02.759667 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161e093-c417-41b5-b208-15fdfabed742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:02.761331 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161e093-c417-41b5-b208-15fdfabed742 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:02.761779 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161e093-c417-41b5-b208-15fdfabed742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:02.762219 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161e093-c417-41b5-b208-15fdfabed742 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:02.763247 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2161e093-c417-41b5-b208-15fdfabed742 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:02.765688 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2161e093-c417-41b5-b208-15fdfabed742 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:02.820465 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc92de-b81c-4d3f-a22d-85bc8fcabaf1 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:02.822232 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e2bc92de-b81c-4d3f-a22d-85bc8fcabaf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:02.884525 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc92de-b81c-4d3f-a22d-85bc8fcabaf1 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:02.890882 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37fea4-dfe6-48e5-9bc3-8a0781d2dfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:02.892370 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37fea4-dfe6-48e5-9bc3-8a0781d2dfd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:02.892829 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37fea4-dfe6-48e5-9bc3-8a0781d2dfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:02.893261 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37fea4-dfe6-48e5-9bc3-8a0781d2dfd7 admin admin] PATH_INFO: `/v3/users/f26fdaa20dc54886b5dcc08794b0b7d8` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:02.894814 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d37fea4-dfe6-48e5-9bc3-8a0781d2dfd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f26fdaa20dc54886b5dcc08794b0b7d8)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:02.897985 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d37fea4-dfe6-48e5-9bc3-8a0781d2dfd7 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:02.914190 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 802/1598] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:42:02 2022] POST /identity/v3/projects => generated 377 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:02.918411 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161e093-c417-41b5-b208-15fdfabed742 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:03.024686 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161e093-c417-41b5-b208-15fdfabed742 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:03.030537 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937947c1-e9b4-4151-9da2-3d9b3f20288f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:03.031092 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937947c1-e9b4-4151-9da2-3d9b3f20288f admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:03.031372 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937947c1-e9b4-4151-9da2-3d9b3f20288f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:03.031645 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937947c1-e9b4-4151-9da2-3d9b3f20288f admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:03.032335 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937947c1-e9b4-4151-9da2-3d9b3f20288f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:03.034568 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937947c1-e9b4-4151-9da2-3d9b3f20288f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:03.136946 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 803/1599] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:42:02 2022] POST /identity/v3/users => generated 289 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:42:03.140946 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937947c1-e9b4-4151-9da2-3d9b3f20288f admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:03.152310 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937947c1-e9b4-4151-9da2-3d9b3f20288f admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:03.165896 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25dcdbe-52a1-4ea1-bcda-2307235e8d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:03.165896 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25dcdbe-52a1-4ea1-bcda-2307235e8d8e admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:03.166203 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25dcdbe-52a1-4ea1-bcda-2307235e8d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:03.166312 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25dcdbe-52a1-4ea1-bcda-2307235e8d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:03.167103 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25dcdbe-52a1-4ea1-bcda-2307235e8d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:03.169496 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25dcdbe-52a1-4ea1-bcda-2307235e8d8e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:03.171186 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-7d37fea4-dfe6-48e5-9bc3-8a0781d2dfd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f26fdaa20dc54886b5dcc08794b0b7d8'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:03.185312 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 804/1600] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:42:03.186256 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-7d37fea4-dfe6-48e5-9bc3-8a0781d2dfd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f26fdaa20dc54886b5dcc08794b0b7d8'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:03.186440 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25dcdbe-52a1-4ea1-bcda-2307235e8d8e admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:03.195754 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-7d37fea4-dfe6-48e5-9bc3-8a0781d2dfd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f26fdaa20dc54886b5dcc08794b0b7d8'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:03.196844 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-7d37fea4-dfe6-48e5-9bc3-8a0781d2dfd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f26fdaa20dc54886b5dcc08794b0b7d8'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:03.197754 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-7d37fea4-dfe6-48e5-9bc3-8a0781d2dfd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f26fdaa20dc54886b5dcc08794b0b7d8'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:03.198506 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25dcdbe-52a1-4ea1-bcda-2307235e8d8e admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:03.203380 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca4dfa-e8bd-4dc4-bb6c-ed4dc2f50cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:03.204029 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca4dfa-e8bd-4dc4-bb6c-ed4dc2f50cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:03.204377 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca4dfa-e8bd-4dc4-bb6c-ed4dc2f50cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:03.204705 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca4dfa-e8bd-4dc4-bb6c-ed4dc2f50cd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:03.205408 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca4dfa-e8bd-4dc4-bb6c-ed4dc2f50cd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:03.207011 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca4dfa-e8bd-4dc4-bb6c-ed4dc2f50cd7 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:03.224675 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 805/1601] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:42:03.225648 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca4dfa-e8bd-4dc4-bb6c-ed4dc2f50cd7 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:03.227356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9bca4dfa-e8bd-4dc4-bb6c-ed4dc2f50cd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:03.241293 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca4dfa-e8bd-4dc4-bb6c-ed4dc2f50cd7 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:03.246448 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f0fab4-b548-4c2c-aeba-2900014bfd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:03.247127 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0fab4-b548-4c2c-aeba-2900014bfd4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:03.247401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0fab4-b548-4c2c-aeba-2900014bfd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:03.247718 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0fab4-b548-4c2c-aeba-2900014bfd4d admin admin] PATH_INFO: `/v3/projects/623e77c72135421f8a7f85b52706c84d/users/b2c56a5ba0054c5c98a76169a4fc124c/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:03.259723 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:03.269608 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f0fab4-b548-4c2c-aeba-2900014bfd4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=623e77c72135421f8a7f85b52706c84d, user_id=b2c56a5ba0054c5c98a76169a4fc124c, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:03.272386 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f0fab4-b548-4c2c-aeba-2900014bfd4d admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:03.320687 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 797/1602] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:42:02 2022] DELETE /identity/v3/users/f26fdaa20dc54886b5dcc08794b0b7d8 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:03.325363 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c58b3-a75c-421c-8cf6-1d0910b98524 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:03.325809 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c58b3-a75c-421c-8cf6-1d0910b98524 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:03.326182 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c58b3-a75c-421c-8cf6-1d0910b98524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:03.346222 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-e86c58b3-a75c-421c-8cf6-1d0910b98524 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:03.347526 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e86c58b3-a75c-421c-8cf6-1d0910b98524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:03.380740 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 806/1603] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:03 2022] PUT /identity/v3/projects/623e77c72135421f8a7f85b52706c84d/users/b2c56a5ba0054c5c98a76169a4fc124c/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:03.391813 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80746f07-5584-448b-ab0f-4d66a49248ac None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:03.392362 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80746f07-5584-448b-ab0f-4d66a49248ac None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:03.392796 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80746f07-5584-448b-ab0f-4d66a49248ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:03.414255 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 798/1604] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:03.425276 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c58b3-a75c-421c-8cf6-1d0910b98524 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:03.432076 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e86c58b3-a75c-421c-8cf6-1d0910b98524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:03.433799 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-80746f07-5584-448b-ab0f-4d66a49248ac None None] MFA Rules not processed for user `b2c56a5ba0054c5c98a76169a4fc124c`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:03.436221 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-80746f07-5584-448b-ab0f-4d66a49248ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:03.508208 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c58b3-a75c-421c-8cf6-1d0910b98524 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:03.527148 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 807/1605] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:03.531830 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80746f07-5584-448b-ab0f-4d66a49248ac None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:03.588533 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23251a-4918-4036-ad70-6852c1e74a41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:03.589142 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23251a-4918-4036-ad70-6852c1e74a41 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:03.589846 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23251a-4918-4036-ad70-6852c1e74a41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:03.590129 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23251a-4918-4036-ad70-6852c1e74a41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:03.611989 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80746f07-5584-448b-ab0f-4d66a49248ac None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:03.617171 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d90b3-fb95-4802-b0f6-71d71c74df88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:03.617877 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d90b3-fb95-4802-b0f6-71d71c74df88 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:03.618175 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d90b3-fb95-4802-b0f6-71d71c74df88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:03.618431 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d90b3-fb95-4802-b0f6-71d71c74df88 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:03.619075 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d90b3-fb95-4802-b0f6-71d71c74df88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:03.621073 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d90b3-fb95-4802-b0f6-71d71c74df88 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:03.672787 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b23251a-4918-4036-ad70-6852c1e74a41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:03.676561 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b23251a-4918-4036-ad70-6852c1e74a41 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:03.696002 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 799/1606] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:42:03.757846 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 808/1607] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:42:03 2022] POST /identity/v3/projects => generated 377 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:03.761134 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23251a-4918-4036-ad70-6852c1e74a41 service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:03.771757 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23251a-4918-4036-ad70-6852c1e74a41 service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:03.778620 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:03.848389 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48bf37d-cfd2-4d25-8082-c64f8eb7cae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:03.849037 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bf37d-cfd2-4d25-8082-c64f8eb7cae8 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:03.849287 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bf37d-cfd2-4d25-8082-c64f8eb7cae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:03.849691 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bf37d-cfd2-4d25-8082-c64f8eb7cae8 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:03.850199 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48bf37d-cfd2-4d25-8082-c64f8eb7cae8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:03.852356 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48bf37d-cfd2-4d25-8082-c64f8eb7cae8 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:03.948751 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 800/1608] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:42:03 2022] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:42:03.952824 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d90b3-fb95-4802-b0f6-71d71c74df88 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:03.966779 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d90b3-fb95-4802-b0f6-71d71c74df88 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:03.974504 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a501186-2f98-4a85-86b4-fbead1e9638d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:03.977044 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a501186-2f98-4a85-86b4-fbead1e9638d admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:03.977559 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a501186-2f98-4a85-86b4-fbead1e9638d admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:03.978033 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a501186-2f98-4a85-86b4-fbead1e9638d admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:03.979077 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a501186-2f98-4a85-86b4-fbead1e9638d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:03.981154 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a501186-2f98-4a85-86b4-fbead1e9638d admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:03.995184 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 809/1609] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:04.003034 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48bf37d-cfd2-4d25-8082-c64f8eb7cae8 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:04.027051 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48bf37d-cfd2-4d25-8082-c64f8eb7cae8 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:04.034319 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326391d3-5805-4119-b994-61e126570310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:04.034938 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326391d3-5805-4119-b994-61e126570310 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:04.035215 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326391d3-5805-4119-b994-61e126570310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:04.035486 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326391d3-5805-4119-b994-61e126570310 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:04.036474 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326391d3-5805-4119-b994-61e126570310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:04.038103 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326391d3-5805-4119-b994-61e126570310 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:04.055072 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 801/1610] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:42:04.063033 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a501186-2f98-4a85-86b4-fbead1e9638d admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:04.078912 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a501186-2f98-4a85-86b4-fbead1e9638d admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:04.084821 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373babd-d8e4-4019-8f91-d513ba79463e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:04.086012 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373babd-d8e4-4019-8f91-d513ba79463e admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:04.086209 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373babd-d8e4-4019-8f91-d513ba79463e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:04.086493 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373babd-d8e4-4019-8f91-d513ba79463e admin admin] PATH_INFO: `/v3/projects/bbed708ed80f4d919374da9f9313535c/users/40d5e99dc632402e9844e068d5f097d2/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:04.104458 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373babd-d8e4-4019-8f91-d513ba79463e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbed708ed80f4d919374da9f9313535c, user_id=40d5e99dc632402e9844e068d5f097d2, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:04.107988 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373babd-d8e4-4019-8f91-d513ba79463e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:04.298572 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 810/1611] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:04 2022] PUT /identity/v3/projects/bbed708ed80f4d919374da9f9313535c/users/40d5e99dc632402e9844e068d5f097d2/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:04.309634 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12d219-8de3-48ed-a22d-cb71a7a3ca8c None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:04.309918 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12d219-8de3-48ed-a22d-cb71a7a3ca8c None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:04.310188 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12d219-8de3-48ed-a22d-cb71a7a3ca8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:04.340199 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-8f12d219-8de3-48ed-a22d-cb71a7a3ca8c None None] MFA Rules not processed for user `40d5e99dc632402e9844e068d5f097d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:04.341586 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-8f12d219-8de3-48ed-a22d-cb71a7a3ca8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:04.415223 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 802/1612] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:04.420022 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373babd-d8e4-4019-8f91-d513ba79463e admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:04.494586 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f12d219-8de3-48ed-a22d-cb71a7a3ca8c None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:04.499184 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-8f12d219-8de3-48ed-a22d-cb71a7a3ca8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:04.559307 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373babd-d8e4-4019-8f91-d513ba79463e admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:04.580373 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb1e8e-75a9-46b4-8525-c75c5e8f9acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:04.581116 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb1e8e-75a9-46b4-8525-c75c5e8f9acb admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:04.581464 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb1e8e-75a9-46b4-8525-c75c5e8f9acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:04.581802 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb1e8e-75a9-46b4-8525-c75c5e8f9acb admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:04.582524 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb1e8e-75a9-46b4-8525-c75c5e8f9acb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:04.584972 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb1e8e-75a9-46b4-8525-c75c5e8f9acb admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:04.628230 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f12d219-8de3-48ed-a22d-cb71a7a3ca8c None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:04.633217 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b8cc9-a8d6-4b6a-85f2-01d7357e45f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:04.634106 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b8cc9-a8d6-4b6a-85f2-01d7357e45f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:04.634349 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b8cc9-a8d6-4b6a-85f2-01d7357e45f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:04.634551 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b8cc9-a8d6-4b6a-85f2-01d7357e45f2 admin admin] PATH_INFO: `/v3/projects/4c59b8012df8456bb7b59f2eeb4fd321` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:04.635756 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7b8cc9-a8d6-4b6a-85f2-01d7357e45f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c59b8012df8456bb7b59f2eeb4fd321)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:04.637966 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7b8cc9-a8d6-4b6a-85f2-01d7357e45f2 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:04.701453 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 811/1613] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:42:04 2022] POST /identity/v3/projects => generated 375 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:04.701453 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb1e8e-75a9-46b4-8525-c75c5e8f9acb admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:04.765633 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb1e8e-75a9-46b4-8525-c75c5e8f9acb admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:04.770671 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf8c96-2886-4bcb-932a-9cb915794cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:04.771283 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf8c96-2886-4bcb-932a-9cb915794cd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:04.771564 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf8c96-2886-4bcb-932a-9cb915794cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:04.771836 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf8c96-2886-4bcb-932a-9cb915794cd2 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:04.772506 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf8c96-2886-4bcb-932a-9cb915794cd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:04.774543 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf8c96-2886-4bcb-932a-9cb915794cd2 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:04.824591 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-ea7b8cc9-a8d6-4b6a-85f2-01d7357e45f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c59b8012df8456bb7b59f2eeb4fd321', 'request_id': 'req-ea7b8cc9-a8d6-4b6a-85f2-01d7357e45f2'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:04.831332 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-ea7b8cc9-a8d6-4b6a-85f2-01d7357e45f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c59b8012df8456bb7b59f2eeb4fd321', 'request_id': 'req-ea7b8cc9-a8d6-4b6a-85f2-01d7357e45f2'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:04.845102 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-ea7b8cc9-a8d6-4b6a-85f2-01d7357e45f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c59b8012df8456bb7b59f2eeb4fd321', 'request_id': 'req-ea7b8cc9-a8d6-4b6a-85f2-01d7357e45f2'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:04.896410 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 812/1614] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:42:04 2022] POST /identity/v3/users => generated 294 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:42:04.900365 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf8c96-2886-4bcb-932a-9cb915794cd2 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:04.911013 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf8c96-2886-4bcb-932a-9cb915794cd2 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:04.937658 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-ea7b8cc9-a8d6-4b6a-85f2-01d7357e45f2 admin admin] The token cache is being invalidate because project 4c59b8012df8456bb7b59f2eeb4fd321 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:42:04.937949 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-ea7b8cc9-a8d6-4b6a-85f2-01d7357e45f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:04.939779 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-ea7b8cc9-a8d6-4b6a-85f2-01d7357e45f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:04.944821 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 803/1615] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:42:04 2022] DELETE /identity/v3/projects/4c59b8012df8456bb7b59f2eeb4fd321 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:04.945801 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b8cc9-a8d6-4b6a-85f2-01d7357e45f2 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:04.947457 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-ea7b8cc9-a8d6-4b6a-85f2-01d7357e45f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:04.978110 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58733e-5e63-40c8-84b6-227c4a3808b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:04.978991 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58733e-5e63-40c8-84b6-227c4a3808b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:04.978991 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58733e-5e63-40c8-84b6-227c4a3808b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:04.979282 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58733e-5e63-40c8-84b6-227c4a3808b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:04.979920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58733e-5e63-40c8-84b6-227c4a3808b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:04.982130 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58733e-5e63-40c8-84b6-227c4a3808b9 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:05.000786 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 813/1616] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:42:05.005662 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58733e-5e63-40c8-84b6-227c4a3808b9 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:05.013606 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2d58733e-5e63-40c8-84b6-227c4a3808b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:05.025536 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58733e-5e63-40c8-84b6-227c4a3808b9 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:05.030571 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61955069-374f-4e15-b398-5192d1f988e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:05.031223 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61955069-374f-4e15-b398-5192d1f988e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:05.031667 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61955069-374f-4e15-b398-5192d1f988e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:05.031938 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61955069-374f-4e15-b398-5192d1f988e6 admin admin] PATH_INFO: `/v3/projects/ee6c4cbe928c4b318c861fcf77e47b09/users/500e31d197ca49aa98461e3b9a1ea00c/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:05.049018 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b8cc9-a8d6-4b6a-85f2-01d7357e45f2 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:05.049018 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41702c7-3128-4278-aab9-41af1a6d9ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:05.049881 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41702c7-3128-4278-aab9-41af1a6d9ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:05.050159 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41702c7-3128-4278-aab9-41af1a6d9ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:05.050447 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41702c7-3128-4278-aab9-41af1a6d9ca5 admin admin] PATH_INFO: `/v3/users/9e192a124be4477f8ba3560605af7176` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:05.051632 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41702c7-3128-4278-aab9-41af1a6d9ca5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e192a124be4477f8ba3560605af7176)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:05.051986 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61955069-374f-4e15-b398-5192d1f988e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee6c4cbe928c4b318c861fcf77e47b09, user_id=500e31d197ca49aa98461e3b9a1ea00c, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:05.053592 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41702c7-3128-4278-aab9-41af1a6d9ca5 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:05.054814 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61955069-374f-4e15-b398-5192d1f988e6 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:05.193288 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 814/1617] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:05 2022] PUT /identity/v3/projects/ee6c4cbe928c4b318c861fcf77e47b09/users/500e31d197ca49aa98461e3b9a1ea00c/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:05.198454 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61955069-374f-4e15-b398-5192d1f988e6 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:05.279057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61955069-374f-4e15-b398-5192d1f988e6 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:05.305698 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b6109-1639-4e31-b9db-0572dc993832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:05.309129 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b6109-1639-4e31-b9db-0572dc993832 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:05.310372 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f41702c7-3128-4278-aab9-41af1a6d9ca5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e192a124be4477f8ba3560605af7176'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:05.311809 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b6109-1639-4e31-b9db-0572dc993832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:05.314508 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b6109-1639-4e31-b9db-0572dc993832 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:05.317625 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b6109-1639-4e31-b9db-0572dc993832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:05.324159 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b6109-1639-4e31-b9db-0572dc993832 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:05.328923 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f41702c7-3128-4278-aab9-41af1a6d9ca5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e192a124be4477f8ba3560605af7176'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:05.336415 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f41702c7-3128-4278-aab9-41af1a6d9ca5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e192a124be4477f8ba3560605af7176'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:05.337391 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f41702c7-3128-4278-aab9-41af1a6d9ca5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e192a124be4477f8ba3560605af7176'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:05.338151 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f41702c7-3128-4278-aab9-41af1a6d9ca5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e192a124be4477f8ba3560605af7176'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:05.359980 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 815/1618] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:05.362358 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b6109-1639-4e31-b9db-0572dc993832 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:05.364971 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-960b6109-1639-4e31-b9db-0572dc993832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:05.381350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b6109-1639-4e31-b9db-0572dc993832 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:05.387755 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d4ab8-f583-416f-b881-af0a0a68be3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:05.388491 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d4ab8-f583-416f-b881-af0a0a68be3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:05.388769 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d4ab8-f583-416f-b881-af0a0a68be3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:05.389042 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d4ab8-f583-416f-b881-af0a0a68be3e admin admin] PATH_INFO: `/v3/projects/ee6c4cbe928c4b318c861fcf77e47b09/users/500e31d197ca49aa98461e3b9a1ea00c/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:05.394473 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d4ab8-f583-416f-b881-af0a0a68be3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee6c4cbe928c4b318c861fcf77e47b09, user_id=500e31d197ca49aa98461e3b9a1ea00c, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:05.394473 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d4ab8-f583-416f-b881-af0a0a68be3e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:05.406433 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 816/1619] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:05 2022] PUT /identity/v3/projects/ee6c4cbe928c4b318c861fcf77e47b09/users/500e31d197ca49aa98461e3b9a1ea00c/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:05.417418 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc886a-13ef-4aa0-956d-99b1738445ec None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:05.417418 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc886a-13ef-4aa0-956d-99b1738445ec None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:05.423248 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc886a-13ef-4aa0-956d-99b1738445ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:05.425368 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 804/1620] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:42:04 2022] DELETE /identity/v3/users/9e192a124be4477f8ba3560605af7176 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:05.449949 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-69dc886a-13ef-4aa0-956d-99b1738445ec None None] MFA Rules not processed for user `500e31d197ca49aa98461e3b9a1ea00c`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:05.451452 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-69dc886a-13ef-4aa0-956d-99b1738445ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:05.544180 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 817/1621] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:05 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:05.557883 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41702c7-3128-4278-aab9-41af1a6d9ca5 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:05.559393 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f41702c7-3128-4278-aab9-41af1a6d9ca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:05.627713 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41702c7-3128-4278-aab9-41af1a6d9ca5 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:05.631880 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebc736-6ee8-44c5-b0ce-998fe91d70d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:05.632628 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebc736-6ee8-44c5-b0ce-998fe91d70d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:05.632864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebc736-6ee8-44c5-b0ce-998fe91d70d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:05.633130 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebc736-6ee8-44c5-b0ce-998fe91d70d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:05.635003 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a8ebc736-6ee8-44c5-b0ce-998fe91d70d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:05.699990 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ebc736-6ee8-44c5-b0ce-998fe91d70d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:05.701489 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ebc736-6ee8-44c5-b0ce-998fe91d70d2 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:05.711390 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 805/1622] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:05.765360 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:05.948915 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc886a-13ef-4aa0-956d-99b1738445ec None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:05.951090 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-69dc886a-13ef-4aa0-956d-99b1738445ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:06.020248 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc886a-13ef-4aa0-956d-99b1738445ec None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:06.024124 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1414c-6f38-447d-a15b-f0fb7950d454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:06.024756 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1414c-6f38-447d-a15b-f0fb7950d454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:06.025033 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1414c-6f38-447d-a15b-f0fb7950d454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:06.025307 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1414c-6f38-447d-a15b-f0fb7950d454 admin admin] PATH_INFO: `/v3/projects/84e22dd7c16442c5807ff6455776dcea` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:06.026422 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1414c-6f38-447d-a15b-f0fb7950d454 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84e22dd7c16442c5807ff6455776dcea)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:06.028466 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1414c-6f38-447d-a15b-f0fb7950d454 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:06.176777 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d3d1414c-6f38-447d-a15b-f0fb7950d454 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84e22dd7c16442c5807ff6455776dcea', 'request_id': 'req-d3d1414c-6f38-447d-a15b-f0fb7950d454'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:06.182163 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d3d1414c-6f38-447d-a15b-f0fb7950d454 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84e22dd7c16442c5807ff6455776dcea', 'request_id': 'req-d3d1414c-6f38-447d-a15b-f0fb7950d454'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:06.188343 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d3d1414c-6f38-447d-a15b-f0fb7950d454 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84e22dd7c16442c5807ff6455776dcea', 'request_id': 'req-d3d1414c-6f38-447d-a15b-f0fb7950d454'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:06.273632 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:06.309091 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d3d1414c-6f38-447d-a15b-f0fb7950d454 admin admin] The token cache is being invalidate because project 84e22dd7c16442c5807ff6455776dcea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:42:06.309728 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d3d1414c-6f38-447d-a15b-f0fb7950d454 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:06.311557 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d3d1414c-6f38-447d-a15b-f0fb7950d454 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:06.312850 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 818/1623] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:42:05 2022] DELETE /identity/v3/projects/84e22dd7c16442c5807ff6455776dcea => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:06.319570 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c077bee-a90a-446d-bf4f-c130c2b2df3c None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:06.320120 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c077bee-a90a-446d-bf4f-c130c2b2df3c None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:06.320335 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c077bee-a90a-446d-bf4f-c130c2b2df3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:06.343468 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-9c077bee-a90a-446d-bf4f-c130c2b2df3c None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:06.344735 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-9c077bee-a90a-446d-bf4f-c130c2b2df3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:06.406965 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 806/1624] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:06.415894 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65c546-f5e1-4f57-8f7d-ecdadf4f40eb None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:06.416282 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65c546-f5e1-4f57-8f7d-ecdadf4f40eb None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:06.416563 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65c546-f5e1-4f57-8f7d-ecdadf4f40eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:06.437037 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-8e65c546-f5e1-4f57-8f7d-ecdadf4f40eb None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:06.438278 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8e65c546-f5e1-4f57-8f7d-ecdadf4f40eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:06.448314 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 819/1625] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:06.453011 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c077bee-a90a-446d-bf4f-c130c2b2df3c None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:06.463997 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c077bee-a90a-446d-bf4f-c130c2b2df3c None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:06.469043 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0a128-b344-4eb7-8273-79c83786b283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:06.469667 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0a128-b344-4eb7-8273-79c83786b283 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:06.470028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0a128-b344-4eb7-8273-79c83786b283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:06.470305 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0a128-b344-4eb7-8273-79c83786b283 admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:06.470961 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0a128-b344-4eb7-8273-79c83786b283 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:42:06.471258 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0a128-b344-4eb7-8273-79c83786b283 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:06.472915 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0a128-b344-4eb7-8273-79c83786b283 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:06.485519 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 807/1626] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:42:06.490072 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65c546-f5e1-4f57-8f7d-ecdadf4f40eb None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:06.499799 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65c546-f5e1-4f57-8f7d-ecdadf4f40eb None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:06.505337 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e57a7-a573-47f0-97a1-ff595c6357a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:06.505963 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e57a7-a573-47f0-97a1-ff595c6357a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:06.506241 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e57a7-a573-47f0-97a1-ff595c6357a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:06.506509 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e57a7-a573-47f0-97a1-ff595c6357a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:06.507395 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e57a7-a573-47f0-97a1-ff595c6357a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:06.509362 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e57a7-a573-47f0-97a1-ff595c6357a4 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:06.650047 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 820/1627] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:42:06 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:42:06.654747 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0a128-b344-4eb7-8273-79c83786b283 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:06.667380 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0a128-b344-4eb7-8273-79c83786b283 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:06.726815 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb65a6-0f16-4153-acc4-8199709037c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:06.727508 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb65a6-0f16-4153-acc4-8199709037c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:06.727783 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb65a6-0f16-4153-acc4-8199709037c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:06.728138 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb65a6-0f16-4153-acc4-8199709037c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:06.728825 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb65a6-0f16-4153-acc4-8199709037c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:06.730810 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb65a6-0f16-4153-acc4-8199709037c1 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:06.842923 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 808/1628] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:42:06 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:42:06.844265 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e57a7-a573-47f0-97a1-ff595c6357a4 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:06.854531 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e57a7-a573-47f0-97a1-ff595c6357a4 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:06.859036 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f0b26-5365-41a8-8383-3d34842c6031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:06.859667 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f0b26-5365-41a8-8383-3d34842c6031 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:06.859942 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f0b26-5365-41a8-8383-3d34842c6031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:06.860242 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f0b26-5365-41a8-8383-3d34842c6031 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:06.861398 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f0b26-5365-41a8-8383-3d34842c6031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:06.863010 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f0b26-5365-41a8-8383-3d34842c6031 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:06.874635 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 821/1629] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:06.880907 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb65a6-0f16-4153-acc4-8199709037c1 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:06.891115 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb65a6-0f16-4153-acc4-8199709037c1 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:06.896322 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a184b-46f2-4398-a9ea-aeb825352629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:06.896833 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a184b-46f2-4398-a9ea-aeb825352629 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:06.897139 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a184b-46f2-4398-a9ea-aeb825352629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:06.897436 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a184b-46f2-4398-a9ea-aeb825352629 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:06.898063 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a184b-46f2-4398-a9ea-aeb825352629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:06.899651 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a184b-46f2-4398-a9ea-aeb825352629 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:06.910935 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 809/1630] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:06.938556 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f0b26-5365-41a8-8383-3d34842c6031 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:06.949727 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f0b26-5365-41a8-8383-3d34842c6031 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:06.954433 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf0207-bdf1-4bd7-94a1-c121a8fe9415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:06.955094 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf0207-bdf1-4bd7-94a1-c121a8fe9415 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:06.955366 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf0207-bdf1-4bd7-94a1-c121a8fe9415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:06.955636 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf0207-bdf1-4bd7-94a1-c121a8fe9415 admin admin] PATH_INFO: `/v3/projects/066b2a8fbcea472a83476c1a0b4f43b9/users/103998f30b094ac399e53a684f8d9185/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:06.972409 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdf0207-bdf1-4bd7-94a1-c121a8fe9415 admin admin] RBAC: Authorizing `identity:create_grant(project_id=066b2a8fbcea472a83476c1a0b4f43b9, user_id=103998f30b094ac399e53a684f8d9185, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:06.975054 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdf0207-bdf1-4bd7-94a1-c121a8fe9415 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:07.051831 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 822/1631] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:06 2022] PUT /identity/v3/projects/066b2a8fbcea472a83476c1a0b4f43b9/users/103998f30b094ac399e53a684f8d9185/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:07.063244 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf51a55-324d-48cb-bfa5-20cdf170a0f3 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:07.063558 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf51a55-324d-48cb-bfa5-20cdf170a0f3 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:07.064408 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf51a55-324d-48cb-bfa5-20cdf170a0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:07.074451 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:07.091851 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-5bf51a55-324d-48cb-bfa5-20cdf170a0f3 None None] MFA Rules not processed for user `103998f30b094ac399e53a684f8d9185`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:07.093135 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-5bf51a55-324d-48cb-bfa5-20cdf170a0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:07.148990 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:07.159423 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 810/1632] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:07.171095 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf0207-bdf1-4bd7-94a1-c121a8fe9415 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:07.172798 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8fdf0207-bdf1-4bd7-94a1-c121a8fe9415 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:07.230072 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf0207-bdf1-4bd7-94a1-c121a8fe9415 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:07.233665 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa9a8e-db99-4a68-ac56-278dc28fad57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:07.234270 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa9a8e-db99-4a68-ac56-278dc28fad57 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:07.234559 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa9a8e-db99-4a68-ac56-278dc28fad57 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:07.234809 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa9a8e-db99-4a68-ac56-278dc28fad57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:07.244089 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa9a8e-db99-4a68-ac56-278dc28fad57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:07.245501 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa9a8e-db99-4a68-ac56-278dc28fad57 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:07.254973 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 823/1633] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:08.023770 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:08.192708 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:08.704013 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:09.054668 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf51a55-324d-48cb-bfa5-20cdf170a0f3 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:09.064175 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf51a55-324d-48cb-bfa5-20cdf170a0f3 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:09.067987 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f8cea-42dd-4eef-8019-f2e5f4ba88d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:09.068636 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f8cea-42dd-4eef-8019-f2e5f4ba88d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:09.068909 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f8cea-42dd-4eef-8019-f2e5f4ba88d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:09.069174 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f8cea-42dd-4eef-8019-f2e5f4ba88d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:09.071256 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-657f8cea-42dd-4eef-8019-f2e5f4ba88d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:09.131037 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f8cea-42dd-4eef-8019-f2e5f4ba88d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:09.132522 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f8cea-42dd-4eef-8019-f2e5f4ba88d3 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:09.141425 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 811/1634] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:09.285722 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:09.325717 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:10.478723 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:10.765571 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:11.103794 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa9a8e-db99-4a68-ac56-278dc28fad57 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:11.110086 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa9a8e-db99-4a68-ac56-278dc28fad57 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:11.114067 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a495db2-258b-4f8d-ba16-96eed1826b74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:11.114692 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a495db2-258b-4f8d-ba16-96eed1826b74 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:11.114997 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a495db2-258b-4f8d-ba16-96eed1826b74 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:11.115265 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a495db2-258b-4f8d-ba16-96eed1826b74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:11.116997 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8a495db2-258b-4f8d-ba16-96eed1826b74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:11.180766 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a495db2-258b-4f8d-ba16-96eed1826b74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:11.182205 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a495db2-258b-4f8d-ba16-96eed1826b74 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:11.192424 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 824/1635] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:11 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:11.846217 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:11.931898 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:12.135433 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f8cea-42dd-4eef-8019-f2e5f4ba88d3 service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:12.196139 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f8cea-42dd-4eef-8019-f2e5f4ba88d3 service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:12.200697 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab248c-ce4b-4edd-95eb-7c5e0ac8f916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:12.201401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab248c-ce4b-4edd-95eb-7c5e0ac8f916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:12.201672 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab248c-ce4b-4edd-95eb-7c5e0ac8f916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:12.201938 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab248c-ce4b-4edd-95eb-7c5e0ac8f916 admin admin] PATH_INFO: `/v3/users/103998f30b094ac399e53a684f8d9185` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:12.203027 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab248c-ce4b-4edd-95eb-7c5e0ac8f916 admin admin] RBAC: Authorizing `identity:delete_user(user_id=103998f30b094ac399e53a684f8d9185)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:12.205194 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab248c-ce4b-4edd-95eb-7c5e0ac8f916 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:12.440416 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-75ab248c-ce4b-4edd-95eb-7c5e0ac8f916 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '103998f30b094ac399e53a684f8d9185'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:12.451656 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-75ab248c-ce4b-4edd-95eb-7c5e0ac8f916 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '103998f30b094ac399e53a684f8d9185'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:12.459192 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-75ab248c-ce4b-4edd-95eb-7c5e0ac8f916 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '103998f30b094ac399e53a684f8d9185'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:12.460006 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-75ab248c-ce4b-4edd-95eb-7c5e0ac8f916 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '103998f30b094ac399e53a684f8d9185'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:12.460896 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-75ab248c-ce4b-4edd-95eb-7c5e0ac8f916 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '103998f30b094ac399e53a684f8d9185'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:12.490319 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a495db2-258b-4f8d-ba16-96eed1826b74 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:12.491727 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8a495db2-258b-4f8d-ba16-96eed1826b74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:12.506746 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a495db2-258b-4f8d-ba16-96eed1826b74 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:12.511200 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85f93a-85fd-4593-aadc-75abdee6c850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:12.511818 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85f93a-85fd-4593-aadc-75abdee6c850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:12.512117 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85f93a-85fd-4593-aadc-75abdee6c850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:12.512437 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85f93a-85fd-4593-aadc-75abdee6c850 admin admin] PATH_INFO: `/v3/users/6a087e23dcd04756ac9837d080812f87` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:12.513659 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a85f93a-85fd-4593-aadc-75abdee6c850 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a087e23dcd04756ac9837d080812f87)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:12.515525 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a85f93a-85fd-4593-aadc-75abdee6c850 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:12.536238 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 812/1636] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:42:12 2022] DELETE /identity/v3/users/103998f30b094ac399e53a684f8d9185 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:12.540795 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfae692-614e-4f92-8a08-0fd0a4d5fff4 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:12.541296 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfae692-614e-4f92-8a08-0fd0a4d5fff4 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:12.541720 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfae692-614e-4f92-8a08-0fd0a4d5fff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:12.563373 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-edfae692-614e-4f92-8a08-0fd0a4d5fff4 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:12.565278 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-edfae692-614e-4f92-8a08-0fd0a4d5fff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:12.664038 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 813/1637] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:12.676653 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfae692-614e-4f92-8a08-0fd0a4d5fff4 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:12.678289 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-edfae692-614e-4f92-8a08-0fd0a4d5fff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:12.727851 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4a85f93a-85fd-4593-aadc-75abdee6c850 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a087e23dcd04756ac9837d080812f87'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:12.753678 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4a85f93a-85fd-4593-aadc-75abdee6c850 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a087e23dcd04756ac9837d080812f87'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:12.754793 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4a85f93a-85fd-4593-aadc-75abdee6c850 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a087e23dcd04756ac9837d080812f87'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:12.770089 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4a85f93a-85fd-4593-aadc-75abdee6c850 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a087e23dcd04756ac9837d080812f87'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:12.770930 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4a85f93a-85fd-4593-aadc-75abdee6c850 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a087e23dcd04756ac9837d080812f87'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:12.778640 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfae692-614e-4f92-8a08-0fd0a4d5fff4 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:12.782839 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491bb981-beca-47d1-beb4-fdd663146450 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:12.783529 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bb981-beca-47d1-beb4-fdd663146450 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:12.783866 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bb981-beca-47d1-beb4-fdd663146450 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:12.784241 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bb981-beca-47d1-beb4-fdd663146450 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:12.786015 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-491bb981-beca-47d1-beb4-fdd663146450 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:12.800243 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491bb981-beca-47d1-beb4-fdd663146450 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:12.801660 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491bb981-beca-47d1-beb4-fdd663146450 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:12.812250 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 814/1638] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:42:12.898271 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 825/1639] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:42:12 2022] DELETE /identity/v3/users/6a087e23dcd04756ac9837d080812f87 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:12.902915 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d9b91-94fe-4f8a-8716-86f0c16e77cd None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:12.903374 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d9b91-94fe-4f8a-8716-86f0c16e77cd None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:12.903448 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d9b91-94fe-4f8a-8716-86f0c16e77cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:12.926265 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-397d9b91-94fe-4f8a-8716-86f0c16e77cd None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:12.928025 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-397d9b91-94fe-4f8a-8716-86f0c16e77cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:13.005304 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 815/1640] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:13.012543 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85f93a-85fd-4593-aadc-75abdee6c850 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:13.016549 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4a85f93a-85fd-4593-aadc-75abdee6c850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:13.092806 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85f93a-85fd-4593-aadc-75abdee6c850 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:13.097215 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e71ed-acfa-4705-ac7c-dbefd8d9d8ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:13.097916 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e71ed-acfa-4705-ac7c-dbefd8d9d8ad service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:13.098194 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e71ed-acfa-4705-ac7c-dbefd8d9d8ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:13.098461 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e71ed-acfa-4705-ac7c-dbefd8d9d8ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:13.117457 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e71ed-acfa-4705-ac7c-dbefd8d9d8ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:13.118947 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e71ed-acfa-4705-ac7c-dbefd8d9d8ad service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:13.128812 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 826/1641] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:42:13.131584 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:13.323083 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d9b91-94fe-4f8a-8716-86f0c16e77cd None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:13.325458 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-397d9b91-94fe-4f8a-8716-86f0c16e77cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:13.356299 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d9b91-94fe-4f8a-8716-86f0c16e77cd None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:13.362412 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8889e08-690d-47fe-9d68-de60e52df5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:13.363430 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8889e08-690d-47fe-9d68-de60e52df5fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:13.363803 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8889e08-690d-47fe-9d68-de60e52df5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:13.364216 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8889e08-690d-47fe-9d68-de60e52df5fa admin admin] PATH_INFO: `/v3/projects/066b2a8fbcea472a83476c1a0b4f43b9` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:13.365593 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8889e08-690d-47fe-9d68-de60e52df5fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=066b2a8fbcea472a83476c1a0b4f43b9)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:13.367957 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8889e08-690d-47fe-9d68-de60e52df5fa admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:13.514104 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f8889e08-690d-47fe-9d68-de60e52df5fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '066b2a8fbcea472a83476c1a0b4f43b9', 'request_id': 'req-f8889e08-690d-47fe-9d68-de60e52df5fa'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:13.522286 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f8889e08-690d-47fe-9d68-de60e52df5fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '066b2a8fbcea472a83476c1a0b4f43b9', 'request_id': 'req-f8889e08-690d-47fe-9d68-de60e52df5fa'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:13.530272 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f8889e08-690d-47fe-9d68-de60e52df5fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '066b2a8fbcea472a83476c1a0b4f43b9', 'request_id': 'req-f8889e08-690d-47fe-9d68-de60e52df5fa'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:13.623630 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f8889e08-690d-47fe-9d68-de60e52df5fa admin admin] The token cache is being invalidate because project 066b2a8fbcea472a83476c1a0b4f43b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:42:13.623929 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f8889e08-690d-47fe-9d68-de60e52df5fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:13.624598 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f8889e08-690d-47fe-9d68-de60e52df5fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:13.629087 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 816/1642] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:42:13 2022] DELETE /identity/v3/projects/066b2a8fbcea472a83476c1a0b4f43b9 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:13.633842 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f590322-a8fd-453b-b618-1f5926972afa None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:13.634126 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f590322-a8fd-453b-b618-1f5926972afa None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:13.634401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f590322-a8fd-453b-b618-1f5926972afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:13.655961 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-2f590322-a8fd-453b-b618-1f5926972afa None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:13.657386 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2f590322-a8fd-453b-b618-1f5926972afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:13.717408 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 827/1643] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:13.725374 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f374c4-651f-405e-866f-5210fc7816c1 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:13.725611 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f374c4-651f-405e-866f-5210fc7816c1 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:13.725878 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f374c4-651f-405e-866f-5210fc7816c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:13.748600 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-66f374c4-651f-405e-866f-5210fc7816c1 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:13.750714 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-66f374c4-651f-405e-866f-5210fc7816c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:13.761184 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f590322-a8fd-453b-b618-1f5926972afa None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:13.762677 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2f590322-a8fd-453b-b618-1f5926972afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:13.766308 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 817/1644] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:13.767586 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f374c4-651f-405e-866f-5210fc7816c1 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:13.781016 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f374c4-651f-405e-866f-5210fc7816c1 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:13.786487 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97f4f3-d3c7-4593-813f-69c1fc691f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:13.787413 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97f4f3-d3c7-4593-813f-69c1fc691f19 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:13.787698 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97f4f3-d3c7-4593-813f-69c1fc691f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:13.788135 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97f4f3-d3c7-4593-813f-69c1fc691f19 admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:13.788991 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97f4f3-d3c7-4593-813f-69c1fc691f19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:42:13.789297 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97f4f3-d3c7-4593-813f-69c1fc691f19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:13.790663 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f590322-a8fd-453b-b618-1f5926972afa None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:13.790954 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97f4f3-d3c7-4593-813f-69c1fc691f19 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:13.801002 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5533679-1374-401d-b5f4-9777e6495312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:13.801992 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5533679-1374-401d-b5f4-9777e6495312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:13.802419 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5533679-1374-401d-b5f4-9777e6495312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:13.802831 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5533679-1374-401d-b5f4-9777e6495312 admin admin] PATH_INFO: `/v3/projects/d98fb90f84494767b775a4a055ef59ab` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:13.805024 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5533679-1374-401d-b5f4-9777e6495312 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d98fb90f84494767b775a4a055ef59ab)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:13.808268 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 818/1645] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:42:13.808577 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5533679-1374-401d-b5f4-9777e6495312 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:13.813060 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97f4f3-d3c7-4593-813f-69c1fc691f19 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:13.828078 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97f4f3-d3c7-4593-813f-69c1fc691f19 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:13.834193 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202c409-c723-4166-b4e5-fcd65db41268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:13.840483 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:13.848519 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202c409-c723-4166-b4e5-fcd65db41268 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:13.848964 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202c409-c723-4166-b4e5-fcd65db41268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:13.849963 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202c409-c723-4166-b4e5-fcd65db41268 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:13.851576 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7202c409-c723-4166-b4e5-fcd65db41268 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:13.858010 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7202c409-c723-4166-b4e5-fcd65db41268 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:13.942668 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b5533679-1374-401d-b5f4-9777e6495312 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd98fb90f84494767b775a4a055ef59ab', 'request_id': 'req-b5533679-1374-401d-b5f4-9777e6495312'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:13.958716 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b5533679-1374-401d-b5f4-9777e6495312 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd98fb90f84494767b775a4a055ef59ab', 'request_id': 'req-b5533679-1374-401d-b5f4-9777e6495312'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:13.971033 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b5533679-1374-401d-b5f4-9777e6495312 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd98fb90f84494767b775a4a055ef59ab', 'request_id': 'req-b5533679-1374-401d-b5f4-9777e6495312'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:14.024780 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 819/1646] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:42:13 2022] POST /identity/v3/projects => generated 391 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:42:14.027836 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202c409-c723-4166-b4e5-fcd65db41268 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:14.089391 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202c409-c723-4166-b4e5-fcd65db41268 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:14.093945 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520fc7f-bcff-4303-9519-567087830950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:14.094547 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520fc7f-bcff-4303-9519-567087830950 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:14.094830 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520fc7f-bcff-4303-9519-567087830950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:14.095118 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520fc7f-bcff-4303-9519-567087830950 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:14.095884 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520fc7f-bcff-4303-9519-567087830950 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:14.097810 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520fc7f-bcff-4303-9519-567087830950 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:14.113589 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b5533679-1374-401d-b5f4-9777e6495312 admin admin] The token cache is being invalidate because project d98fb90f84494767b775a4a055ef59ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:42:14.114125 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b5533679-1374-401d-b5f4-9777e6495312 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:14.114692 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b5533679-1374-401d-b5f4-9777e6495312 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:14.116417 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 828/1647] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:42:13 2022] DELETE /identity/v3/projects/d98fb90f84494767b775a4a055ef59ab => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:42:14.121008 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a8e56-a0c9-4739-b30d-a2dbcfe75862 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:14.121335 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a8e56-a0c9-4739-b30d-a2dbcfe75862 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:14.121612 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a8e56-a0c9-4739-b30d-a2dbcfe75862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:14.141643 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-a87a8e56-a0c9-4739-b30d-a2dbcfe75862 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:14.143606 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a87a8e56-a0c9-4739-b30d-a2dbcfe75862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:14.151508 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 829/1648] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:42:14.159933 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a9910-fcd8-421b-b585-0b437b44ea37 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:14.160254 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a9910-fcd8-421b-b585-0b437b44ea37 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:14.160532 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a9910-fcd8-421b-b585-0b437b44ea37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:14.179877 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-c30a9910-fcd8-421b-b585-0b437b44ea37 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:14.181145 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c30a9910-fcd8-421b-b585-0b437b44ea37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:14.191460 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 830/1649] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:42:14.195554 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a9910-fcd8-421b-b585-0b437b44ea37 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:14.205614 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a9910-fcd8-421b-b585-0b437b44ea37 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:14.210278 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03ed1c-2118-41a0-9794-c18292d9d1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:14.210878 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03ed1c-2118-41a0-9794-c18292d9d1a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:14.218502 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03ed1c-2118-41a0-9794-c18292d9d1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:14.218502 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03ed1c-2118-41a0-9794-c18292d9d1a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:14.218502 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b03ed1c-2118-41a0-9794-c18292d9d1a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:42:14.218502 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b03ed1c-2118-41a0-9794-c18292d9d1a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:14.218502 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b03ed1c-2118-41a0-9794-c18292d9d1a6 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:14.225815 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 831/1650] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:42:14.230218 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03ed1c-2118-41a0-9794-c18292d9d1a6 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:14.240960 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03ed1c-2118-41a0-9794-c18292d9d1a6 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:14.245853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556dcbca-0874-4692-b7a1-c3d80ee5bcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:14.246461 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556dcbca-0874-4692-b7a1-c3d80ee5bcb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:14.251745 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556dcbca-0874-4692-b7a1-c3d80ee5bcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:14.251745 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556dcbca-0874-4692-b7a1-c3d80ee5bcb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:14.251745 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556dcbca-0874-4692-b7a1-c3d80ee5bcb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:14.252129 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 820/1651] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:42:14 2022] POST /identity/v3/users => generated 296 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:42:14.252224 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556dcbca-0874-4692-b7a1-c3d80ee5bcb4 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:14.253331 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520fc7f-bcff-4303-9519-567087830950 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:14.256039 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-5520fc7f-bcff-4303-9519-567087830950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:14.271322 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520fc7f-bcff-4303-9519-567087830950 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:14.276140 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd454d-c868-48ac-9ef5-a7ce63496cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:14.276785 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd454d-c868-48ac-9ef5-a7ce63496cfe admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:14.281664 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd454d-c868-48ac-9ef5-a7ce63496cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:14.281664 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd454d-c868-48ac-9ef5-a7ce63496cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:14.281664 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd454d-c868-48ac-9ef5-a7ce63496cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:14.281664 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd454d-c868-48ac-9ef5-a7ce63496cfe admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:14.291857 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 821/1652] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:42:14.295762 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd454d-c868-48ac-9ef5-a7ce63496cfe admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:14.306902 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd454d-c868-48ac-9ef5-a7ce63496cfe admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:14.312443 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c875ac-a708-4131-8dca-4adece57e5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:14.312443 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c875ac-a708-4131-8dca-4adece57e5e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:14.312443 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c875ac-a708-4131-8dca-4adece57e5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:14.312706 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c875ac-a708-4131-8dca-4adece57e5e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:14.313295 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c875ac-a708-4131-8dca-4adece57e5e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:14.315698 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c875ac-a708-4131-8dca-4adece57e5e7 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:14.328511 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 822/1653] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:42:14.331115 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c875ac-a708-4131-8dca-4adece57e5e7 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:14.340666 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c875ac-a708-4131-8dca-4adece57e5e7 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:14.345905 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea9953-87fd-45c9-bfd2-e7affc6de202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:14.347154 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea9953-87fd-45c9-bfd2-e7affc6de202 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:14.347154 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea9953-87fd-45c9-bfd2-e7affc6de202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:14.348381 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea9953-87fd-45c9-bfd2-e7affc6de202 admin admin] PATH_INFO: `/v3/projects/3036f4440ed44495b7b811ac6b9c8d19/users/5fc4016e6a294663a9ce946404a39f93/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:14.374350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 832/1654] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:42:14 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:42:14.380104 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556dcbca-0874-4692-b7a1-c3d80ee5bcb4 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:14.381004 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea9953-87fd-45c9-bfd2-e7affc6de202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3036f4440ed44495b7b811ac6b9c8d19, user_id=5fc4016e6a294663a9ce946404a39f93, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:14.384106 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea9953-87fd-45c9-bfd2-e7affc6de202 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:14.429454 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:14.451449 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556dcbca-0874-4692-b7a1-c3d80ee5bcb4 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:14.457603 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a7d56-f915-4969-8dc2-0ca1eaa751e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:14.458507 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a7d56-f915-4969-8dc2-0ca1eaa751e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:14.458507 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a7d56-f915-4969-8dc2-0ca1eaa751e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:14.458680 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a7d56-f915-4969-8dc2-0ca1eaa751e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:14.459353 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a7d56-f915-4969-8dc2-0ca1eaa751e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:14.461385 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a7d56-f915-4969-8dc2-0ca1eaa751e7 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:14.481484 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 823/1655] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:14 2022] PUT /identity/v3/projects/3036f4440ed44495b7b811ac6b9c8d19/users/5fc4016e6a294663a9ce946404a39f93/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:42:14.493036 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc6e70-448c-4f00-868f-e5af13c64f4c None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:14.493338 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc6e70-448c-4f00-868f-e5af13c64f4c None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:14.493610 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc6e70-448c-4f00-868f-e5af13c64f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:14.521617 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-a9cc6e70-448c-4f00-868f-e5af13c64f4c None None] MFA Rules not processed for user `5fc4016e6a294663a9ce946404a39f93`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:14.522925 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a9cc6e70-448c-4f00-868f-e5af13c64f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:14.556105 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 833/1656] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:42:14 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:14.560130 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a7d56-f915-4969-8dc2-0ca1eaa751e7 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:14.571020 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a7d56-f915-4969-8dc2-0ca1eaa751e7 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:14.593090 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 824/1657] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:14 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:42:14.605512 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc6e70-448c-4f00-868f-e5af13c64f4c None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:14.607779 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a9cc6e70-448c-4f00-868f-e5af13c64f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:14.656664 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ece217-a9e1-4dd9-af86-c05353b84149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:14.657823 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ece217-a9e1-4dd9-af86-c05353b84149 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:14.658103 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ece217-a9e1-4dd9-af86-c05353b84149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:14.658375 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ece217-a9e1-4dd9-af86-c05353b84149 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:14.659339 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ece217-a9e1-4dd9-af86-c05353b84149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:14.661519 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ece217-a9e1-4dd9-af86-c05353b84149 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:14.674538 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc6e70-448c-4f00-868f-e5af13c64f4c None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:14.678421 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 834/1658] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:14.678573 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c3efa-a8fa-4549-b6e3-c3adf94abb61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:14.679076 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c3efa-a8fa-4549-b6e3-c3adf94abb61 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:14.679586 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c3efa-a8fa-4549-b6e3-c3adf94abb61 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:14.679845 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c3efa-a8fa-4549-b6e3-c3adf94abb61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:14.680203 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ece217-a9e1-4dd9-af86-c05353b84149 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:14.690433 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982c3efa-a8fa-4549-b6e3-c3adf94abb61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:14.692408 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982c3efa-a8fa-4549-b6e3-c3adf94abb61 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:14.695048 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ece217-a9e1-4dd9-af86-c05353b84149 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:14.701651 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f298f-0808-49f1-92a5-da978e0eb5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:14.702493 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f298f-0808-49f1-92a5-da978e0eb5ce admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:14.702870 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 825/1659] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:14 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:14.703165 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f298f-0808-49f1-92a5-da978e0eb5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:14.703445 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f298f-0808-49f1-92a5-da978e0eb5ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:14.704308 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f298f-0808-49f1-92a5-da978e0eb5ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:14.706082 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f298f-0808-49f1-92a5-da978e0eb5ce admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:14.722554 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 835/1660] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:42:14.726717 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c3efa-a8fa-4549-b6e3-c3adf94abb61 service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:14.739646 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c3efa-a8fa-4549-b6e3-c3adf94abb61 service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:14.744812 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771025b-405b-43f5-b624-a7c905ee5e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:14.745293 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771025b-405b-43f5-b624-a7c905ee5e8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:14.745571 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771025b-405b-43f5-b624-a7c905ee5e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:14.745845 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771025b-405b-43f5-b624-a7c905ee5e8a admin admin] PATH_INFO: `/v3/projects/4c0b2da1108d45afa3c1788a74159784/users/ab6c3390f67d4b6197e8af78bac779e1/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:14.761483 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771025b-405b-43f5-b624-a7c905ee5e8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c0b2da1108d45afa3c1788a74159784, user_id=ab6c3390f67d4b6197e8af78bac779e1, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:14.764405 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771025b-405b-43f5-b624-a7c905ee5e8a admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:14.840003 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 826/1661] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:14 2022] PUT /identity/v3/projects/4c0b2da1108d45afa3c1788a74159784/users/ab6c3390f67d4b6197e8af78bac779e1/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:14.851018 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b62c1c-e84f-4edf-a543-ea787b60d3c9 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:14.851303 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b62c1c-e84f-4edf-a543-ea787b60d3c9 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:14.851577 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b62c1c-e84f-4edf-a543-ea787b60d3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:14.881224 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-45b62c1c-e84f-4edf-a543-ea787b60d3c9 None None] MFA Rules not processed for user `ab6c3390f67d4b6197e8af78bac779e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:14.882473 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-45b62c1c-e84f-4edf-a543-ea787b60d3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:14.917216 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:14.963744 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 836/1662] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:15.069755 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771025b-405b-43f5-b624-a7c905ee5e8a admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:15.071461 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-4771025b-405b-43f5-b624-a7c905ee5e8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:15.141889 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771025b-405b-43f5-b624-a7c905ee5e8a admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:15.146615 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d216af-e374-4270-8864-12b14e298dad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:15.147572 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d216af-e374-4270-8864-12b14e298dad service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:15.147856 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d216af-e374-4270-8864-12b14e298dad service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:15.148221 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d216af-e374-4270-8864-12b14e298dad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:15.158503 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d216af-e374-4270-8864-12b14e298dad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:15.159942 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d216af-e374-4270-8864-12b14e298dad service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:15.176398 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 827/1663] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:15.400593 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:16.210700 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:16.494790 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b62c1c-e84f-4edf-a543-ea787b60d3c9 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:16.496317 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-45b62c1c-e84f-4edf-a543-ea787b60d3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:16.591789 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b62c1c-e84f-4edf-a543-ea787b60d3c9 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:16.599320 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8bee6-b964-4b10-a3cb-478aa66c9ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:16.600299 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8bee6-b964-4b10-a3cb-478aa66c9ea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:16.600782 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8bee6-b964-4b10-a3cb-478aa66c9ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:16.601220 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8bee6-b964-4b10-a3cb-478aa66c9ea2 admin admin] PATH_INFO: `/v3/users/b2c56a5ba0054c5c98a76169a4fc124c` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:16.602561 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8bee6-b964-4b10-a3cb-478aa66c9ea2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2c56a5ba0054c5c98a76169a4fc124c)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:16.605290 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8bee6-b964-4b10-a3cb-478aa66c9ea2 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:16.844400 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4ba8bee6-b964-4b10-a3cb-478aa66c9ea2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2c56a5ba0054c5c98a76169a4fc124c'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:16.859821 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4ba8bee6-b964-4b10-a3cb-478aa66c9ea2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2c56a5ba0054c5c98a76169a4fc124c'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:16.861283 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4ba8bee6-b964-4b10-a3cb-478aa66c9ea2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2c56a5ba0054c5c98a76169a4fc124c'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:16.869612 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4ba8bee6-b964-4b10-a3cb-478aa66c9ea2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2c56a5ba0054c5c98a76169a4fc124c'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:16.870591 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4ba8bee6-b964-4b10-a3cb-478aa66c9ea2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2c56a5ba0054c5c98a76169a4fc124c'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:17.013207 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 837/1664] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:42:16 2022] DELETE /identity/v3/users/b2c56a5ba0054c5c98a76169a4fc124c => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:17.013880 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54604775-6f22-46a8-8717-53a4a19e9f15 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:17.014344 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54604775-6f22-46a8-8717-53a4a19e9f15 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:17.014460 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54604775-6f22-46a8-8717-53a4a19e9f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:17.039916 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-54604775-6f22-46a8-8717-53a4a19e9f15 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:17.041457 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-54604775-6f22-46a8-8717-53a4a19e9f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:17.150421 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 828/1665] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:17.161249 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8bee6-b964-4b10-a3cb-478aa66c9ea2 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:17.162819 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4ba8bee6-b964-4b10-a3cb-478aa66c9ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:17.242452 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8bee6-b964-4b10-a3cb-478aa66c9ea2 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:17.246336 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc94ea-932a-4962-a787-110892b4d37c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:17.246943 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc94ea-932a-4962-a787-110892b4d37c service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:17.247218 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc94ea-932a-4962-a787-110892b4d37c service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:17.247485 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc94ea-932a-4962-a787-110892b4d37c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:17.257001 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc94ea-932a-4962-a787-110892b4d37c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:17.258419 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc94ea-932a-4962-a787-110892b4d37c service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:17.268330 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 838/1666] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:17.554892 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:17.716738 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54604775-6f22-46a8-8717-53a4a19e9f15 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:17.718192 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-54604775-6f22-46a8-8717-53a4a19e9f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:17.731797 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54604775-6f22-46a8-8717-53a4a19e9f15 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:17.772579 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb8124-e441-4372-852f-e29641705cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:17.774426 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb8124-e441-4372-852f-e29641705cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:17.774913 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb8124-e441-4372-852f-e29641705cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:17.782832 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb8124-e441-4372-852f-e29641705cc5 admin admin] PATH_INFO: `/v3/projects/623e77c72135421f8a7f85b52706c84d` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:17.782832 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb8124-e441-4372-852f-e29641705cc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=623e77c72135421f8a7f85b52706c84d)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:17.785555 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb8124-e441-4372-852f-e29641705cc5 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:17.957477 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-0efb8124-e441-4372-852f-e29641705cc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '623e77c72135421f8a7f85b52706c84d', 'request_id': 'req-0efb8124-e441-4372-852f-e29641705cc5'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:17.965362 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-0efb8124-e441-4372-852f-e29641705cc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '623e77c72135421f8a7f85b52706c84d', 'request_id': 'req-0efb8124-e441-4372-852f-e29641705cc5'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:17.974449 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-0efb8124-e441-4372-852f-e29641705cc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '623e77c72135421f8a7f85b52706c84d', 'request_id': 'req-0efb8124-e441-4372-852f-e29641705cc5'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:18.113112 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-0efb8124-e441-4372-852f-e29641705cc5 admin admin] The token cache is being invalidate because project 623e77c72135421f8a7f85b52706c84d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:42:18.115652 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-0efb8124-e441-4372-852f-e29641705cc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:18.116689 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-0efb8124-e441-4372-852f-e29641705cc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:18.119208 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 829/1667] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:42:17 2022] DELETE /identity/v3/projects/623e77c72135421f8a7f85b52706c84d => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:18.123255 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc94ea-932a-4962-a787-110892b4d37c service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:18.146593 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc94ea-932a-4962-a787-110892b4d37c service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:18.265107 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1d61f-a6d8-44e5-a459-f4996e0e753c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:18.265973 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1d61f-a6d8-44e5-a459-f4996e0e753c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:18.266321 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1d61f-a6d8-44e5-a459-f4996e0e753c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:18.267124 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1d61f-a6d8-44e5-a459-f4996e0e753c admin admin] PATH_INFO: `/v3/users/40d5e99dc632402e9844e068d5f097d2` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:18.269045 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1d61f-a6d8-44e5-a459-f4996e0e753c admin admin] RBAC: Authorizing `identity:delete_user(user_id=40d5e99dc632402e9844e068d5f097d2)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:18.271193 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1d61f-a6d8-44e5-a459-f4996e0e753c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:18.622775 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-acb1d61f-a6d8-44e5-a459-f4996e0e753c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40d5e99dc632402e9844e068d5f097d2'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:18.637793 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-acb1d61f-a6d8-44e5-a459-f4996e0e753c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40d5e99dc632402e9844e068d5f097d2'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:18.638555 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-acb1d61f-a6d8-44e5-a459-f4996e0e753c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40d5e99dc632402e9844e068d5f097d2'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:18.646901 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-acb1d61f-a6d8-44e5-a459-f4996e0e753c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40d5e99dc632402e9844e068d5f097d2'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:18.647856 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-acb1d61f-a6d8-44e5-a459-f4996e0e753c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40d5e99dc632402e9844e068d5f097d2'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:18.756529 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 839/1668] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:42:18 2022] DELETE /identity/v3/users/40d5e99dc632402e9844e068d5f097d2 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:42:18.930413 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:19.134509 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944218c-05eb-4f9e-b767-4da2c852afd2 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:19.135011 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944218c-05eb-4f9e-b767-4da2c852afd2 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:19.136514 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944218c-05eb-4f9e-b767-4da2c852afd2 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:19.137101 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 830/1669] 10.222.0.16 () {54 vars in 921 bytes} [Wed Nov 2 07:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:42:19.149471 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9e8c2-2407-4ca1-8350-d89d7860d2a9 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:19.149759 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9e8c2-2407-4ca1-8350-d89d7860d2a9 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:19.150038 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9e8c2-2407-4ca1-8350-d89d7860d2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:19.170568 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-fff9e8c2-2407-4ca1-8350-d89d7860d2a9 None None] MFA Rules not processed for user `741c9fc71c80438faa037c85f4997c3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:19.171781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-fff9e8c2-2407-4ca1-8350-d89d7860d2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:19.241920 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944218c-05eb-4f9e-b767-4da2c852afd2 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:19.244359 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-9944218c-05eb-4f9e-b767-4da2c852afd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:19.282376 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 840/1670] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Nov 2 07:42:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:19.295763 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024f360-b7d2-4841-8f6e-66a4873f5431 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:19.295948 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024f360-b7d2-4841-8f6e-66a4873f5431 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:19.296358 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024f360-b7d2-4841-8f6e-66a4873f5431 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:19.312821 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 841/1671] 10.222.0.16 () {54 vars in 961 bytes} [Wed Nov 2 07:42:19 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:42:19.315284 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024f360-b7d2-4841-8f6e-66a4873f5431 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:19.317881 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d024f360-b7d2-4841-8f6e-66a4873f5431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:19.381185 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944218c-05eb-4f9e-b767-4da2c852afd2 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:19.386024 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1a94c-1cd9-4470-9d8e-adfeab1ac51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:19.386668 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1a94c-1cd9-4470-9d8e-adfeab1ac51f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:19.386931 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1a94c-1cd9-4470-9d8e-adfeab1ac51f admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:19.387197 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1a94c-1cd9-4470-9d8e-adfeab1ac51f admin admin] PATH_INFO: `/v3/projects/bbed708ed80f4d919374da9f9313535c` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:19.388331 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1a94c-1cd9-4470-9d8e-adfeab1ac51f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbed708ed80f4d919374da9f9313535c)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:19.391429 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1a94c-1cd9-4470-9d8e-adfeab1ac51f admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:19.397984 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024f360-b7d2-4841-8f6e-66a4873f5431 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:19.402539 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d529b-e137-4de1-a3e1-87d882f294d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:19.403171 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d529b-e137-4de1-a3e1-87d882f294d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:19.403447 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d529b-e137-4de1-a3e1-87d882f294d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:19.403719 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d529b-e137-4de1-a3e1-87d882f294d9 admin admin] PATH_INFO: `/v3/users/ef0c95e28e4c439d8bf52b2fc8297444` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:19.405155 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d529b-e137-4de1-a3e1-87d882f294d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef0c95e28e4c439d8bf52b2fc8297444)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:19.407088 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d529b-e137-4de1-a3e1-87d882f294d9 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:19.537590 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4eb1a94c-1cd9-4470-9d8e-adfeab1ac51f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbed708ed80f4d919374da9f9313535c', 'request_id': 'req-4eb1a94c-1cd9-4470-9d8e-adfeab1ac51f'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:19.548944 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4eb1a94c-1cd9-4470-9d8e-adfeab1ac51f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbed708ed80f4d919374da9f9313535c', 'request_id': 'req-4eb1a94c-1cd9-4470-9d8e-adfeab1ac51f'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:19.552190 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4eb1a94c-1cd9-4470-9d8e-adfeab1ac51f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbed708ed80f4d919374da9f9313535c', 'request_id': 'req-4eb1a94c-1cd9-4470-9d8e-adfeab1ac51f'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:19.628089 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4eb1a94c-1cd9-4470-9d8e-adfeab1ac51f admin admin] The token cache is being invalidate because project bbed708ed80f4d919374da9f9313535c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:42:19.628389 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4eb1a94c-1cd9-4470-9d8e-adfeab1ac51f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:19.629035 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4eb1a94c-1cd9-4470-9d8e-adfeab1ac51f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:19.630588 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 831/1672] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:42:19 2022] DELETE /identity/v3/projects/bbed708ed80f4d919374da9f9313535c => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:19.634700 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9f316-be29-4f0e-8567-831ebbccb769 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:19.634989 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9f316-be29-4f0e-8567-831ebbccb769 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:19.635256 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9f316-be29-4f0e-8567-831ebbccb769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:19.637209 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3d6d529b-e137-4de1-a3e1-87d882f294d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef0c95e28e4c439d8bf52b2fc8297444'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:19.657859 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-54e9f316-be29-4f0e-8567-831ebbccb769 None None] MFA Rules not processed for user `741c9fc71c80438faa037c85f4997c3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:19.659179 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-54e9f316-be29-4f0e-8567-831ebbccb769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:19.659497 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3d6d529b-e137-4de1-a3e1-87d882f294d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef0c95e28e4c439d8bf52b2fc8297444'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:19.660377 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3d6d529b-e137-4de1-a3e1-87d882f294d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef0c95e28e4c439d8bf52b2fc8297444'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:19.669399 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3d6d529b-e137-4de1-a3e1-87d882f294d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef0c95e28e4c439d8bf52b2fc8297444'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:19.670159 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3d6d529b-e137-4de1-a3e1-87d882f294d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef0c95e28e4c439d8bf52b2fc8297444'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:19.724766 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 832/1673] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Nov 2 07:42:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:19.725610 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9f316-be29-4f0e-8567-831ebbccb769 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:19.726920 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-54e9f316-be29-4f0e-8567-831ebbccb769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:19.765864 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 842/1674] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:42:19 2022] DELETE /identity/v3/users/ef0c95e28e4c439d8bf52b2fc8297444 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:19.767598 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d529b-e137-4de1-a3e1-87d882f294d9 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:19.801536 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9f316-be29-4f0e-8567-831ebbccb769 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:19.841853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d529b-e137-4de1-a3e1-87d882f294d9 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:19.857056 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de215350-4259-4592-ae0c-13885d2a758a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '741c9fc71c80438faa037c85f4997c3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:19.857360 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de215350-4259-4592-ae0c-13885d2a758a service placement] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:19.857653 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de215350-4259-4592-ae0c-13885d2a758a service placement] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:19.857910 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de215350-4259-4592-ae0c-13885d2a758a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:19.860575 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-de215350-4259-4592-ae0c-13885d2a758a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:19.870906 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba0c19-e492-4142-8447-b32df5ae0a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:19.878909 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba0c19-e492-4142-8447-b32df5ae0a27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:19.878909 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba0c19-e492-4142-8447-b32df5ae0a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:19.878909 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba0c19-e492-4142-8447-b32df5ae0a27 admin admin] PATH_INFO: `/v3/users/500e31d197ca49aa98461e3b9a1ea00c` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:19.878909 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba0c19-e492-4142-8447-b32df5ae0a27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=500e31d197ca49aa98461e3b9a1ea00c)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:19.878909 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba0c19-e492-4142-8447-b32df5ae0a27 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:19.879801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de215350-4259-4592-ae0c-13885d2a758a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:19.881508 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de215350-4259-4592-ae0c-13885d2a758a service placement] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:19.894021 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 843/1675] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:20.038762 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de215350-4259-4592-ae0c-13885d2a758a service placement] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:20.041536 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-de215350-4259-4592-ae0c-13885d2a758a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:20.064931 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de215350-4259-4592-ae0c-13885d2a758a service placement] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:20.064931 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a8583-7369-4dbe-b7c3-c0b7bbbbefdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:20.065592 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a8583-7369-4dbe-b7c3-c0b7bbbbefdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:20.065929 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a8583-7369-4dbe-b7c3-c0b7bbbbefdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:20.066206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a8583-7369-4dbe-b7c3-c0b7bbbbefdd admin admin] PATH_INFO: `/v3/projects/b29011f7d4f8427ab0286481f97d5e0e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:20.067373 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a8583-7369-4dbe-b7c3-c0b7bbbbefdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b29011f7d4f8427ab0286481f97d5e0e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:20.069331 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a8583-7369-4dbe-b7c3-c0b7bbbbefdd admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:20.099853 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b2ba0c19-e492-4142-8447-b32df5ae0a27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '500e31d197ca49aa98461e3b9a1ea00c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:20.111698 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b2ba0c19-e492-4142-8447-b32df5ae0a27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '500e31d197ca49aa98461e3b9a1ea00c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:20.118550 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b2ba0c19-e492-4142-8447-b32df5ae0a27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '500e31d197ca49aa98461e3b9a1ea00c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:20.119497 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b2ba0c19-e492-4142-8447-b32df5ae0a27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '500e31d197ca49aa98461e3b9a1ea00c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:20.119976 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b2ba0c19-e492-4142-8447-b32df5ae0a27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '500e31d197ca49aa98461e3b9a1ea00c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:20.223312 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 833/1676] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:42:19 2022] DELETE /identity/v3/users/500e31d197ca49aa98461e3b9a1ea00c => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:20.237608 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-482a8583-7369-4dbe-b7c3-c0b7bbbbefdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b29011f7d4f8427ab0286481f97d5e0e', 'request_id': 'req-482a8583-7369-4dbe-b7c3-c0b7bbbbefdd'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:20.247069 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-482a8583-7369-4dbe-b7c3-c0b7bbbbefdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b29011f7d4f8427ab0286481f97d5e0e', 'request_id': 'req-482a8583-7369-4dbe-b7c3-c0b7bbbbefdd'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:20.255354 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-482a8583-7369-4dbe-b7c3-c0b7bbbbefdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b29011f7d4f8427ab0286481f97d5e0e', 'request_id': 'req-482a8583-7369-4dbe-b7c3-c0b7bbbbefdd'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:20.364928 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-482a8583-7369-4dbe-b7c3-c0b7bbbbefdd admin admin] The token cache is being invalidate because project b29011f7d4f8427ab0286481f97d5e0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:42:20.365489 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-482a8583-7369-4dbe-b7c3-c0b7bbbbefdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:20.367380 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-482a8583-7369-4dbe-b7c3-c0b7bbbbefdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:20.369833 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 844/1677] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:42:20 2022] DELETE /identity/v3/projects/b29011f7d4f8427ab0286481f97d5e0e => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:42:20.374450 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dfcd9c-0423-411a-83bb-4634af9ccdc8 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:20.374735 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dfcd9c-0423-411a-83bb-4634af9ccdc8 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:20.375007 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dfcd9c-0423-411a-83bb-4634af9ccdc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:20.401702 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-b7dfcd9c-0423-411a-83bb-4634af9ccdc8 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:20.403078 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-b7dfcd9c-0423-411a-83bb-4634af9ccdc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:20.477667 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:20.495247 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 834/1678] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:20.504520 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d5e10-028b-4abb-ad7a-4da17a12d263 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:20.505183 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d5e10-028b-4abb-ad7a-4da17a12d263 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:20.505637 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d5e10-028b-4abb-ad7a-4da17a12d263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:20.540353 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-f29d5e10-028b-4abb-ad7a-4da17a12d263 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:20.542453 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f29d5e10-028b-4abb-ad7a-4da17a12d263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:20.559126 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 845/1679] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:20.560500 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dfcd9c-0423-411a-83bb-4634af9ccdc8 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:20.573433 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dfcd9c-0423-411a-83bb-4634af9ccdc8 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:20.578344 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc6261-20cb-4faa-ab3e-fef0e18fd1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:20.579984 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc6261-20cb-4faa-ab3e-fef0e18fd1ae admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:20.580293 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc6261-20cb-4faa-ab3e-fef0e18fd1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:20.580561 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc6261-20cb-4faa-ab3e-fef0e18fd1ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:20.581205 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc6261-20cb-4faa-ab3e-fef0e18fd1ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:42:20.581504 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc6261-20cb-4faa-ab3e-fef0e18fd1ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:20.583115 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc6261-20cb-4faa-ab3e-fef0e18fd1ae admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:20.599054 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 835/1680] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:42:20.600258 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d5e10-028b-4abb-ad7a-4da17a12d263 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:20.610559 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d5e10-028b-4abb-ad7a-4da17a12d263 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:20.616638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769e5dc-855b-4076-8f3a-503fde79bc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:20.617495 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769e5dc-855b-4076-8f3a-503fde79bc09 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:20.617770 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769e5dc-855b-4076-8f3a-503fde79bc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:20.618035 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769e5dc-855b-4076-8f3a-503fde79bc09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:20.619024 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9769e5dc-855b-4076-8f3a-503fde79bc09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:20.621429 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9769e5dc-855b-4076-8f3a-503fde79bc09 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:20.758565 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc6261-20cb-4faa-ab3e-fef0e18fd1ae admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:20.760524 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e4fc6261-20cb-4faa-ab3e-fef0e18fd1ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:20.761305 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 846/1681] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:42:20 2022] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:42:20.765382 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769e5dc-855b-4076-8f3a-503fde79bc09 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:20.835159 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769e5dc-855b-4076-8f3a-503fde79bc09 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:20.840717 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e253cc-7bf1-42ae-ac49-41ac906f8464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:20.840867 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc6261-20cb-4faa-ab3e-fef0e18fd1ae admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:20.841329 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e253cc-7bf1-42ae-ac49-41ac906f8464 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:20.841605 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e253cc-7bf1-42ae-ac49-41ac906f8464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:20.841874 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e253cc-7bf1-42ae-ac49-41ac906f8464 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:20.842507 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e253cc-7bf1-42ae-ac49-41ac906f8464 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:20.844495 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e253cc-7bf1-42ae-ac49-41ac906f8464 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:20.890513 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820fbeb-576f-4a4b-865f-adc6e5a4afa8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:20.891179 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820fbeb-576f-4a4b-865f-adc6e5a4afa8 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:20.891469 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820fbeb-576f-4a4b-865f-adc6e5a4afa8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:20.892461 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820fbeb-576f-4a4b-865f-adc6e5a4afa8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:20.894301 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-1820fbeb-576f-4a4b-865f-adc6e5a4afa8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:20.949024 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 847/1682] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:42:20 2022] POST /identity/v3/users => generated 288 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:20.952862 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e253cc-7bf1-42ae-ac49-41ac906f8464 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:20.955038 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-56e253cc-7bf1-42ae-ac49-41ac906f8464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:20.956304 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1820fbeb-576f-4a4b-865f-adc6e5a4afa8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:20.957741 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1820fbeb-576f-4a4b-865f-adc6e5a4afa8 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:20.967545 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e253cc-7bf1-42ae-ac49-41ac906f8464 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:20.967868 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 836/1683] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:42:20.968713 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820fbeb-576f-4a4b-865f-adc6e5a4afa8 service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:20.972593 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187db7d-4e1f-4042-bb3f-9e285495b0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:20.973299 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187db7d-4e1f-4042-bb3f-9e285495b0e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:20.973485 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187db7d-4e1f-4042-bb3f-9e285495b0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:20.974209 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187db7d-4e1f-4042-bb3f-9e285495b0e5 admin admin] PATH_INFO: `/v3/projects/ee6c4cbe928c4b318c861fcf77e47b09` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:20.975225 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187db7d-4e1f-4042-bb3f-9e285495b0e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee6c4cbe928c4b318c861fcf77e47b09)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:20.976796 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187db7d-4e1f-4042-bb3f-9e285495b0e5 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:20.978756 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820fbeb-576f-4a4b-865f-adc6e5a4afa8 service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:20.983465 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57500353-652a-4115-97ee-4fb93208ad72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:20.984097 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57500353-652a-4115-97ee-4fb93208ad72 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:20.984384 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57500353-652a-4115-97ee-4fb93208ad72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:20.984657 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57500353-652a-4115-97ee-4fb93208ad72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:20.985294 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57500353-652a-4115-97ee-4fb93208ad72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:20.987045 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57500353-652a-4115-97ee-4fb93208ad72 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:21.001963 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 837/1684] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:21.003757 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57500353-652a-4115-97ee-4fb93208ad72 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:21.017946 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57500353-652a-4115-97ee-4fb93208ad72 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:21.023235 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e5e03-299e-4920-b8af-a8aa8f6de7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:21.024017 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e5e03-299e-4920-b8af-a8aa8f6de7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:21.024328 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e5e03-299e-4920-b8af-a8aa8f6de7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:21.024627 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e5e03-299e-4920-b8af-a8aa8f6de7c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:21.025558 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e5e03-299e-4920-b8af-a8aa8f6de7c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:21.027177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e5e03-299e-4920-b8af-a8aa8f6de7c1 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:21.037853 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 838/1685] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:21.042035 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e5e03-299e-4920-b8af-a8aa8f6de7c1 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:21.053032 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e5e03-299e-4920-b8af-a8aa8f6de7c1 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:21.057925 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15086979-293e-4867-969b-2f50366938c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:21.058578 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15086979-293e-4867-969b-2f50366938c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:21.058858 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15086979-293e-4867-969b-2f50366938c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:21.059132 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15086979-293e-4867-969b-2f50366938c7 admin admin] PATH_INFO: `/v3/projects/c9231f89e3124db5afa272acc5d3c430/users/a483f57a4bab4d499d8fa8585d8622d3/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:21.074824 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15086979-293e-4867-969b-2f50366938c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9231f89e3124db5afa272acc5d3c430, user_id=a483f57a4bab4d499d8fa8585d8622d3, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:21.077495 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15086979-293e-4867-969b-2f50366938c7 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:21.150616 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 839/1686] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:21 2022] PUT /identity/v3/projects/c9231f89e3124db5afa272acc5d3c430/users/a483f57a4bab4d499d8fa8585d8622d3/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:42:21.156084 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6becf-82fe-48e0-883f-16c8caa5631b None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:21.156327 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6becf-82fe-48e0-883f-16c8caa5631b None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:21.157497 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6becf-82fe-48e0-883f-16c8caa5631b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:21.165066 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7187db7d-4e1f-4042-bb3f-9e285495b0e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee6c4cbe928c4b318c861fcf77e47b09', 'request_id': 'req-7187db7d-4e1f-4042-bb3f-9e285495b0e5'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:21.181451 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7187db7d-4e1f-4042-bb3f-9e285495b0e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee6c4cbe928c4b318c861fcf77e47b09', 'request_id': 'req-7187db7d-4e1f-4042-bb3f-9e285495b0e5'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:21.185420 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7187db7d-4e1f-4042-bb3f-9e285495b0e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee6c4cbe928c4b318c861fcf77e47b09', 'request_id': 'req-7187db7d-4e1f-4042-bb3f-9e285495b0e5'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:21.194400 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-e4c6becf-82fe-48e0-883f-16c8caa5631b None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:21.195815 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e4c6becf-82fe-48e0-883f-16c8caa5631b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:21.257143 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 840/1687] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:42:21.269321 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6becf-82fe-48e0-883f-16c8caa5631b None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:21.271058 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e4c6becf-82fe-48e0-883f-16c8caa5631b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:21.274475 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7187db7d-4e1f-4042-bb3f-9e285495b0e5 admin admin] The token cache is being invalidate because project ee6c4cbe928c4b318c861fcf77e47b09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:42:21.278899 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7187db7d-4e1f-4042-bb3f-9e285495b0e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:21.278899 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7187db7d-4e1f-4042-bb3f-9e285495b0e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:21.278899 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 848/1688] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:42:20 2022] DELETE /identity/v3/projects/ee6c4cbe928c4b318c861fcf77e47b09 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:21.282814 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838db9e0-a97b-4cac-99a0-77a1fd7c3ed7 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:21.283389 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838db9e0-a97b-4cac-99a0-77a1fd7c3ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:21.283763 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838db9e0-a97b-4cac-99a0-77a1fd7c3ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:21.302304 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:21.308484 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-838db9e0-a97b-4cac-99a0-77a1fd7c3ed7 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:21.309706 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-838db9e0-a97b-4cac-99a0-77a1fd7c3ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:21.318630 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 849/1689] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:21.326947 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37eccaf-3f4d-4674-bafa-95b987e524f8 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:21.327298 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37eccaf-3f4d-4674-bafa-95b987e524f8 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:21.327615 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37eccaf-3f4d-4674-bafa-95b987e524f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:21.334877 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6becf-82fe-48e0-883f-16c8caa5631b None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:21.338987 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a941754-00cc-40b3-8856-f70b90cf14af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:21.339591 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a941754-00cc-40b3-8856-f70b90cf14af service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:21.339874 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a941754-00cc-40b3-8856-f70b90cf14af service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:21.340183 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a941754-00cc-40b3-8856-f70b90cf14af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:21.342396 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-3a941754-00cc-40b3-8856-f70b90cf14af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:21.348021 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-e37eccaf-3f4d-4674-bafa-95b987e524f8 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:21.349213 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e37eccaf-3f4d-4674-bafa-95b987e524f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:21.355804 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a941754-00cc-40b3-8856-f70b90cf14af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:21.357265 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 850/1690] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:42:21.357403 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a941754-00cc-40b3-8856-f70b90cf14af service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:21.361754 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37eccaf-3f4d-4674-bafa-95b987e524f8 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:21.370815 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37eccaf-3f4d-4674-bafa-95b987e524f8 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:21.375907 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0492013-7628-40e2-94c9-a774882a9dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:21.377175 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0492013-7628-40e2-94c9-a774882a9dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:21.377517 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0492013-7628-40e2-94c9-a774882a9dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:21.377782 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0492013-7628-40e2-94c9-a774882a9dd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:21.378432 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0492013-7628-40e2-94c9-a774882a9dd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:42:21.378714 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0492013-7628-40e2-94c9-a774882a9dd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:21.379507 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 841/1691] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:21.380445 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0492013-7628-40e2-94c9-a774882a9dd6 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:21.392604 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 851/1692] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:42:21.397070 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a941754-00cc-40b3-8856-f70b90cf14af service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:21.406939 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a941754-00cc-40b3-8856-f70b90cf14af service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:21.412676 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e7b72-39bd-4d33-a1d0-7a47f2b61215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:21.413278 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e7b72-39bd-4d33-a1d0-7a47f2b61215 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:21.413559 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e7b72-39bd-4d33-a1d0-7a47f2b61215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:21.413836 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e7b72-39bd-4d33-a1d0-7a47f2b61215 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:21.414472 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e7b72-39bd-4d33-a1d0-7a47f2b61215 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:21.416380 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e7b72-39bd-4d33-a1d0-7a47f2b61215 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:21.533632 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 842/1693] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:42:21 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:21.544980 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0492013-7628-40e2-94c9-a774882a9dd6 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:21.549357 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0492013-7628-40e2-94c9-a774882a9dd6 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:21.610177 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb273d-4b40-4d32-ac44-9872deaf7e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:21.611488 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb273d-4b40-4d32-ac44-9872deaf7e33 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:21.611767 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb273d-4b40-4d32-ac44-9872deaf7e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:21.612038 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb273d-4b40-4d32-ac44-9872deaf7e33 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:21.612930 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb273d-4b40-4d32-ac44-9872deaf7e33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:21.614619 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb273d-4b40-4d32-ac44-9872deaf7e33 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:21.714616 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 852/1694] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:42:21 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:21.721963 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e7b72-39bd-4d33-a1d0-7a47f2b61215 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:21.729832 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e7b72-39bd-4d33-a1d0-7a47f2b61215 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:21.737334 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145fae0d-954d-4841-b1f5-3db217697a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:21.738167 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145fae0d-954d-4841-b1f5-3db217697a2c admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:21.738377 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145fae0d-954d-4841-b1f5-3db217697a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:21.738745 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145fae0d-954d-4841-b1f5-3db217697a2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:21.739370 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145fae0d-954d-4841-b1f5-3db217697a2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:21.741044 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145fae0d-954d-4841-b1f5-3db217697a2c admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:21.751835 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 843/1695] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:21.755977 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb273d-4b40-4d32-ac44-9872deaf7e33 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:21.766185 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb273d-4b40-4d32-ac44-9872deaf7e33 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:21.771443 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540dc6b-8482-46df-937e-57892fb89b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:21.774468 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540dc6b-8482-46df-937e-57892fb89b50 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:21.774468 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540dc6b-8482-46df-937e-57892fb89b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:21.774468 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540dc6b-8482-46df-937e-57892fb89b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:21.774468 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540dc6b-8482-46df-937e-57892fb89b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:21.774849 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540dc6b-8482-46df-937e-57892fb89b50 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:21.786306 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 853/1696] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:21.790316 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145fae0d-954d-4841-b1f5-3db217697a2c admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:21.801139 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145fae0d-954d-4841-b1f5-3db217697a2c admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:21.805691 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7708dc59-6ad7-4fca-ab75-9f72c4a72c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:21.806331 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708dc59-6ad7-4fca-ab75-9f72c4a72c91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:21.806609 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708dc59-6ad7-4fca-ab75-9f72c4a72c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:21.806878 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708dc59-6ad7-4fca-ab75-9f72c4a72c91 admin admin] PATH_INFO: `/v3/projects/fcf75e095a35443a8f8fac69f465af59/users/852e9a8e27c640c985fca3476a3ae853/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:21.822168 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7708dc59-6ad7-4fca-ab75-9f72c4a72c91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcf75e095a35443a8f8fac69f465af59, user_id=852e9a8e27c640c985fca3476a3ae853, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:21.825223 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7708dc59-6ad7-4fca-ab75-9f72c4a72c91 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:21.916139 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 844/1697] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:21 2022] PUT /identity/v3/projects/fcf75e095a35443a8f8fac69f465af59/users/852e9a8e27c640c985fca3476a3ae853/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:21.927652 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef41553-d1d6-4ba1-b814-c40fbfbf8a00 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:21.927939 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef41553-d1d6-4ba1-b814-c40fbfbf8a00 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:21.928333 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef41553-d1d6-4ba1-b814-c40fbfbf8a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:21.959415 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-2ef41553-d1d6-4ba1-b814-c40fbfbf8a00 None None] MFA Rules not processed for user `852e9a8e27c640c985fca3476a3ae853`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:21.960894 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2ef41553-d1d6-4ba1-b814-c40fbfbf8a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:22.036118 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 854/1698] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:22.037998 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7708dc59-6ad7-4fca-ab75-9f72c4a72c91 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:22.120380 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7708dc59-6ad7-4fca-ab75-9f72c4a72c91 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:22.122069 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2a0ee-3df4-495e-9229-a036612f7418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:22.122675 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2a0ee-3df4-495e-9229-a036612f7418 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:22.123322 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2a0ee-3df4-495e-9229-a036612f7418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:22.123593 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2a0ee-3df4-495e-9229-a036612f7418 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:22.124304 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2a0ee-3df4-495e-9229-a036612f7418 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:22.126423 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2a0ee-3df4-495e-9229-a036612f7418 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:22.223721 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 845/1699] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:42:22 2022] POST /identity/v3/projects => generated 383 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:42:22.229538 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef41553-d1d6-4ba1-b814-c40fbfbf8a00 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:22.246499 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef41553-d1d6-4ba1-b814-c40fbfbf8a00 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:22.331461 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed655c-d7f3-4f47-b2fd-8a16d326c584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:22.332197 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed655c-d7f3-4f47-b2fd-8a16d326c584 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:22.332479 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed655c-d7f3-4f47-b2fd-8a16d326c584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:22.332751 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed655c-d7f3-4f47-b2fd-8a16d326c584 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:22.333396 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed655c-d7f3-4f47-b2fd-8a16d326c584 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:22.335426 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed655c-d7f3-4f47-b2fd-8a16d326c584 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:22.446239 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:22.455361 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 855/1700] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:42:22 2022] POST /identity/v3/users => generated 292 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:22.460413 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2a0ee-3df4-495e-9229-a036612f7418 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:22.472109 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2a0ee-3df4-495e-9229-a036612f7418 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:22.476695 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a42e82-fff1-49cc-9a85-370863776014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:22.477327 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a42e82-fff1-49cc-9a85-370863776014 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:22.477604 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a42e82-fff1-49cc-9a85-370863776014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:22.477876 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a42e82-fff1-49cc-9a85-370863776014 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:22.478533 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a42e82-fff1-49cc-9a85-370863776014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:22.480160 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a42e82-fff1-49cc-9a85-370863776014 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:22.492555 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 846/1701] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:22.496608 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed655c-d7f3-4f47-b2fd-8a16d326c584 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:22.506860 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed655c-d7f3-4f47-b2fd-8a16d326c584 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:22.511681 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d65b30-16b6-4f7d-87ac-e51e2da1c473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:22.512520 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d65b30-16b6-4f7d-87ac-e51e2da1c473 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:22.512828 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d65b30-16b6-4f7d-87ac-e51e2da1c473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:22.513103 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d65b30-16b6-4f7d-87ac-e51e2da1c473 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:22.513772 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d65b30-16b6-4f7d-87ac-e51e2da1c473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:22.515371 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d65b30-16b6-4f7d-87ac-e51e2da1c473 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:22.529287 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 856/1702] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:22.533481 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a42e82-fff1-49cc-9a85-370863776014 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:22.543672 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a42e82-fff1-49cc-9a85-370863776014 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:22.548872 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ec68f-ac8e-45d3-b828-14a041b8eb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:22.549635 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ec68f-ac8e-45d3-b828-14a041b8eb89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:22.549934 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ec68f-ac8e-45d3-b828-14a041b8eb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:22.550182 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ec68f-ac8e-45d3-b828-14a041b8eb89 admin admin] PATH_INFO: `/v3/projects/35149f95cb344090b98290f6abca33e9/users/cb21db700c214735b878eb1cd2acd99e/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:22.572292 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628ec68f-ac8e-45d3-b828-14a041b8eb89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35149f95cb344090b98290f6abca33e9, user_id=cb21db700c214735b878eb1cd2acd99e, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:22.575281 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628ec68f-ac8e-45d3-b828-14a041b8eb89 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:22.737746 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 847/1703] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:22 2022] PUT /identity/v3/projects/35149f95cb344090b98290f6abca33e9/users/cb21db700c214735b878eb1cd2acd99e/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:22.750221 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85aa2b6-d416-4d8b-8330-078c5c2ada12 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:22.750889 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85aa2b6-d416-4d8b-8330-078c5c2ada12 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:22.751371 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85aa2b6-d416-4d8b-8330-078c5c2ada12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:22.862202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-f85aa2b6-d416-4d8b-8330-078c5c2ada12 None None] MFA Rules not processed for user `cb21db700c214735b878eb1cd2acd99e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:22.871585 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f85aa2b6-d416-4d8b-8330-078c5c2ada12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:22.996391 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 857/1704] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:42:23.001755 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ec68f-ac8e-45d3-b828-14a041b8eb89 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:23.031004 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85aa2b6-d416-4d8b-8330-078c5c2ada12 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:23.032515 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f85aa2b6-d416-4d8b-8330-078c5c2ada12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:23.077789 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ec68f-ac8e-45d3-b828-14a041b8eb89 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:23.083509 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5eb8d-21cb-4e5f-80fa-53f41e56a42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:23.084157 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5eb8d-21cb-4e5f-80fa-53f41e56a42b admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:23.084575 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5eb8d-21cb-4e5f-80fa-53f41e56a42b admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:23.085239 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5eb8d-21cb-4e5f-80fa-53f41e56a42b admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:23.086021 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b5eb8d-21cb-4e5f-80fa-53f41e56a42b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:23.088159 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b5eb8d-21cb-4e5f-80fa-53f41e56a42b admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:23.150063 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85aa2b6-d416-4d8b-8330-078c5c2ada12 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:23.168364 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a4932-48c0-4559-bf3a-0e67f3036ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:23.170196 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a4932-48c0-4559-bf3a-0e67f3036ac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:23.170543 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a4932-48c0-4559-bf3a-0e67f3036ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:23.171165 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a4932-48c0-4559-bf3a-0e67f3036ac4 admin admin] PATH_INFO: `/v3/users/ab6c3390f67d4b6197e8af78bac779e1` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:23.172711 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3a4932-48c0-4559-bf3a-0e67f3036ac4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab6c3390f67d4b6197e8af78bac779e1)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:23.175464 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3a4932-48c0-4559-bf3a-0e67f3036ac4 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:23.230370 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 848/1705] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:42:22 2022] POST /identity/v3/projects => generated 385 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:23.234700 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5eb8d-21cb-4e5f-80fa-53f41e56a42b admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:23.281580 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:23.298929 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5eb8d-21cb-4e5f-80fa-53f41e56a42b admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:23.304035 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf41917-9afd-4fc5-994c-a7bd375d2405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:23.304851 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf41917-9afd-4fc5-994c-a7bd375d2405 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:23.305188 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf41917-9afd-4fc5-994c-a7bd375d2405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:23.305559 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf41917-9afd-4fc5-994c-a7bd375d2405 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:23.306302 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf41917-9afd-4fc5-994c-a7bd375d2405 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:23.316989 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf41917-9afd-4fc5-994c-a7bd375d2405 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:23.396354 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3f3a4932-48c0-4559-bf3a-0e67f3036ac4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab6c3390f67d4b6197e8af78bac779e1'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:23.410026 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3f3a4932-48c0-4559-bf3a-0e67f3036ac4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab6c3390f67d4b6197e8af78bac779e1'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:23.411255 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3f3a4932-48c0-4559-bf3a-0e67f3036ac4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab6c3390f67d4b6197e8af78bac779e1'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:23.417877 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 849/1706] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:42:23 2022] POST /identity/v3/users => generated 299 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:42:23.421591 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3f3a4932-48c0-4559-bf3a-0e67f3036ac4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab6c3390f67d4b6197e8af78bac779e1'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:23.422616 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3f3a4932-48c0-4559-bf3a-0e67f3036ac4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab6c3390f67d4b6197e8af78bac779e1'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:23.423653 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf41917-9afd-4fc5-994c-a7bd375d2405 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:23.429182 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-adf41917-9afd-4fc5-994c-a7bd375d2405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:23.444597 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf41917-9afd-4fc5-994c-a7bd375d2405 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:23.455236 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9641d0-938f-47e5-8681-c8b4265d0e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:23.455236 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9641d0-938f-47e5-8681-c8b4265d0e71 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:23.455236 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9641d0-938f-47e5-8681-c8b4265d0e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:23.455236 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9641d0-938f-47e5-8681-c8b4265d0e71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:23.456188 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9641d0-938f-47e5-8681-c8b4265d0e71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:23.456834 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9641d0-938f-47e5-8681-c8b4265d0e71 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:23.471276 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 850/1707] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:42:23.475180 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9641d0-938f-47e5-8681-c8b4265d0e71 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:23.485958 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9641d0-938f-47e5-8681-c8b4265d0e71 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:23.490907 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6cdf1-d43a-4347-88df-dd0c8cffa7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:23.491559 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6cdf1-d43a-4347-88df-dd0c8cffa7ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:23.491837 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6cdf1-d43a-4347-88df-dd0c8cffa7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:23.492139 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6cdf1-d43a-4347-88df-dd0c8cffa7ba admin admin] PATH_INFO: `/v3/projects/9331f651509844e1b13b19dde7068f4e/users/f6725d4ff5624c1fa394d4e035d6706c/roles/9252c356af254127896f3626d925a88a` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:23.507676 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c6cdf1-d43a-4347-88df-dd0c8cffa7ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=9331f651509844e1b13b19dde7068f4e, user_id=f6725d4ff5624c1fa394d4e035d6706c, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:23.510181 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c6cdf1-d43a-4347-88df-dd0c8cffa7ba admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:23.570812 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 858/1708] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:42:23 2022] DELETE /identity/v3/users/ab6c3390f67d4b6197e8af78bac779e1 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:23.575196 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93fe66-245c-4062-9ec5-299d740ae19a None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:23.575495 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93fe66-245c-4062-9ec5-299d740ae19a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:23.575756 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93fe66-245c-4062-9ec5-299d740ae19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:23.594604 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-0c93fe66-245c-4062-9ec5-299d740ae19a None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:23.596142 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0c93fe66-245c-4062-9ec5-299d740ae19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:23.640361 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 851/1709] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:23 2022] PUT /identity/v3/projects/9331f651509844e1b13b19dde7068f4e/users/f6725d4ff5624c1fa394d4e035d6706c/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:23.644436 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6cdf1-d43a-4347-88df-dd0c8cffa7ba admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:23.667297 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:23.668244 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 859/1710] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:42:23.677362 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93fe66-245c-4062-9ec5-299d740ae19a None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:23.678608 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0c93fe66-245c-4062-9ec5-299d740ae19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:23.726634 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6cdf1-d43a-4347-88df-dd0c8cffa7ba admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:23.745485 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837fba0-4d71-433f-950c-baed94786671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:23.746179 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837fba0-4d71-433f-950c-baed94786671 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:23.746398 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837fba0-4d71-433f-950c-baed94786671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:23.746670 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837fba0-4d71-433f-950c-baed94786671 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:23.748523 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d837fba0-4d71-433f-950c-baed94786671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:23.750420 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93fe66-245c-4062-9ec5-299d740ae19a None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:23.750710 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d837fba0-4d71-433f-950c-baed94786671 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:23.769081 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 852/1711] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:42:23.776896 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837fba0-4d71-433f-950c-baed94786671 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:23.790813 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837fba0-4d71-433f-950c-baed94786671 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:23.801433 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f522f-b84b-4198-ad37-ca517dfad2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:23.802032 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f522f-b84b-4198-ad37-ca517dfad2d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:23.802313 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f522f-b84b-4198-ad37-ca517dfad2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:23.802597 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f522f-b84b-4198-ad37-ca517dfad2d2 admin admin] PATH_INFO: `/v3/projects/9331f651509844e1b13b19dde7068f4e/users/f6725d4ff5624c1fa394d4e035d6706c/roles/9252c356af254127896f3626d925a88a` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:23.805916 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f522f-b84b-4198-ad37-ca517dfad2d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9331f651509844e1b13b19dde7068f4e, user_id=f6725d4ff5624c1fa394d4e035d6706c, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:23.808712 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f522f-b84b-4198-ad37-ca517dfad2d2 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:23.826249 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 853/1712] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:23 2022] PUT /identity/v3/projects/9331f651509844e1b13b19dde7068f4e/users/f6725d4ff5624c1fa394d4e035d6706c/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:42:23.838687 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b63c6-e654-497b-9545-eca2c2df313b None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:23.839081 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b63c6-e654-497b-9545-eca2c2df313b None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:23.839463 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b63c6-e654-497b-9545-eca2c2df313b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:23.848378 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a76de-280f-4a5c-86fc-cb81f06f431a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:23.849315 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a76de-280f-4a5c-86fc-cb81f06f431a service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:23.849810 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a76de-280f-4a5c-86fc-cb81f06f431a service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:23.850255 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a76de-280f-4a5c-86fc-cb81f06f431a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:23.864293 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a76de-280f-4a5c-86fc-cb81f06f431a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:23.866357 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a76de-280f-4a5c-86fc-cb81f06f431a service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:23.877053 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-509b63c6-e654-497b-9545-eca2c2df313b None None] MFA Rules not processed for user `f6725d4ff5624c1fa394d4e035d6706c`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:23.878408 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-509b63c6-e654-497b-9545-eca2c2df313b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:23.879101 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 860/1713] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:42:23.973969 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 854/1714] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:23 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:23.989588 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a76de-280f-4a5c-86fc-cb81f06f431a service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:23.998812 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-131a76de-280f-4a5c-86fc-cb81f06f431a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:24.125318 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a76de-280f-4a5c-86fc-cb81f06f431a service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:24.213929 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea7a8d-c63e-4ca6-b2fc-e3f7d2b2275b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:24.214624 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea7a8d-c63e-4ca6-b2fc-e3f7d2b2275b service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:24.214988 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea7a8d-c63e-4ca6-b2fc-e3f7d2b2275b service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:24.215715 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea7a8d-c63e-4ca6-b2fc-e3f7d2b2275b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:24.217864 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-bdea7a8d-c63e-4ca6-b2fc-e3f7d2b2275b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:24.367727 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea7a8d-c63e-4ca6-b2fc-e3f7d2b2275b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:24.369800 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea7a8d-c63e-4ca6-b2fc-e3f7d2b2275b service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:24.406638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 861/1715] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:24.588871 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b63c6-e654-497b-9545-eca2c2df313b None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:24.591756 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-509b63c6-e654-497b-9545-eca2c2df313b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:24.699783 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b63c6-e654-497b-9545-eca2c2df313b None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:24.706088 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c26fc6-e0a8-4f22-a1b8-16516da33171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:24.706571 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c26fc6-e0a8-4f22-a1b8-16516da33171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:24.706850 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c26fc6-e0a8-4f22-a1b8-16516da33171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:24.707123 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c26fc6-e0a8-4f22-a1b8-16516da33171 admin admin] PATH_INFO: `/v3/projects/4c0b2da1108d45afa3c1788a74159784` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:24.708284 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c26fc6-e0a8-4f22-a1b8-16516da33171 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c0b2da1108d45afa3c1788a74159784)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:24.710204 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c26fc6-e0a8-4f22-a1b8-16516da33171 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:24.865683 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-75c26fc6-e0a8-4f22-a1b8-16516da33171 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c0b2da1108d45afa3c1788a74159784', 'request_id': 'req-75c26fc6-e0a8-4f22-a1b8-16516da33171'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:24.873776 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-75c26fc6-e0a8-4f22-a1b8-16516da33171 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c0b2da1108d45afa3c1788a74159784', 'request_id': 'req-75c26fc6-e0a8-4f22-a1b8-16516da33171'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:24.881358 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-75c26fc6-e0a8-4f22-a1b8-16516da33171 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c0b2da1108d45afa3c1788a74159784', 'request_id': 'req-75c26fc6-e0a8-4f22-a1b8-16516da33171'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:24.881903 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:24.984468 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-75c26fc6-e0a8-4f22-a1b8-16516da33171 admin admin] The token cache is being invalidate because project 4c0b2da1108d45afa3c1788a74159784 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:42:24.985181 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-75c26fc6-e0a8-4f22-a1b8-16516da33171 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:24.986792 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-75c26fc6-e0a8-4f22-a1b8-16516da33171 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:24.992673 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 855/1716] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:42:24 2022] DELETE /identity/v3/projects/4c0b2da1108d45afa3c1788a74159784 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:24.997277 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a45ec2-e24b-48d2-93d7-a4118eb7bdc4 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:24.997627 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a45ec2-e24b-48d2-93d7-a4118eb7bdc4 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:24.997905 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a45ec2-e24b-48d2-93d7-a4118eb7bdc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:25.026153 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-b3a45ec2-e24b-48d2-93d7-a4118eb7bdc4 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:25.027624 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b3a45ec2-e24b-48d2-93d7-a4118eb7bdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:25.109539 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 862/1717] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:25.117910 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496a079-f625-4324-9637-ccc29e5cbb96 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:25.118199 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496a079-f625-4324-9637-ccc29e5cbb96 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:25.118464 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496a079-f625-4324-9637-ccc29e5cbb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:25.140582 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-2496a079-f625-4324-9637-ccc29e5cbb96 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:25.143115 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-2496a079-f625-4324-9637-ccc29e5cbb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:25.159820 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 856/1718] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:25.163147 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a45ec2-e24b-48d2-93d7-a4118eb7bdc4 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:25.175970 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a45ec2-e24b-48d2-93d7-a4118eb7bdc4 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:25.180871 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7cca9-f2c9-495b-84cb-998af91c58e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:25.181571 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7cca9-f2c9-495b-84cb-998af91c58e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:25.181921 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7cca9-f2c9-495b-84cb-998af91c58e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:25.182263 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7cca9-f2c9-495b-84cb-998af91c58e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:25.182991 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7cca9-f2c9-495b-84cb-998af91c58e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:42:25.183364 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7cca9-f2c9-495b-84cb-998af91c58e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:25.185102 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7cca9-f2c9-495b-84cb-998af91c58e6 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:25.199638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 863/1719] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:42:25.204875 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496a079-f625-4324-9637-ccc29e5cbb96 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:25.217771 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496a079-f625-4324-9637-ccc29e5cbb96 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:25.224613 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb03c1c-65ed-41da-810b-200ae450727a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:25.225257 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb03c1c-65ed-41da-810b-200ae450727a admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:25.225535 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb03c1c-65ed-41da-810b-200ae450727a admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:25.225804 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb03c1c-65ed-41da-810b-200ae450727a admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:25.226449 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb03c1c-65ed-41da-810b-200ae450727a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:25.228558 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb03c1c-65ed-41da-810b-200ae450727a admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:25.353562 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 857/1720] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:42:25 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:42:25.361917 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7cca9-f2c9-495b-84cb-998af91c58e6 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:25.371439 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7cca9-f2c9-495b-84cb-998af91c58e6 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:25.451049 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb872c-4f3c-4a18-8b28-c2d99f5bb088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:25.451847 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb872c-4f3c-4a18-8b28-c2d99f5bb088 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:25.452277 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb872c-4f3c-4a18-8b28-c2d99f5bb088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:25.452809 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb872c-4f3c-4a18-8b28-c2d99f5bb088 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:25.453564 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb872c-4f3c-4a18-8b28-c2d99f5bb088 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:25.457117 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb872c-4f3c-4a18-8b28-c2d99f5bb088 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:25.513569 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:25.560720 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 864/1721] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:42:25 2022] POST /identity/v3/users => generated 287 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:25.561307 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb03c1c-65ed-41da-810b-200ae450727a admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:25.575995 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb03c1c-65ed-41da-810b-200ae450727a admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:25.586487 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21cfa1-e832-4bc4-a534-67b70487882e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:25.587115 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21cfa1-e832-4bc4-a534-67b70487882e admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:25.587390 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21cfa1-e832-4bc4-a534-67b70487882e admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:25.587663 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21cfa1-e832-4bc4-a534-67b70487882e admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:25.588332 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21cfa1-e832-4bc4-a534-67b70487882e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:25.589929 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21cfa1-e832-4bc4-a534-67b70487882e admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:25.630452 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 858/1722] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:25.634655 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb872c-4f3c-4a18-8b28-c2d99f5bb088 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:25.649622 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb872c-4f3c-4a18-8b28-c2d99f5bb088 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:25.667859 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3e915-7496-4e67-a771-fcd88da180ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:25.668730 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3e915-7496-4e67-a771-fcd88da180ef admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:25.669013 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3e915-7496-4e67-a771-fcd88da180ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:25.669325 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3e915-7496-4e67-a771-fcd88da180ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:25.670109 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3e915-7496-4e67-a771-fcd88da180ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:25.675016 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3e915-7496-4e67-a771-fcd88da180ef admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:25.689061 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 865/1723] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:25.693012 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21cfa1-e832-4bc4-a534-67b70487882e admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:25.704469 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21cfa1-e832-4bc4-a534-67b70487882e admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:25.713887 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32485603-88e5-4f4e-87fa-a8ce1a656ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:25.714701 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32485603-88e5-4f4e-87fa-a8ce1a656ffb admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:25.715054 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32485603-88e5-4f4e-87fa-a8ce1a656ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:25.715394 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32485603-88e5-4f4e-87fa-a8ce1a656ffb admin admin] PATH_INFO: `/v3/projects/270fb02de7b34458b28272689606d249/users/4c1f411e3e3f4d2a8c2cab3d5ac05411/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:25.731541 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32485603-88e5-4f4e-87fa-a8ce1a656ffb admin admin] RBAC: Authorizing `identity:create_grant(project_id=270fb02de7b34458b28272689606d249, user_id=4c1f411e3e3f4d2a8c2cab3d5ac05411, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:25.734490 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32485603-88e5-4f4e-87fa-a8ce1a656ffb admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:25.820303 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 859/1724] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:25 2022] PUT /identity/v3/projects/270fb02de7b34458b28272689606d249/users/4c1f411e3e3f4d2a8c2cab3d5ac05411/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:25.830271 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba935c7-c6fc-4a24-b6c9-39639e4e5cac None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:25.830553 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba935c7-c6fc-4a24-b6c9-39639e4e5cac None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:25.830989 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba935c7-c6fc-4a24-b6c9-39639e4e5cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:25.849807 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-2ba935c7-c6fc-4a24-b6c9-39639e4e5cac None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:25.851017 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2ba935c7-c6fc-4a24-b6c9-39639e4e5cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:25.942617 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 866/1725] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:25.948497 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32485603-88e5-4f4e-87fa-a8ce1a656ffb admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:25.950735 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-32485603-88e5-4f4e-87fa-a8ce1a656ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:26.014772 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32485603-88e5-4f4e-87fa-a8ce1a656ffb admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:26.019433 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f46fb-c990-4fb4-a32d-e2c40b0fd856 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:26.020139 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f46fb-c990-4fb4-a32d-e2c40b0fd856 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:26.020358 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f46fb-c990-4fb4-a32d-e2c40b0fd856 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:26.020630 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f46fb-c990-4fb4-a32d-e2c40b0fd856 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:26.030397 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f46fb-c990-4fb4-a32d-e2c40b0fd856 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:26.031827 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f46fb-c990-4fb4-a32d-e2c40b0fd856 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:26.042992 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 860/1726] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:26.429939 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:27.045720 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba935c7-c6fc-4a24-b6c9-39639e4e5cac None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:27.047339 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2ba935c7-c6fc-4a24-b6c9-39639e4e5cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:27.139046 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba935c7-c6fc-4a24-b6c9-39639e4e5cac None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:27.155421 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f62754-ac5f-471a-98e8-ff66e60f1c55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:27.156082 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f62754-ac5f-471a-98e8-ff66e60f1c55 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:27.156366 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f62754-ac5f-471a-98e8-ff66e60f1c55 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:27.156657 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f62754-ac5f-471a-98e8-ff66e60f1c55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:27.161948 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-40f62754-ac5f-471a-98e8-ff66e60f1c55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:27.272388 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f62754-ac5f-471a-98e8-ff66e60f1c55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:27.273946 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f62754-ac5f-471a-98e8-ff66e60f1c55 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:27.284467 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 867/1727] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:28.495192 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989f2b3-7a68-484d-a619-dd77992f5de8 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:28.495759 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989f2b3-7a68-484d-a619-dd77992f5de8 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:28.496301 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989f2b3-7a68-484d-a619-dd77992f5de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:28.562944 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-b989f2b3-7a68-484d-a619-dd77992f5de8 None None] MFA Rules not processed for user `4c1f411e3e3f4d2a8c2cab3d5ac05411`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:28.565144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-b989f2b3-7a68-484d-a619-dd77992f5de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:28.671126 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:28.691563 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 861/1728] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:28.786113 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f62754-ac5f-471a-98e8-ff66e60f1c55 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:28.787876 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-40f62754-ac5f-471a-98e8-ff66e60f1c55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:28.791922 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989f2b3-7a68-484d-a619-dd77992f5de8 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:28.793793 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-b989f2b3-7a68-484d-a619-dd77992f5de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:28.811915 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989f2b3-7a68-484d-a619-dd77992f5de8 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:28.818328 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba69c9b-c347-4a22-98bc-539cfe938643 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:28.818989 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba69c9b-c347-4a22-98bc-539cfe938643 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:28.819664 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba69c9b-c347-4a22-98bc-539cfe938643 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:28.819947 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba69c9b-c347-4a22-98bc-539cfe938643 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:28.822962 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f62754-ac5f-471a-98e8-ff66e60f1c55 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:28.832947 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba69c9b-c347-4a22-98bc-539cfe938643 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:28.834525 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba69c9b-c347-4a22-98bc-539cfe938643 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:28.845878 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4348a2-1df0-4b08-b505-d864e0087a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:28.846796 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4348a2-1df0-4b08-b505-d864e0087a15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:28.847171 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4348a2-1df0-4b08-b505-d864e0087a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:28.847548 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4348a2-1df0-4b08-b505-d864e0087a15 admin admin] PATH_INFO: `/v3/users/5fc4016e6a294663a9ce946404a39f93` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:28.848910 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4348a2-1df0-4b08-b505-d864e0087a15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fc4016e6a294663a9ce946404a39f93)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:28.851393 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4348a2-1df0-4b08-b505-d864e0087a15 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:28.858566 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 862/1729] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:29.113707 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4b4348a2-1df0-4b08-b505-d864e0087a15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fc4016e6a294663a9ce946404a39f93'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:29.130062 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4b4348a2-1df0-4b08-b505-d864e0087a15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fc4016e6a294663a9ce946404a39f93'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:29.131254 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4b4348a2-1df0-4b08-b505-d864e0087a15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fc4016e6a294663a9ce946404a39f93'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:29.138522 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4b4348a2-1df0-4b08-b505-d864e0087a15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fc4016e6a294663a9ce946404a39f93'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:29.139243 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4b4348a2-1df0-4b08-b505-d864e0087a15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fc4016e6a294663a9ce946404a39f93'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:29.272692 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 868/1730] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:42:28 2022] DELETE /identity/v3/users/5fc4016e6a294663a9ce946404a39f93 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:29.272817 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28337e0e-5929-4551-b660-7a91c457ddfc None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:29.272817 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28337e0e-5929-4551-b660-7a91c457ddfc None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:29.272817 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28337e0e-5929-4551-b660-7a91c457ddfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:29.306459 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-28337e0e-5929-4551-b660-7a91c457ddfc None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:29.308156 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-28337e0e-5929-4551-b660-7a91c457ddfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:29.400891 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 863/1731] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:29.411918 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4348a2-1df0-4b08-b505-d864e0087a15 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:29.413637 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4b4348a2-1df0-4b08-b505-d864e0087a15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:29.531427 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4348a2-1df0-4b08-b505-d864e0087a15 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:29.536753 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e3a43-478d-4e87-bfe0-8eca0da225f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:29.537864 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e3a43-478d-4e87-bfe0-8eca0da225f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:29.538214 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e3a43-478d-4e87-bfe0-8eca0da225f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:29.538585 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e3a43-478d-4e87-bfe0-8eca0da225f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:29.553381 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e3a43-478d-4e87-bfe0-8eca0da225f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:29.565235 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e3a43-478d-4e87-bfe0-8eca0da225f6 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:29.578530 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41fe2e4-d6cb-4263-b4f2-2bbe8da81f05 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:29.579066 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41fe2e4-d6cb-4263-b4f2-2bbe8da81f05 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:29.579203 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41fe2e4-d6cb-4263-b4f2-2bbe8da81f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:29.581882 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 869/1732] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:29.639037 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-c41fe2e4-d6cb-4263-b4f2-2bbe8da81f05 None None] MFA Rules not processed for user `a483f57a4bab4d499d8fa8585d8622d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:29.640608 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c41fe2e4-d6cb-4263-b4f2-2bbe8da81f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:29.755490 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 864/1733] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:29.768707 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e3a43-478d-4e87-bfe0-8eca0da225f6 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:29.780841 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-841e3a43-478d-4e87-bfe0-8eca0da225f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:29.815086 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41fe2e4-d6cb-4263-b4f2-2bbe8da81f05 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:29.817835 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c41fe2e4-d6cb-4263-b4f2-2bbe8da81f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:29.893492 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e3a43-478d-4e87-bfe0-8eca0da225f6 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:29.902321 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc1e92-ef39-4195-9dba-63a35fe747d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:29.903039 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc1e92-ef39-4195-9dba-63a35fe747d8 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:29.903376 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc1e92-ef39-4195-9dba-63a35fe747d8 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:29.903711 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc1e92-ef39-4195-9dba-63a35fe747d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:29.911635 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41fe2e4-d6cb-4263-b4f2-2bbe8da81f05 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:29.913530 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc1e92-ef39-4195-9dba-63a35fe747d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:29.915237 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc1e92-ef39-4195-9dba-63a35fe747d8 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:29.915524 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2dbc8c-b85b-4a04-b53b-b354f718c573 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:29.916183 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2dbc8c-b85b-4a04-b53b-b354f718c573 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:29.916466 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2dbc8c-b85b-4a04-b53b-b354f718c573 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:29.916763 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2dbc8c-b85b-4a04-b53b-b354f718c573 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:29.918734 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-2f2dbc8c-b85b-4a04-b53b-b354f718c573 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:29.932021 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:29.944252 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 870/1734] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:30.002329 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2dbc8c-b85b-4a04-b53b-b354f718c573 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:30.004120 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2dbc8c-b85b-4a04-b53b-b354f718c573 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:30.014192 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 865/1735] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:29 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:42:30.064243 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc1e92-ef39-4195-9dba-63a35fe747d8 service nova] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:30.065959 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3fcc1e92-ef39-4195-9dba-63a35fe747d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:30.082352 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc1e92-ef39-4195-9dba-63a35fe747d8 service nova] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:30.087883 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254c783-4255-4433-8b6b-8d2a6f06cfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:30.088597 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254c783-4255-4433-8b6b-8d2a6f06cfcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:30.088884 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254c783-4255-4433-8b6b-8d2a6f06cfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:30.089126 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254c783-4255-4433-8b6b-8d2a6f06cfcf admin admin] PATH_INFO: `/v3/projects/3036f4440ed44495b7b811ac6b9c8d19` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:30.090370 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6254c783-4255-4433-8b6b-8d2a6f06cfcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=3036f4440ed44495b7b811ac6b9c8d19)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:30.092220 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6254c783-4255-4433-8b6b-8d2a6f06cfcf admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:30.243404 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-6254c783-4255-4433-8b6b-8d2a6f06cfcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3036f4440ed44495b7b811ac6b9c8d19', 'request_id': 'req-6254c783-4255-4433-8b6b-8d2a6f06cfcf'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:30.250962 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-6254c783-4255-4433-8b6b-8d2a6f06cfcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3036f4440ed44495b7b811ac6b9c8d19', 'request_id': 'req-6254c783-4255-4433-8b6b-8d2a6f06cfcf'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:30.262340 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-6254c783-4255-4433-8b6b-8d2a6f06cfcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3036f4440ed44495b7b811ac6b9c8d19', 'request_id': 'req-6254c783-4255-4433-8b6b-8d2a6f06cfcf'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:30.377591 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-6254c783-4255-4433-8b6b-8d2a6f06cfcf admin admin] The token cache is being invalidate because project 3036f4440ed44495b7b811ac6b9c8d19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:42:30.378053 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-6254c783-4255-4433-8b6b-8d2a6f06cfcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:30.381716 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-6254c783-4255-4433-8b6b-8d2a6f06cfcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:30.383389 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 871/1736] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:42:30 2022] DELETE /identity/v3/projects/3036f4440ed44495b7b811ac6b9c8d19 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:30.461600 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:30.838183 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d12e9-e379-496c-9226-ff1891392f69 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:30.838799 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d12e9-e379-496c-9226-ff1891392f69 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:30.838799 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d12e9-e379-496c-9226-ff1891392f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:30.860526 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-6f5d12e9-e379-496c-9226-ff1891392f69 None None] MFA Rules not processed for user `4c1f411e3e3f4d2a8c2cab3d5ac05411`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:30.862349 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-6f5d12e9-e379-496c-9226-ff1891392f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:30.920376 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 866/1737] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:32.774833 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ecfa9e-34fc-4b80-a979-8483497c1f4f None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:32.775271 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ecfa9e-34fc-4b80-a979-8483497c1f4f None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:32.775369 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ecfa9e-34fc-4b80-a979-8483497c1f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:32.802599 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-42ecfa9e-34fc-4b80-a979-8483497c1f4f None None] MFA Rules not processed for user `a483f57a4bab4d499d8fa8585d8622d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:32.804583 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-42ecfa9e-34fc-4b80-a979-8483497c1f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:32.921505 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 872/1738] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:33.041373 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:33.537838 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:35.188394 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d12e9-e379-496c-9226-ff1891392f69 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:35.189875 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-6f5d12e9-e379-496c-9226-ff1891392f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:35.258301 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d12e9-e379-496c-9226-ff1891392f69 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:35.268210 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e69b6-22ab-40da-a5fd-e06836a49518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:35.268897 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e69b6-22ab-40da-a5fd-e06836a49518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:35.269255 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e69b6-22ab-40da-a5fd-e06836a49518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:35.269537 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e69b6-22ab-40da-a5fd-e06836a49518 admin admin] PATH_INFO: `/v3/users/852e9a8e27c640c985fca3476a3ae853` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:35.270900 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e69b6-22ab-40da-a5fd-e06836a49518 admin admin] RBAC: Authorizing `identity:delete_user(user_id=852e9a8e27c640c985fca3476a3ae853)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:35.272968 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e69b6-22ab-40da-a5fd-e06836a49518 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:35.570315 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:INSERT=7,keystone:SELECT=86,keystone:DELETE=7 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:35.589777 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-954e69b6-22ab-40da-a5fd-e06836a49518 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '852e9a8e27c640c985fca3476a3ae853'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:35.603008 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-954e69b6-22ab-40da-a5fd-e06836a49518 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '852e9a8e27c640c985fca3476a3ae853'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:35.612966 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-954e69b6-22ab-40da-a5fd-e06836a49518 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '852e9a8e27c640c985fca3476a3ae853'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:35.612966 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-954e69b6-22ab-40da-a5fd-e06836a49518 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '852e9a8e27c640c985fca3476a3ae853'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:35.612966 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-954e69b6-22ab-40da-a5fd-e06836a49518 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '852e9a8e27c640c985fca3476a3ae853'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:35.706168 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 867/1739] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:42:35 2022] DELETE /identity/v3/users/852e9a8e27c640c985fca3476a3ae853 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:35.711351 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4437a-9d37-422f-a1b7-789273fe7127 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:35.712459 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4437a-9d37-422f-a1b7-789273fe7127 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:35.712741 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4437a-9d37-422f-a1b7-789273fe7127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:35.739955 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-84f4437a-9d37-422f-a1b7-789273fe7127 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:35.739955 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-84f4437a-9d37-422f-a1b7-789273fe7127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:35.801280 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 873/1740] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:35.812187 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e69b6-22ab-40da-a5fd-e06836a49518 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:35.814409 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-954e69b6-22ab-40da-a5fd-e06836a49518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:35.888326 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e69b6-22ab-40da-a5fd-e06836a49518 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:35.892439 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cb16e-4caa-4187-b1a0-be5a3b6e9f0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:35.893055 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cb16e-4caa-4187-b1a0-be5a3b6e9f0c service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:35.893328 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cb16e-4caa-4187-b1a0-be5a3b6e9f0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:35.893908 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cb16e-4caa-4187-b1a0-be5a3b6e9f0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:35.906169 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693cb16e-4caa-4187-b1a0-be5a3b6e9f0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:35.908399 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693cb16e-4caa-4187-b1a0-be5a3b6e9f0c service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:35.918562 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 868/1741] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:36.240185 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:36.413258 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4437a-9d37-422f-a1b7-789273fe7127 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:36.416297 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-84f4437a-9d37-422f-a1b7-789273fe7127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:36.474537 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4437a-9d37-422f-a1b7-789273fe7127 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:36.477395 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d213b-cdbb-44ff-8b52-7948a6992c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:36.478063 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d213b-cdbb-44ff-8b52-7948a6992c11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:36.478373 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d213b-cdbb-44ff-8b52-7948a6992c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:36.478648 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d213b-cdbb-44ff-8b52-7948a6992c11 admin admin] PATH_INFO: `/v3/projects/fcf75e095a35443a8f8fac69f465af59` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:36.480532 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d213b-cdbb-44ff-8b52-7948a6992c11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcf75e095a35443a8f8fac69f465af59)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:36.482868 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d213b-cdbb-44ff-8b52-7948a6992c11 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:36.627992 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7a9d213b-cdbb-44ff-8b52-7948a6992c11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcf75e095a35443a8f8fac69f465af59', 'request_id': 'req-7a9d213b-cdbb-44ff-8b52-7948a6992c11'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:36.634117 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7a9d213b-cdbb-44ff-8b52-7948a6992c11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcf75e095a35443a8f8fac69f465af59', 'request_id': 'req-7a9d213b-cdbb-44ff-8b52-7948a6992c11'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:36.640930 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7a9d213b-cdbb-44ff-8b52-7948a6992c11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcf75e095a35443a8f8fac69f465af59', 'request_id': 'req-7a9d213b-cdbb-44ff-8b52-7948a6992c11'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:36.737697 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7a9d213b-cdbb-44ff-8b52-7948a6992c11 admin admin] The token cache is being invalidate because project fcf75e095a35443a8f8fac69f465af59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:42:36.737996 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7a9d213b-cdbb-44ff-8b52-7948a6992c11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:36.738627 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7a9d213b-cdbb-44ff-8b52-7948a6992c11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:36.740222 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 874/1742] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:42:36 2022] DELETE /identity/v3/projects/fcf75e095a35443a8f8fac69f465af59 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:36.744226 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cb16e-4caa-4187-b1a0-be5a3b6e9f0c service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:36.755924 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cb16e-4caa-4187-b1a0-be5a3b6e9f0c service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:36.828306 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178eda7-6ff5-4bc0-9297-dbe5be7e277a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:36.828901 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178eda7-6ff5-4bc0-9297-dbe5be7e277a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:36.829910 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178eda7-6ff5-4bc0-9297-dbe5be7e277a admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:36.830352 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178eda7-6ff5-4bc0-9297-dbe5be7e277a admin admin] PATH_INFO: `/v3/users/cb21db700c214735b878eb1cd2acd99e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:36.831778 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178eda7-6ff5-4bc0-9297-dbe5be7e277a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb21db700c214735b878eb1cd2acd99e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:36.833716 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178eda7-6ff5-4bc0-9297-dbe5be7e277a admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:37.049018 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2178eda7-6ff5-4bc0-9297-dbe5be7e277a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb21db700c214735b878eb1cd2acd99e'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:37.062315 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2178eda7-6ff5-4bc0-9297-dbe5be7e277a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb21db700c214735b878eb1cd2acd99e'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:37.077960 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2178eda7-6ff5-4bc0-9297-dbe5be7e277a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb21db700c214735b878eb1cd2acd99e'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:37.078773 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2178eda7-6ff5-4bc0-9297-dbe5be7e277a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb21db700c214735b878eb1cd2acd99e'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:37.081048 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2178eda7-6ff5-4bc0-9297-dbe5be7e277a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb21db700c214735b878eb1cd2acd99e'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:37.195994 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 869/1743] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:42:36 2022] DELETE /identity/v3/users/cb21db700c214735b878eb1cd2acd99e => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:37.969464 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d213b-cdbb-44ff-8b52-7948a6992c11 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:37.971543 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7a9d213b-cdbb-44ff-8b52-7948a6992c11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:37.985206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d213b-cdbb-44ff-8b52-7948a6992c11 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:38.050719 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:38.056661 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b108269-dae5-4581-a8d0-44662fc15203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:38.057738 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b108269-dae5-4581-a8d0-44662fc15203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:38.058415 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b108269-dae5-4581-a8d0-44662fc15203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:38.058913 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b108269-dae5-4581-a8d0-44662fc15203 admin admin] PATH_INFO: `/v3/projects/35149f95cb344090b98290f6abca33e9` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:38.060137 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b108269-dae5-4581-a8d0-44662fc15203 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35149f95cb344090b98290f6abca33e9)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:38.062942 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b108269-dae5-4581-a8d0-44662fc15203 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:38.171928 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:38.208665 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3b108269-dae5-4581-a8d0-44662fc15203 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35149f95cb344090b98290f6abca33e9', 'request_id': 'req-3b108269-dae5-4581-a8d0-44662fc15203'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:38.223806 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3b108269-dae5-4581-a8d0-44662fc15203 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35149f95cb344090b98290f6abca33e9', 'request_id': 'req-3b108269-dae5-4581-a8d0-44662fc15203'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:38.230718 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3b108269-dae5-4581-a8d0-44662fc15203 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35149f95cb344090b98290f6abca33e9', 'request_id': 'req-3b108269-dae5-4581-a8d0-44662fc15203'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:38.322291 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3b108269-dae5-4581-a8d0-44662fc15203 admin admin] The token cache is being invalidate because project 35149f95cb344090b98290f6abca33e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:42:38.322634 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3b108269-dae5-4581-a8d0-44662fc15203 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:38.324121 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3b108269-dae5-4581-a8d0-44662fc15203 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:38.329295 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 875/1744] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:42:37 2022] DELETE /identity/v3/projects/35149f95cb344090b98290f6abca33e9 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:38.330050 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178eda7-6ff5-4bc0-9297-dbe5be7e277a admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:38.331451 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-2178eda7-6ff5-4bc0-9297-dbe5be7e277a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:38.344215 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178eda7-6ff5-4bc0-9297-dbe5be7e277a admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:38.407724 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561fbc6f-80d5-40d1-b413-7779c0b6f5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:38.407724 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fbc6f-80d5-40d1-b413-7779c0b6f5e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:38.407724 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fbc6f-80d5-40d1-b413-7779c0b6f5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:38.407724 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fbc6f-80d5-40d1-b413-7779c0b6f5e0 admin admin] PATH_INFO: `/v3/users/f6725d4ff5624c1fa394d4e035d6706c` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:38.408159 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561fbc6f-80d5-40d1-b413-7779c0b6f5e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6725d4ff5624c1fa394d4e035d6706c)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:38.409680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561fbc6f-80d5-40d1-b413-7779c0b6f5e0 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:38.682596 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-561fbc6f-80d5-40d1-b413-7779c0b6f5e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6725d4ff5624c1fa394d4e035d6706c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:38.706522 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-561fbc6f-80d5-40d1-b413-7779c0b6f5e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6725d4ff5624c1fa394d4e035d6706c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:38.716452 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-561fbc6f-80d5-40d1-b413-7779c0b6f5e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6725d4ff5624c1fa394d4e035d6706c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:38.717936 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-561fbc6f-80d5-40d1-b413-7779c0b6f5e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6725d4ff5624c1fa394d4e035d6706c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:38.718583 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-561fbc6f-80d5-40d1-b413-7779c0b6f5e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6725d4ff5624c1fa394d4e035d6706c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:38.801028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 870/1745] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:42:38 2022] DELETE /identity/v3/users/f6725d4ff5624c1fa394d4e035d6706c => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:42:39.349484 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:39.569355 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b108269-dae5-4581-a8d0-44662fc15203 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:39.570969 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3b108269-dae5-4581-a8d0-44662fc15203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:39.607444 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b108269-dae5-4581-a8d0-44662fc15203 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:39.666994 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2b2f3-8890-42fd-a8c6-1bb554f7502e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:39.667718 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2b2f3-8890-42fd-a8c6-1bb554f7502e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:39.667995 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2b2f3-8890-42fd-a8c6-1bb554f7502e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:39.668343 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2b2f3-8890-42fd-a8c6-1bb554f7502e admin admin] PATH_INFO: `/v3/projects/9331f651509844e1b13b19dde7068f4e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:39.669555 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f2b2f3-8890-42fd-a8c6-1bb554f7502e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9331f651509844e1b13b19dde7068f4e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:39.671741 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f2b2f3-8890-42fd-a8c6-1bb554f7502e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:39.795094 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b6f2b2f3-8890-42fd-a8c6-1bb554f7502e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9331f651509844e1b13b19dde7068f4e', 'request_id': 'req-b6f2b2f3-8890-42fd-a8c6-1bb554f7502e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:39.801684 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b6f2b2f3-8890-42fd-a8c6-1bb554f7502e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9331f651509844e1b13b19dde7068f4e', 'request_id': 'req-b6f2b2f3-8890-42fd-a8c6-1bb554f7502e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:39.808079 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b6f2b2f3-8890-42fd-a8c6-1bb554f7502e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9331f651509844e1b13b19dde7068f4e', 'request_id': 'req-b6f2b2f3-8890-42fd-a8c6-1bb554f7502e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:39.856189 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:39.898794 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b6f2b2f3-8890-42fd-a8c6-1bb554f7502e admin admin] The token cache is being invalidate because project 9331f651509844e1b13b19dde7068f4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:42:39.901291 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b6f2b2f3-8890-42fd-a8c6-1bb554f7502e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:39.901291 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b6f2b2f3-8890-42fd-a8c6-1bb554f7502e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:39.902558 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 876/1746] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:42:39 2022] DELETE /identity/v3/projects/9331f651509844e1b13b19dde7068f4e => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:39.907602 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2e816-9ba2-4c50-8097-aa88d73d6fb0 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:39.908236 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2e816-9ba2-4c50-8097-aa88d73d6fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:39.908742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2e816-9ba2-4c50-8097-aa88d73d6fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:39.931714 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-15e2e816-9ba2-4c50-8097-aa88d73d6fb0 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:39.934770 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-15e2e816-9ba2-4c50-8097-aa88d73d6fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:39.993548 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 871/1747] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:40.001828 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90000ef6-206a-442e-a8c1-6c81788c4c81 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:40.002111 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90000ef6-206a-442e-a8c1-6c81788c4c81 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:40.002538 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90000ef6-206a-442e-a8c1-6c81788c4c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:40.026403 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-90000ef6-206a-442e-a8c1-6c81788c4c81 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:40.026403 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-90000ef6-206a-442e-a8c1-6c81788c4c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:40.032155 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 877/1748] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:40.036417 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2e816-9ba2-4c50-8097-aa88d73d6fb0 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:40.062771 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2e816-9ba2-4c50-8097-aa88d73d6fb0 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:40.068924 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b533ba-0d79-42b3-8155-71ad3dc6d34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:40.069607 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b533ba-0d79-42b3-8155-71ad3dc6d34f admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:40.069994 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b533ba-0d79-42b3-8155-71ad3dc6d34f admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:40.070294 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b533ba-0d79-42b3-8155-71ad3dc6d34f admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:40.070997 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b533ba-0d79-42b3-8155-71ad3dc6d34f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:42:40.071367 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b533ba-0d79-42b3-8155-71ad3dc6d34f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:40.073160 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b533ba-0d79-42b3-8155-71ad3dc6d34f admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:40.089004 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 872/1749] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:42:40.093610 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90000ef6-206a-442e-a8c1-6c81788c4c81 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:40.104883 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90000ef6-206a-442e-a8c1-6c81788c4c81 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:40.109969 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd07156c-63a8-405f-9ac7-856a659f5d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:40.111766 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07156c-63a8-405f-9ac7-856a659f5d22 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:40.112082 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07156c-63a8-405f-9ac7-856a659f5d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:40.117050 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07156c-63a8-405f-9ac7-856a659f5d22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:40.117917 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd07156c-63a8-405f-9ac7-856a659f5d22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:40.121390 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd07156c-63a8-405f-9ac7-856a659f5d22 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:40.197496 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 878/1750] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:42:40 2022] POST /identity/v3/projects => generated 369 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:40.200298 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b533ba-0d79-42b3-8155-71ad3dc6d34f admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:40.211106 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b533ba-0d79-42b3-8155-71ad3dc6d34f admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:40.270020 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c272a35c-c3b9-4a01-9385-7dc408e194a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:40.275186 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272a35c-c3b9-4a01-9385-7dc408e194a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:40.275186 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272a35c-c3b9-4a01-9385-7dc408e194a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:40.275186 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272a35c-c3b9-4a01-9385-7dc408e194a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:40.275186 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c272a35c-c3b9-4a01-9385-7dc408e194a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:40.275186 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c272a35c-c3b9-4a01-9385-7dc408e194a3 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:40.427999 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 873/1751] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:42:40 2022] POST /identity/v3/users => generated 285 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:40.432255 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd07156c-63a8-405f-9ac7-856a659f5d22 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:40.442794 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd07156c-63a8-405f-9ac7-856a659f5d22 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:40.447593 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43246b-793b-45c7-b2bf-33ff71ac9c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:40.448245 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43246b-793b-45c7-b2bf-33ff71ac9c32 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:40.448516 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43246b-793b-45c7-b2bf-33ff71ac9c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:40.448788 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43246b-793b-45c7-b2bf-33ff71ac9c32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:40.449455 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43246b-793b-45c7-b2bf-33ff71ac9c32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:40.451058 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43246b-793b-45c7-b2bf-33ff71ac9c32 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:40.461335 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 879/1752] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:40.465311 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c272a35c-c3b9-4a01-9385-7dc408e194a3 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:40.476524 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c272a35c-c3b9-4a01-9385-7dc408e194a3 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:40.483059 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed72d8-1e25-48e7-9f63-0673cc5e0f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:40.483666 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed72d8-1e25-48e7-9f63-0673cc5e0f5e admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:40.483947 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed72d8-1e25-48e7-9f63-0673cc5e0f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:40.484266 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed72d8-1e25-48e7-9f63-0673cc5e0f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:40.484901 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed72d8-1e25-48e7-9f63-0673cc5e0f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:40.487085 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed72d8-1e25-48e7-9f63-0673cc5e0f5e admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:40.497899 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 874/1753] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:42:40.502308 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43246b-793b-45c7-b2bf-33ff71ac9c32 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:40.512207 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43246b-793b-45c7-b2bf-33ff71ac9c32 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:40.516707 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134dea5-35df-4f68-9279-045c14db488f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:40.517385 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134dea5-35df-4f68-9279-045c14db488f admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:40.517668 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134dea5-35df-4f68-9279-045c14db488f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:40.517941 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134dea5-35df-4f68-9279-045c14db488f admin admin] PATH_INFO: `/v3/projects/a710ae4a244341bcafe05df6c7c10701/users/269f912b8d5b4a5181044688245dc635/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:40.534335 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e134dea5-35df-4f68-9279-045c14db488f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a710ae4a244341bcafe05df6c7c10701, user_id=269f912b8d5b4a5181044688245dc635, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:40.537025 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e134dea5-35df-4f68-9279-045c14db488f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:40.612475 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 880/1754] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:40 2022] PUT /identity/v3/projects/a710ae4a244341bcafe05df6c7c10701/users/269f912b8d5b4a5181044688245dc635/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:40.621903 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b36879-b188-4d0c-bde3-ba9b83c89f8c None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:40.622420 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b36879-b188-4d0c-bde3-ba9b83c89f8c None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:40.622880 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b36879-b188-4d0c-bde3-ba9b83c89f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:40.660285 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-d2b36879-b188-4d0c-bde3-ba9b83c89f8c None None] MFA Rules not processed for user `269f912b8d5b4a5181044688245dc635`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:40.661754 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-d2b36879-b188-4d0c-bde3-ba9b83c89f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:40.743659 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 875/1755] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:40.752268 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134dea5-35df-4f68-9279-045c14db488f admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:40.754058 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e134dea5-35df-4f68-9279-045c14db488f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:40.830066 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134dea5-35df-4f68-9279-045c14db488f admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:40.834110 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9268ae-b6ff-46eb-80ad-46cae7c76e57 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '475f6e94957a4ae2b1248c8035231ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:40.834730 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9268ae-b6ff-46eb-80ad-46cae7c76e57 service glance] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:40.835005 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9268ae-b6ff-46eb-80ad-46cae7c76e57 service glance] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:40.835278 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9268ae-b6ff-46eb-80ad-46cae7c76e57 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:40.844042 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9268ae-b6ff-46eb-80ad-46cae7c76e57 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:40.846228 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9268ae-b6ff-46eb-80ad-46cae7c76e57 service glance] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:40.855344 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 881/1756] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:41.006262 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:41.423241 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:41.550048 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:42.379699 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:42.594349 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:43.050419 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:43.452108 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:43.874944 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:44.697974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:44.766020 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:45.955214 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:46.537709 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:47.710443 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:47.939655 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:48.320784 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:49.177972 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:49.480865 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:49.498119 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b36879-b188-4d0c-bde3-ba9b83c89f8c None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:49.499886 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-d2b36879-b188-4d0c-bde3-ba9b83c89f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:49.572773 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b36879-b188-4d0c-bde3-ba9b83c89f8c None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:49.577374 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db7cd1-400f-4b45-b9cb-40e1b73bf404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:49.578009 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db7cd1-400f-4b45-b9cb-40e1b73bf404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:49.581336 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db7cd1-400f-4b45-b9cb-40e1b73bf404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:49.581336 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db7cd1-400f-4b45-b9cb-40e1b73bf404 admin admin] PATH_INFO: `/v3/users/b19d42266bc5423db6daf4f08f928b77` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:49.581336 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db7cd1-400f-4b45-b9cb-40e1b73bf404 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b19d42266bc5423db6daf4f08f928b77)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:49.582491 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db7cd1-400f-4b45-b9cb-40e1b73bf404 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:49.798231 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b0db7cd1-400f-4b45-b9cb-40e1b73bf404 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b19d42266bc5423db6daf4f08f928b77'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:49.815846 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b0db7cd1-400f-4b45-b9cb-40e1b73bf404 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b19d42266bc5423db6daf4f08f928b77'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:49.828364 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b0db7cd1-400f-4b45-b9cb-40e1b73bf404 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b19d42266bc5423db6daf4f08f928b77'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:49.830348 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b0db7cd1-400f-4b45-b9cb-40e1b73bf404 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b19d42266bc5423db6daf4f08f928b77'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:49.831523 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b0db7cd1-400f-4b45-b9cb-40e1b73bf404 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b19d42266bc5423db6daf4f08f928b77'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:49.914281 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 876/1757] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:42:49 2022] DELETE /identity/v3/users/b19d42266bc5423db6daf4f08f928b77 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:50.197181 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9268ae-b6ff-46eb-80ad-46cae7c76e57 service glance] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:50.211906 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9268ae-b6ff-46eb-80ad-46cae7c76e57 service glance] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:50.310178 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5edb03b-3506-402a-b7fe-454fdffc4565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:50.310946 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edb03b-3506-402a-b7fe-454fdffc4565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:50.311189 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edb03b-3506-402a-b7fe-454fdffc4565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:50.311467 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edb03b-3506-402a-b7fe-454fdffc4565 admin admin] PATH_INFO: `/v3/projects/50a62fd921af43acb22183c91493524b` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:50.312783 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5edb03b-3506-402a-b7fe-454fdffc4565 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50a62fd921af43acb22183c91493524b)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:50.316326 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5edb03b-3506-402a-b7fe-454fdffc4565 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:50.496077 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e5edb03b-3506-402a-b7fe-454fdffc4565 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50a62fd921af43acb22183c91493524b', 'request_id': 'req-e5edb03b-3506-402a-b7fe-454fdffc4565'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:50.505049 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e5edb03b-3506-402a-b7fe-454fdffc4565 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50a62fd921af43acb22183c91493524b', 'request_id': 'req-e5edb03b-3506-402a-b7fe-454fdffc4565'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:50.513014 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e5edb03b-3506-402a-b7fe-454fdffc4565 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50a62fd921af43acb22183c91493524b', 'request_id': 'req-e5edb03b-3506-402a-b7fe-454fdffc4565'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:50.598193 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e5edb03b-3506-402a-b7fe-454fdffc4565 admin admin] The token cache is being invalidate because project 50a62fd921af43acb22183c91493524b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:42:50.598193 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e5edb03b-3506-402a-b7fe-454fdffc4565 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:50.598193 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e5edb03b-3506-402a-b7fe-454fdffc4565 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:50.599189 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 882/1758] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:42:50 2022] DELETE /identity/v3/projects/50a62fd921af43acb22183c91493524b => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:50.603163 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db7cd1-400f-4b45-b9cb-40e1b73bf404 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:50.604705 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-b0db7cd1-400f-4b45-b9cb-40e1b73bf404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:50.619198 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db7cd1-400f-4b45-b9cb-40e1b73bf404 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:50.705756 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edca503-cad3-43d3-ac22-2cd96ec4f930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:50.706494 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edca503-cad3-43d3-ac22-2cd96ec4f930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:50.706806 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edca503-cad3-43d3-ac22-2cd96ec4f930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:50.707086 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edca503-cad3-43d3-ac22-2cd96ec4f930 admin admin] PATH_INFO: `/v3/users/f6e460143930423c850e73f97c315262` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:50.708358 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edca503-cad3-43d3-ac22-2cd96ec4f930 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6e460143930423c850e73f97c315262)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:50.712787 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edca503-cad3-43d3-ac22-2cd96ec4f930 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:50.727193 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:50.903538 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-8edca503-cad3-43d3-ac22-2cd96ec4f930 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6e460143930423c850e73f97c315262'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:50.916105 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-8edca503-cad3-43d3-ac22-2cd96ec4f930 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6e460143930423c850e73f97c315262'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:50.930025 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-8edca503-cad3-43d3-ac22-2cd96ec4f930 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6e460143930423c850e73f97c315262'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:50.930860 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-8edca503-cad3-43d3-ac22-2cd96ec4f930 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6e460143930423c850e73f97c315262'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:50.931485 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-8edca503-cad3-43d3-ac22-2cd96ec4f930 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6e460143930423c850e73f97c315262'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:51.021908 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 877/1759] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:42:50 2022] DELETE /identity/v3/users/f6e460143930423c850e73f97c315262 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:51.258520 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5edb03b-3506-402a-b7fe-454fdffc4565 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:51.260318 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e5edb03b-3506-402a-b7fe-454fdffc4565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:51.274617 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5edb03b-3506-402a-b7fe-454fdffc4565 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:51.286333 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:51.336853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5f917-fb24-4b20-a281-519534bb772a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:51.337511 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5f917-fb24-4b20-a281-519534bb772a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:51.337787 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5f917-fb24-4b20-a281-519534bb772a admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:51.338054 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5f917-fb24-4b20-a281-519534bb772a admin admin] PATH_INFO: `/v3/projects/0e8baf3f193a456493b264c37f080785` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:51.339149 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e5f917-fb24-4b20-a281-519534bb772a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e8baf3f193a456493b264c37f080785)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:51.341268 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e5f917-fb24-4b20-a281-519534bb772a admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:51.467539 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-57e5f917-fb24-4b20-a281-519534bb772a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e8baf3f193a456493b264c37f080785', 'request_id': 'req-57e5f917-fb24-4b20-a281-519534bb772a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:51.475220 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-57e5f917-fb24-4b20-a281-519534bb772a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e8baf3f193a456493b264c37f080785', 'request_id': 'req-57e5f917-fb24-4b20-a281-519534bb772a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:51.484348 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-57e5f917-fb24-4b20-a281-519534bb772a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e8baf3f193a456493b264c37f080785', 'request_id': 'req-57e5f917-fb24-4b20-a281-519534bb772a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:51.587268 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-57e5f917-fb24-4b20-a281-519534bb772a admin admin] The token cache is being invalidate because project 0e8baf3f193a456493b264c37f080785 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:42:51.587737 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-57e5f917-fb24-4b20-a281-519534bb772a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:51.588630 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-57e5f917-fb24-4b20-a281-519534bb772a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:51.590616 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 883/1760] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:42:51 2022] DELETE /identity/v3/projects/0e8baf3f193a456493b264c37f080785 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:51.596300 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9dac7-88b3-41f5-8b03-d43d82d8fdf3 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:51.597746 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9dac7-88b3-41f5-8b03-d43d82d8fdf3 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:51.597746 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9dac7-88b3-41f5-8b03-d43d82d8fdf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:51.618887 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-b9b9dac7-88b3-41f5-8b03-d43d82d8fdf3 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:51.620170 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-b9b9dac7-88b3-41f5-8b03-d43d82d8fdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:51.690090 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 878/1761] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:51.697986 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528715d9-f50c-4a33-821e-da585919e286 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:51.698517 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528715d9-f50c-4a33-821e-da585919e286 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:51.698880 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528715d9-f50c-4a33-821e-da585919e286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:51.727132 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-528715d9-f50c-4a33-821e-da585919e286 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:51.728418 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-528715d9-f50c-4a33-821e-da585919e286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:51.738116 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 884/1762] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:51.742463 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9dac7-88b3-41f5-8b03-d43d82d8fdf3 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:51.753485 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9dac7-88b3-41f5-8b03-d43d82d8fdf3 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:51.759342 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b56b4e-854b-4c84-b820-43fcf2b0e6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:51.760039 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b56b4e-854b-4c84-b820-43fcf2b0e6a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:51.760482 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b56b4e-854b-4c84-b820-43fcf2b0e6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:51.760842 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b56b4e-854b-4c84-b820-43fcf2b0e6a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:51.761543 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b56b4e-854b-4c84-b820-43fcf2b0e6a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:42:51.761844 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b56b4e-854b-4c84-b820-43fcf2b0e6a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:51.763827 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b56b4e-854b-4c84-b820-43fcf2b0e6a2 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:51.782198 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 879/1763] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:42:51.783631 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528715d9-f50c-4a33-821e-da585919e286 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:51.800711 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528715d9-f50c-4a33-821e-da585919e286 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:51.806335 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700adffa-eac5-4308-8c8a-193ff3751999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:51.807016 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700adffa-eac5-4308-8c8a-193ff3751999 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:51.807625 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700adffa-eac5-4308-8c8a-193ff3751999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:51.807625 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700adffa-eac5-4308-8c8a-193ff3751999 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:51.808366 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700adffa-eac5-4308-8c8a-193ff3751999 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:51.810473 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700adffa-eac5-4308-8c8a-193ff3751999 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:51.926605 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 885/1764] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:42:51 2022] POST /identity/v3/projects => generated 371 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:51.934119 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b56b4e-854b-4c84-b820-43fcf2b0e6a2 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:51.945112 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b56b4e-854b-4c84-b820-43fcf2b0e6a2 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:52.007411 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832914c-626d-4147-a2b0-09e7822c800a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:52.008316 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832914c-626d-4147-a2b0-09e7822c800a admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:52.008449 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832914c-626d-4147-a2b0-09e7822c800a admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:52.008748 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832914c-626d-4147-a2b0-09e7822c800a admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:52.009577 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5832914c-626d-4147-a2b0-09e7822c800a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:52.011518 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5832914c-626d-4147-a2b0-09e7822c800a admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:52.095979 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 880/1765] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:42:51 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:42:52.100083 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700adffa-eac5-4308-8c8a-193ff3751999 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:52.111577 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700adffa-eac5-4308-8c8a-193ff3751999 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:52.116515 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c60a3-5fd4-4619-90c6-118457cdf02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:52.117141 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c60a3-5fd4-4619-90c6-118457cdf02e admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:52.117419 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c60a3-5fd4-4619-90c6-118457cdf02e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:52.117688 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c60a3-5fd4-4619-90c6-118457cdf02e admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:52.118353 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c60a3-5fd4-4619-90c6-118457cdf02e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:52.119946 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c60a3-5fd4-4619-90c6-118457cdf02e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:52.131976 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 886/1766] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:52.135946 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832914c-626d-4147-a2b0-09e7822c800a admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:52.146197 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832914c-626d-4147-a2b0-09e7822c800a admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:52.151322 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986f819-be3b-4d59-b216-ad582b05953c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:52.151913 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986f819-be3b-4d59-b216-ad582b05953c admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:52.152224 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986f819-be3b-4d59-b216-ad582b05953c admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:52.152496 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986f819-be3b-4d59-b216-ad582b05953c admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:52.153119 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986f819-be3b-4d59-b216-ad582b05953c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:52.154688 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986f819-be3b-4d59-b216-ad582b05953c admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:52.156184 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:52.166609 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 881/1767] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:52.170883 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c60a3-5fd4-4619-90c6-118457cdf02e admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:52.181834 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c60a3-5fd4-4619-90c6-118457cdf02e admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:52.186436 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276eb24f-4526-4a7d-8a6a-926de65dc162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:52.187085 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276eb24f-4526-4a7d-8a6a-926de65dc162 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:52.187361 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276eb24f-4526-4a7d-8a6a-926de65dc162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:52.187632 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276eb24f-4526-4a7d-8a6a-926de65dc162 admin admin] PATH_INFO: `/v3/projects/e50b63f347c248d8a029c0b631b71fc3/users/c4c2265eb27b4b3c843c7b5e9cd6cc81/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:52.202438 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276eb24f-4526-4a7d-8a6a-926de65dc162 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e50b63f347c248d8a029c0b631b71fc3, user_id=c4c2265eb27b4b3c843c7b5e9cd6cc81, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:52.205313 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276eb24f-4526-4a7d-8a6a-926de65dc162 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:52.288446 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 887/1768] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:52 2022] PUT /identity/v3/projects/e50b63f347c248d8a029c0b631b71fc3/users/c4c2265eb27b4b3c843c7b5e9cd6cc81/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:52.301557 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f154256-a720-4569-9619-8ed860203a75 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:52.301838 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f154256-a720-4569-9619-8ed860203a75 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:52.302112 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f154256-a720-4569-9619-8ed860203a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:52.329933 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-0f154256-a720-4569-9619-8ed860203a75 None None] MFA Rules not processed for user `c4c2265eb27b4b3c843c7b5e9cd6cc81`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:52.331143 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-0f154256-a720-4569-9619-8ed860203a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:52.404176 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 882/1769] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:52.418396 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276eb24f-4526-4a7d-8a6a-926de65dc162 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:52.420172 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-276eb24f-4526-4a7d-8a6a-926de65dc162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:52.471588 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:52.486863 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276eb24f-4526-4a7d-8a6a-926de65dc162 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:52.490897 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286879f8-4c2a-4929-840a-4dda06837fe4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:52.491553 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286879f8-4c2a-4929-840a-4dda06837fe4 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:52.491832 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286879f8-4c2a-4929-840a-4dda06837fe4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:52.492139 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286879f8-4c2a-4929-840a-4dda06837fe4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:52.501338 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286879f8-4c2a-4929-840a-4dda06837fe4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:52.502797 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286879f8-4c2a-4929-840a-4dda06837fe4 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:52.513051 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 888/1770] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:52.537588 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f154256-a720-4569-9619-8ed860203a75 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:52.616540 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f154256-a720-4569-9619-8ed860203a75 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:52.624682 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49ce15-1efc-4899-960a-ccd0c58c8548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:52.624682 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49ce15-1efc-4899-960a-ccd0c58c8548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:52.624682 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49ce15-1efc-4899-960a-ccd0c58c8548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:52.624682 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49ce15-1efc-4899-960a-ccd0c58c8548 admin admin] PATH_INFO: `/v3/users/c4c2265eb27b4b3c843c7b5e9cd6cc81` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:52.626641 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c49ce15-1efc-4899-960a-ccd0c58c8548 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4c2265eb27b4b3c843c7b5e9cd6cc81)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:52.628622 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c49ce15-1efc-4899-960a-ccd0c58c8548 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:52.970991 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-6c49ce15-1efc-4899-960a-ccd0c58c8548 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4c2265eb27b4b3c843c7b5e9cd6cc81'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:52.983629 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-6c49ce15-1efc-4899-960a-ccd0c58c8548 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4c2265eb27b4b3c843c7b5e9cd6cc81'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:52.993532 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-6c49ce15-1efc-4899-960a-ccd0c58c8548 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4c2265eb27b4b3c843c7b5e9cd6cc81'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:52.994284 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-6c49ce15-1efc-4899-960a-ccd0c58c8548 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4c2265eb27b4b3c843c7b5e9cd6cc81'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:52.994926 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-6c49ce15-1efc-4899-960a-ccd0c58c8548 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4c2265eb27b4b3c843c7b5e9cd6cc81'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:53.074614 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 883/1771] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:42:52 2022] DELETE /identity/v3/users/c4c2265eb27b4b3c843c7b5e9cd6cc81 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:53.079860 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a818b7-31b2-4144-b7f5-b795d6ac48a5 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:53.080171 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a818b7-31b2-4144-b7f5-b795d6ac48a5 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:53.080443 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a818b7-31b2-4144-b7f5-b795d6ac48a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:53.102006 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-f1a818b7-31b2-4144-b7f5-b795d6ac48a5 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:53.103202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f1a818b7-31b2-4144-b7f5-b795d6ac48a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:53.183402 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 889/1772] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:53.192799 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49ce15-1efc-4899-960a-ccd0c58c8548 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:53.194417 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-6c49ce15-1efc-4899-960a-ccd0c58c8548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:53.201829 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:53.288273 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49ce15-1efc-4899-960a-ccd0c58c8548 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:53.302525 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813174a-b328-49e6-828f-14cafe97fc68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:53.302525 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813174a-b328-49e6-828f-14cafe97fc68 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:53.302525 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813174a-b328-49e6-828f-14cafe97fc68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:53.302525 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813174a-b328-49e6-828f-14cafe97fc68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:53.310389 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813174a-b328-49e6-828f-14cafe97fc68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:53.311847 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813174a-b328-49e6-828f-14cafe97fc68 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:53.323950 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 884/1773] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:53.875495 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a818b7-31b2-4144-b7f5-b795d6ac48a5 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:53.877897 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f1a818b7-31b2-4144-b7f5-b795d6ac48a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:53.890868 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a818b7-31b2-4144-b7f5-b795d6ac48a5 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:53.897102 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f81628-055a-499c-88d3-bce0d82efe85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:53.898199 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f81628-055a-499c-88d3-bce0d82efe85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:53.898472 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f81628-055a-499c-88d3-bce0d82efe85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:53.898904 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f81628-055a-499c-88d3-bce0d82efe85 admin admin] PATH_INFO: `/v3/projects/e50b63f347c248d8a029c0b631b71fc3` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:53.904020 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f81628-055a-499c-88d3-bce0d82efe85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e50b63f347c248d8a029c0b631b71fc3)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:53.904020 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f81628-055a-499c-88d3-bce0d82efe85 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:54.097532 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a6f81628-055a-499c-88d3-bce0d82efe85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e50b63f347c248d8a029c0b631b71fc3', 'request_id': 'req-a6f81628-055a-499c-88d3-bce0d82efe85'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:54.104216 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a6f81628-055a-499c-88d3-bce0d82efe85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e50b63f347c248d8a029c0b631b71fc3', 'request_id': 'req-a6f81628-055a-499c-88d3-bce0d82efe85'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:54.112523 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a6f81628-055a-499c-88d3-bce0d82efe85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e50b63f347c248d8a029c0b631b71fc3', 'request_id': 'req-a6f81628-055a-499c-88d3-bce0d82efe85'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:54.235098 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a6f81628-055a-499c-88d3-bce0d82efe85 admin admin] The token cache is being invalidate because project e50b63f347c248d8a029c0b631b71fc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:42:54.243953 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a6f81628-055a-499c-88d3-bce0d82efe85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:54.243953 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a6f81628-055a-499c-88d3-bce0d82efe85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:54.243953 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 890/1774] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:42:53 2022] DELETE /identity/v3/projects/e50b63f347c248d8a029c0b631b71fc3 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:54.244314 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4faed20-ece0-4eeb-92dc-c43637048000 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:54.244314 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4faed20-ece0-4eeb-92dc-c43637048000 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:54.244314 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4faed20-ece0-4eeb-92dc-c43637048000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:54.272247 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-a4faed20-ece0-4eeb-92dc-c43637048000 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:54.273537 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a4faed20-ece0-4eeb-92dc-c43637048000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:54.405399 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 885/1775] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:54.416029 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96981df-8152-49dc-a6e8-51c1a50842fc None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:54.420491 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96981df-8152-49dc-a6e8-51c1a50842fc None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:54.420854 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96981df-8152-49dc-a6e8-51c1a50842fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:54.457091 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-d96981df-8152-49dc-a6e8-51c1a50842fc None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:54.460188 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d96981df-8152-49dc-a6e8-51c1a50842fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:54.476459 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 891/1776] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:54.477589 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4faed20-ece0-4eeb-92dc-c43637048000 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:54.495934 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4faed20-ece0-4eeb-92dc-c43637048000 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:54.504318 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f553d88-e223-4f80-a4f6-5d90f28af59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:54.505251 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f553d88-e223-4f80-a4f6-5d90f28af59f admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:54.506481 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f553d88-e223-4f80-a4f6-5d90f28af59f admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:54.507551 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f553d88-e223-4f80-a4f6-5d90f28af59f admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:54.508761 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f553d88-e223-4f80-a4f6-5d90f28af59f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:42:54.509068 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f553d88-e223-4f80-a4f6-5d90f28af59f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:54.510786 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f553d88-e223-4f80-a4f6-5d90f28af59f admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:54.525494 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 886/1777] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:42:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:42:54.534945 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96981df-8152-49dc-a6e8-51c1a50842fc None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:54.545196 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96981df-8152-49dc-a6e8-51c1a50842fc None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:54.551254 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74388130-b28e-4a60-87fa-cc3fe8baad93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:54.552226 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74388130-b28e-4a60-87fa-cc3fe8baad93 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:54.552703 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74388130-b28e-4a60-87fa-cc3fe8baad93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:54.553177 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74388130-b28e-4a60-87fa-cc3fe8baad93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:54.554003 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74388130-b28e-4a60-87fa-cc3fe8baad93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:54.555938 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74388130-b28e-4a60-87fa-cc3fe8baad93 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:54.652131 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 892/1778] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:42:54 2022] POST /identity/v3/projects => generated 359 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:54.657066 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f553d88-e223-4f80-a4f6-5d90f28af59f admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:54.692316 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f553d88-e223-4f80-a4f6-5d90f28af59f admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:54.765704 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b63af-d156-4b3a-aece-bbff07b924c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:54.765704 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b63af-d156-4b3a-aece-bbff07b924c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:54.767394 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b63af-d156-4b3a-aece-bbff07b924c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:54.767394 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b63af-d156-4b3a-aece-bbff07b924c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:54.767797 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b63af-d156-4b3a-aece-bbff07b924c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:54.769914 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b63af-d156-4b3a-aece-bbff07b924c7 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:54.879232 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 887/1779] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:42:54 2022] POST /identity/v3/users => generated 280 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:54.883642 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74388130-b28e-4a60-87fa-cc3fe8baad93 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:54.896196 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74388130-b28e-4a60-87fa-cc3fe8baad93 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:54.904368 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd263a-f51e-4fa9-a88e-c964c17d266f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:54.905129 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd263a-f51e-4fa9-a88e-c964c17d266f admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:54.906114 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd263a-f51e-4fa9-a88e-c964c17d266f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:54.906468 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd263a-f51e-4fa9-a88e-c964c17d266f admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:54.907415 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd263a-f51e-4fa9-a88e-c964c17d266f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:54.909578 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd263a-f51e-4fa9-a88e-c964c17d266f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:54.920380 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 893/1780] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:54.925028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b63af-d156-4b3a-aece-bbff07b924c7 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:54.935216 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b63af-d156-4b3a-aece-bbff07b924c7 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:54.940646 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a278390-d937-42d2-83cf-b943d362df0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:54.941331 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a278390-d937-42d2-83cf-b943d362df0d admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:54.941613 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a278390-d937-42d2-83cf-b943d362df0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:54.941888 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a278390-d937-42d2-83cf-b943d362df0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:54.942541 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a278390-d937-42d2-83cf-b943d362df0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:54.944174 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a278390-d937-42d2-83cf-b943d362df0d admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:54.955880 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 888/1781] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:54.960141 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd263a-f51e-4fa9-a88e-c964c17d266f admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:54.970449 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd263a-f51e-4fa9-a88e-c964c17d266f admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:54.975305 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b107d-1575-4c03-9795-e17525eddae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:54.976126 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b107d-1575-4c03-9795-e17525eddae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:54.976478 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b107d-1575-4c03-9795-e17525eddae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:54.976819 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b107d-1575-4c03-9795-e17525eddae4 admin admin] PATH_INFO: `/v3/projects/9e4ae9779cda4412bf2dcec0301e9ef6/users/4ce37803e9c94a0aa37e273f4a2c0b6a/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:54.999938 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b107d-1575-4c03-9795-e17525eddae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e4ae9779cda4412bf2dcec0301e9ef6, user_id=4ce37803e9c94a0aa37e273f4a2c0b6a, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:55.003068 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b107d-1575-4c03-9795-e17525eddae4 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:55.075286 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 894/1782] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:54 2022] PUT /identity/v3/projects/9e4ae9779cda4412bf2dcec0301e9ef6/users/4ce37803e9c94a0aa37e273f4a2c0b6a/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:55.086381 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8de8c-5247-4697-9d64-798cb666bc19 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:55.086694 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8de8c-5247-4697-9d64-798cb666bc19 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:55.086972 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8de8c-5247-4697-9d64-798cb666bc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:55.117206 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:55.120863 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-cfa8de8c-5247-4697-9d64-798cb666bc19 None None] MFA Rules not processed for user `4ce37803e9c94a0aa37e273f4a2c0b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:55.122163 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-cfa8de8c-5247-4697-9d64-798cb666bc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:55.203966 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 889/1783] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:55 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:55.249188 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b107d-1575-4c03-9795-e17525eddae4 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:55.251883 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ea2b107d-1575-4c03-9795-e17525eddae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:55.259701 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:55.273541 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489cc87-4098-465e-8adf-14b0088274b5 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:55.274090 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489cc87-4098-465e-8adf-14b0088274b5 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:55.274211 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489cc87-4098-465e-8adf-14b0088274b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:55.306435 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-4489cc87-4098-465e-8adf-14b0088274b5 None None] MFA Rules not processed for user `4c1f411e3e3f4d2a8c2cab3d5ac05411`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:55.308744 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-4489cc87-4098-465e-8adf-14b0088274b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:55.373753 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b107d-1575-4c03-9795-e17525eddae4 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:55.379337 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45861c64-bbad-4da6-9c3d-40be2a9204bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:55.379828 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45861c64-bbad-4da6-9c3d-40be2a9204bb service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:55.380148 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45861c64-bbad-4da6-9c3d-40be2a9204bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:55.380426 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45861c64-bbad-4da6-9c3d-40be2a9204bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:55.422367 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45861c64-bbad-4da6-9c3d-40be2a9204bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:55.422367 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45861c64-bbad-4da6-9c3d-40be2a9204bb service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:55.422367 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 895/1784] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:55 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:55.436537 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45861c64-bbad-4da6-9c3d-40be2a9204bb service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:55.440507 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 890/1785] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:55.558634 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45861c64-bbad-4da6-9c3d-40be2a9204bb service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:55.565859 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3896e-448a-4307-bb80-63867330e7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:55.566805 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3896e-448a-4307-bb80-63867330e7ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:55.567086 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3896e-448a-4307-bb80-63867330e7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:55.567360 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3896e-448a-4307-bb80-63867330e7ee admin admin] PATH_INFO: `/v3/users/4ce37803e9c94a0aa37e273f4a2c0b6a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:55.569239 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad3896e-448a-4307-bb80-63867330e7ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ce37803e9c94a0aa37e273f4a2c0b6a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:55.571372 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad3896e-448a-4307-bb80-63867330e7ee admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:55.843751 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4ad3896e-448a-4307-bb80-63867330e7ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ce37803e9c94a0aa37e273f4a2c0b6a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:55.873674 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4ad3896e-448a-4307-bb80-63867330e7ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ce37803e9c94a0aa37e273f4a2c0b6a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:55.886027 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4ad3896e-448a-4307-bb80-63867330e7ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ce37803e9c94a0aa37e273f4a2c0b6a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:55.900862 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4ad3896e-448a-4307-bb80-63867330e7ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ce37803e9c94a0aa37e273f4a2c0b6a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:55.901918 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4ad3896e-448a-4307-bb80-63867330e7ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ce37803e9c94a0aa37e273f4a2c0b6a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:56.031542 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 896/1786] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:42:55 2022] DELETE /identity/v3/users/4ce37803e9c94a0aa37e273f4a2c0b6a => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:56.036914 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8939b18-07aa-438d-865e-693e0e449036 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:56.037201 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8939b18-07aa-438d-865e-693e0e449036 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:56.037477 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8939b18-07aa-438d-865e-693e0e449036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:56.072227 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-a8939b18-07aa-438d-865e-693e0e449036 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:56.076841 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a8939b18-07aa-438d-865e-693e0e449036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:56.160807 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 891/1787] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:56.171078 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3896e-448a-4307-bb80-63867330e7ee admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:56.172732 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4ad3896e-448a-4307-bb80-63867330e7ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:56.227372 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:56.336745 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3896e-448a-4307-bb80-63867330e7ee admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:56.353212 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54ad5d-0236-4122-a657-c84a5ecb3e9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:56.355399 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54ad5d-0236-4122-a657-c84a5ecb3e9a service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:56.356712 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54ad5d-0236-4122-a657-c84a5ecb3e9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:56.357223 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54ad5d-0236-4122-a657-c84a5ecb3e9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:56.373252 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54ad5d-0236-4122-a657-c84a5ecb3e9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:56.374744 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54ad5d-0236-4122-a657-c84a5ecb3e9a service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:56.387017 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 897/1788] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:42:56.765369 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c8652-e848-48fe-abc3-c5c94b37af6f None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:56.766252 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c8652-e848-48fe-abc3-c5c94b37af6f None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:56.766809 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c8652-e848-48fe-abc3-c5c94b37af6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:56.794322 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-653c8652-e848-48fe-abc3-c5c94b37af6f None None] MFA Rules not processed for user `047b50cfb513438dbda9cdd89b578062`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:56.795744 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-653c8652-e848-48fe-abc3-c5c94b37af6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:56.850685 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:56.875490 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 892/1789] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:57.047492 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54ad5d-0236-4122-a657-c84a5ecb3e9a service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:57.049741 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-cf54ad5d-0236-4122-a657-c84a5ecb3e9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:57.070607 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54ad5d-0236-4122-a657-c84a5ecb3e9a service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:57.075856 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68cc60e-46dc-4670-a5ac-e82168d7a08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:57.076652 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cc60e-46dc-4670-a5ac-e82168d7a08d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:57.076936 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cc60e-46dc-4670-a5ac-e82168d7a08d admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:57.077204 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cc60e-46dc-4670-a5ac-e82168d7a08d admin admin] PATH_INFO: `/v3/projects/9e4ae9779cda4412bf2dcec0301e9ef6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:57.078630 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68cc60e-46dc-4670-a5ac-e82168d7a08d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e4ae9779cda4412bf2dcec0301e9ef6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:57.081532 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68cc60e-46dc-4670-a5ac-e82168d7a08d admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:57.291674 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b68cc60e-46dc-4670-a5ac-e82168d7a08d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e4ae9779cda4412bf2dcec0301e9ef6', 'request_id': 'req-b68cc60e-46dc-4670-a5ac-e82168d7a08d'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:57.299090 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b68cc60e-46dc-4670-a5ac-e82168d7a08d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e4ae9779cda4412bf2dcec0301e9ef6', 'request_id': 'req-b68cc60e-46dc-4670-a5ac-e82168d7a08d'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:57.306837 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b68cc60e-46dc-4670-a5ac-e82168d7a08d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e4ae9779cda4412bf2dcec0301e9ef6', 'request_id': 'req-b68cc60e-46dc-4670-a5ac-e82168d7a08d'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:57.432973 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b68cc60e-46dc-4670-a5ac-e82168d7a08d admin admin] The token cache is being invalidate because project 9e4ae9779cda4412bf2dcec0301e9ef6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:42:57.433458 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b68cc60e-46dc-4670-a5ac-e82168d7a08d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:57.434602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b68cc60e-46dc-4670-a5ac-e82168d7a08d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:57.436797 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 898/1790] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:42:57 2022] DELETE /identity/v3/projects/9e4ae9779cda4412bf2dcec0301e9ef6 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:57.443071 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de363f-eb50-4252-b3f8-ed9285eefacb None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:57.443363 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de363f-eb50-4252-b3f8-ed9285eefacb None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:57.443641 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de363f-eb50-4252-b3f8-ed9285eefacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:57.463901 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-97de363f-eb50-4252-b3f8-ed9285eefacb None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:57.465190 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-97de363f-eb50-4252-b3f8-ed9285eefacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:57.525136 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 893/1791] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:57.533515 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13be6b-c73b-4e62-8053-e8aa27859f02 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:57.533903 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13be6b-c73b-4e62-8053-e8aa27859f02 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:57.534267 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13be6b-c73b-4e62-8053-e8aa27859f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:57.554320 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-6a13be6b-c73b-4e62-8053-e8aa27859f02 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:57.555444 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6a13be6b-c73b-4e62-8053-e8aa27859f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:57.564025 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 899/1792] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:57.571463 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de363f-eb50-4252-b3f8-ed9285eefacb None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:57.581581 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de363f-eb50-4252-b3f8-ed9285eefacb None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:57.586100 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e944742-8e60-484e-aa1d-e75b86ec3a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:57.586694 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e944742-8e60-484e-aa1d-e75b86ec3a1f admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:57.586969 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e944742-8e60-484e-aa1d-e75b86ec3a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:57.587241 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e944742-8e60-484e-aa1d-e75b86ec3a1f admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:57.587866 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e944742-8e60-484e-aa1d-e75b86ec3a1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:42:57.588197 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e944742-8e60-484e-aa1d-e75b86ec3a1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:57.589836 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e944742-8e60-484e-aa1d-e75b86ec3a1f admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:57.601389 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 894/1793] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:42:57.605859 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13be6b-c73b-4e62-8053-e8aa27859f02 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:57.616288 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13be6b-c73b-4e62-8053-e8aa27859f02 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:57.621100 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c4531-bccf-451b-9956-55af9df7ea31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:57.621700 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c4531-bccf-451b-9956-55af9df7ea31 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:57.621977 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c4531-bccf-451b-9956-55af9df7ea31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:57.622281 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c4531-bccf-451b-9956-55af9df7ea31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:57.622918 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c4531-bccf-451b-9956-55af9df7ea31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:57.624858 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c4531-bccf-451b-9956-55af9df7ea31 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:57.741707 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 900/1794] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:42:57 2022] POST /identity/v3/projects => generated 397 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:57.745969 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e944742-8e60-484e-aa1d-e75b86ec3a1f admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:57.757087 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e944742-8e60-484e-aa1d-e75b86ec3a1f admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:57.832348 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3d123-4298-4b17-bfef-74a40e997c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:57.833073 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3d123-4298-4b17-bfef-74a40e997c06 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:57.833337 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3d123-4298-4b17-bfef-74a40e997c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:57.833610 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3d123-4298-4b17-bfef-74a40e997c06 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:57.834244 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c3d123-4298-4b17-bfef-74a40e997c06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:57.836833 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c3d123-4298-4b17-bfef-74a40e997c06 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:57.962596 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 895/1795] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:42:57 2022] POST /identity/v3/users => generated 299 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:57.966454 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c4531-bccf-451b-9956-55af9df7ea31 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:57.977127 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c4531-bccf-451b-9956-55af9df7ea31 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:57.981817 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fe51d-aab8-45ea-9952-ad4e1caa04a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:57.982435 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fe51d-aab8-45ea-9952-ad4e1caa04a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:57.982715 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fe51d-aab8-45ea-9952-ad4e1caa04a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:57.982983 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fe51d-aab8-45ea-9952-ad4e1caa04a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:57.983621 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6fe51d-aab8-45ea-9952-ad4e1caa04a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:57.985784 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6fe51d-aab8-45ea-9952-ad4e1caa04a2 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:58.000169 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 901/1796] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:58.002583 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3d123-4298-4b17-bfef-74a40e997c06 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:58.013492 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3d123-4298-4b17-bfef-74a40e997c06 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:58.018613 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71178d0c-ed94-46a0-85ad-3bd3829c44df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:58.019259 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71178d0c-ed94-46a0-85ad-3bd3829c44df admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:58.019536 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71178d0c-ed94-46a0-85ad-3bd3829c44df admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:58.019805 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71178d0c-ed94-46a0-85ad-3bd3829c44df admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:58.020465 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71178d0c-ed94-46a0-85ad-3bd3829c44df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:58.022135 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71178d0c-ed94-46a0-85ad-3bd3829c44df admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:58.033469 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 896/1797] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:58.037716 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fe51d-aab8-45ea-9952-ad4e1caa04a2 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:58.049581 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fe51d-aab8-45ea-9952-ad4e1caa04a2 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:58.054316 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8b93f-3e63-46a3-bc33-37a27e532da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:58.054974 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8b93f-3e63-46a3-bc33-37a27e532da6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:58.055423 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8b93f-3e63-46a3-bc33-37a27e532da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:58.055695 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8b93f-3e63-46a3-bc33-37a27e532da6 admin admin] PATH_INFO: `/v3/projects/c6f009ace5e84a33a3f8ebdc95a253aa/users/b7b59c5578164ed19d8d88fea49950a0/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:58.073672 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8b93f-3e63-46a3-bc33-37a27e532da6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6f009ace5e84a33a3f8ebdc95a253aa, user_id=b7b59c5578164ed19d8d88fea49950a0, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:58.076485 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8b93f-3e63-46a3-bc33-37a27e532da6 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:58.217522 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 902/1798] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:58 2022] PUT /identity/v3/projects/c6f009ace5e84a33a3f8ebdc95a253aa/users/b7b59c5578164ed19d8d88fea49950a0/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:58.229273 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8deeb-8e5b-4538-a7c2-41bd107deb23 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:58.229555 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8deeb-8e5b-4538-a7c2-41bd107deb23 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:58.229825 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8deeb-8e5b-4538-a7c2-41bd107deb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:58.260478 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-a0f8deeb-8e5b-4538-a7c2-41bd107deb23 None None] MFA Rules not processed for user `b7b59c5578164ed19d8d88fea49950a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:58.261691 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a0f8deeb-8e5b-4538-a7c2-41bd107deb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:58.315068 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:58.346794 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 897/1799] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:42:58 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:58.356571 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8b93f-3e63-46a3-bc33-37a27e532da6 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:58.358846 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a8b8b93f-3e63-46a3-bc33-37a27e532da6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:58.415513 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:58.421199 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8b93f-3e63-46a3-bc33-37a27e532da6 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:58.425278 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ae512-343a-4bfc-bde5-b2c3d6035cd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:58.426099 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ae512-343a-4bfc-bde5-b2c3d6035cd3 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:58.426373 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ae512-343a-4bfc-bde5-b2c3d6035cd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:58.426744 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ae512-343a-4bfc-bde5-b2c3d6035cd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:58.435950 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ae512-343a-4bfc-bde5-b2c3d6035cd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:58.437445 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ae512-343a-4bfc-bde5-b2c3d6035cd3 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:58.446546 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 903/1800] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:58 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:04.875623 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8deeb-8e5b-4538-a7c2-41bd107deb23 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:04.991495 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8deeb-8e5b-4538-a7c2-41bd107deb23 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:05.005069 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641631c-aa7a-43a5-a5d9-b2eddde054d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:05.006165 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641631c-aa7a-43a5-a5d9-b2eddde054d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:05.007065 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641631c-aa7a-43a5-a5d9-b2eddde054d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:05.007391 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641631c-aa7a-43a5-a5d9-b2eddde054d9 admin admin] PATH_INFO: `/v3/users/b7b59c5578164ed19d8d88fea49950a0` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:05.009428 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8641631c-aa7a-43a5-a5d9-b2eddde054d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7b59c5578164ed19d8d88fea49950a0)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:05.011406 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8641631c-aa7a-43a5-a5d9-b2eddde054d9 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:05.195631 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-8641631c-aa7a-43a5-a5d9-b2eddde054d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7b59c5578164ed19d8d88fea49950a0'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:05.210783 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-8641631c-aa7a-43a5-a5d9-b2eddde054d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7b59c5578164ed19d8d88fea49950a0'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:05.220313 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-8641631c-aa7a-43a5-a5d9-b2eddde054d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7b59c5578164ed19d8d88fea49950a0'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:05.222058 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-8641631c-aa7a-43a5-a5d9-b2eddde054d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7b59c5578164ed19d8d88fea49950a0'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:05.222820 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-8641631c-aa7a-43a5-a5d9-b2eddde054d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7b59c5578164ed19d8d88fea49950a0'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:05.302470 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 898/1801] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:43:04 2022] DELETE /identity/v3/users/b7b59c5578164ed19d8d88fea49950a0 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:05.303364 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6867d-da26-4826-8dd9-f05e24bda091 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:05.303767 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6867d-da26-4826-8dd9-f05e24bda091 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:05.303937 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6867d-da26-4826-8dd9-f05e24bda091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:05.332789 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-daf6867d-da26-4826-8dd9-f05e24bda091 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:05.334781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-daf6867d-da26-4826-8dd9-f05e24bda091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:05.449022 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 904/1802] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:43:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:05.465685 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641631c-aa7a-43a5-a5d9-b2eddde054d9 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:05.467685 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-8641631c-aa7a-43a5-a5d9-b2eddde054d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:05.582467 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641631c-aa7a-43a5-a5d9-b2eddde054d9 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:05.586409 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2469f-a826-4469-8a1f-5ce0c489513e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:05.589274 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2469f-a826-4469-8a1f-5ce0c489513e service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:05.589274 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2469f-a826-4469-8a1f-5ce0c489513e service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:05.589274 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2469f-a826-4469-8a1f-5ce0c489513e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:05.602157 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2469f-a826-4469-8a1f-5ce0c489513e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:05.603599 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2469f-a826-4469-8a1f-5ce0c489513e service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:05.616640 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 899/1803] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:43:06.117453 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf6867d-da26-4826-8dd9-f05e24bda091 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:06.119109 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-daf6867d-da26-4826-8dd9-f05e24bda091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:06.133263 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf6867d-da26-4826-8dd9-f05e24bda091 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:06.139296 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46887593-f472-4130-8765-be0f999cd99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:06.140084 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46887593-f472-4130-8765-be0f999cd99c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:06.140748 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46887593-f472-4130-8765-be0f999cd99c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:06.141204 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46887593-f472-4130-8765-be0f999cd99c admin admin] PATH_INFO: `/v3/projects/c6f009ace5e84a33a3f8ebdc95a253aa` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:06.146313 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46887593-f472-4130-8765-be0f999cd99c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6f009ace5e84a33a3f8ebdc95a253aa)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:06.146313 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46887593-f472-4130-8765-be0f999cd99c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:06.258576 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-46887593-f472-4130-8765-be0f999cd99c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6f009ace5e84a33a3f8ebdc95a253aa', 'request_id': 'req-46887593-f472-4130-8765-be0f999cd99c'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:06.264339 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-46887593-f472-4130-8765-be0f999cd99c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6f009ace5e84a33a3f8ebdc95a253aa', 'request_id': 'req-46887593-f472-4130-8765-be0f999cd99c'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:06.270857 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-46887593-f472-4130-8765-be0f999cd99c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6f009ace5e84a33a3f8ebdc95a253aa', 'request_id': 'req-46887593-f472-4130-8765-be0f999cd99c'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:06.422624 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-46887593-f472-4130-8765-be0f999cd99c admin admin] The token cache is being invalidate because project c6f009ace5e84a33a3f8ebdc95a253aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:43:06.423214 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-46887593-f472-4130-8765-be0f999cd99c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:06.423581 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-46887593-f472-4130-8765-be0f999cd99c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:06.425404 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 905/1804] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:43:06 2022] DELETE /identity/v3/projects/c6f009ace5e84a33a3f8ebdc95a253aa => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:06.430382 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69134cac-8264-487a-bbe0-7b18a3bede44 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:06.430784 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69134cac-8264-487a-bbe0-7b18a3bede44 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:06.430973 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69134cac-8264-487a-bbe0-7b18a3bede44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:06.452289 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-69134cac-8264-487a-bbe0-7b18a3bede44 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:06.453502 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-69134cac-8264-487a-bbe0-7b18a3bede44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:06.459757 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:06.512650 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 900/1805] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:06.521167 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6aae6-845d-4323-ae8b-f28a6e3f588e None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:06.521453 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6aae6-845d-4323-ae8b-f28a6e3f588e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:06.521726 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6aae6-845d-4323-ae8b-f28a6e3f588e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:06.542408 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-22e6aae6-845d-4323-ae8b-f28a6e3f588e None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:06.543615 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-22e6aae6-845d-4323-ae8b-f28a6e3f588e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:06.551774 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 906/1806] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:06.562063 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69134cac-8264-487a-bbe0-7b18a3bede44 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:06.572817 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69134cac-8264-487a-bbe0-7b18a3bede44 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:06.577670 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ee74e-90d5-4bb5-842b-03a4e1bd84d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:06.578267 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ee74e-90d5-4bb5-842b-03a4e1bd84d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:06.578535 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ee74e-90d5-4bb5-842b-03a4e1bd84d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:06.578820 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ee74e-90d5-4bb5-842b-03a4e1bd84d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:06.579442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ee74e-90d5-4bb5-842b-03a4e1bd84d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:43:06.579759 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ee74e-90d5-4bb5-842b-03a4e1bd84d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:06.582009 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ee74e-90d5-4bb5-842b-03a4e1bd84d4 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:06.593675 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 901/1807] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:43:06.599316 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6aae6-845d-4323-ae8b-f28a6e3f588e None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:06.608094 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6aae6-845d-4323-ae8b-f28a6e3f588e None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:06.612987 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca10f46-7283-4596-bdb9-2f5b62d192f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:06.613828 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca10f46-7283-4596-bdb9-2f5b62d192f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:06.613961 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca10f46-7283-4596-bdb9-2f5b62d192f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:06.614605 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca10f46-7283-4596-bdb9-2f5b62d192f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:06.614808 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca10f46-7283-4596-bdb9-2f5b62d192f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:06.617256 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca10f46-7283-4596-bdb9-2f5b62d192f6 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:06.714979 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 907/1808] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:06 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:06.719053 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ee74e-90d5-4bb5-842b-03a4e1bd84d4 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:06.729865 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ee74e-90d5-4bb5-842b-03a4e1bd84d4 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:06.789755 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc351faf-7f51-40c4-b44c-3ee99e720811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:06.790057 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc351faf-7f51-40c4-b44c-3ee99e720811 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:06.790337 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc351faf-7f51-40c4-b44c-3ee99e720811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:06.790930 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc351faf-7f51-40c4-b44c-3ee99e720811 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:06.791472 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc351faf-7f51-40c4-b44c-3ee99e720811 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:06.793434 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc351faf-7f51-40c4-b44c-3ee99e720811 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:06.890768 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 902/1809] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:06 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:06.904929 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca10f46-7283-4596-bdb9-2f5b62d192f6 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:06.907289 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca10f46-7283-4596-bdb9-2f5b62d192f6 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:06.912064 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d3917-84a9-4e87-8642-5e2198f0f874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:06.912672 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d3917-84a9-4e87-8642-5e2198f0f874 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:06.912945 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d3917-84a9-4e87-8642-5e2198f0f874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:06.913212 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d3917-84a9-4e87-8642-5e2198f0f874 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:06.913885 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d3917-84a9-4e87-8642-5e2198f0f874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:06.915482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d3917-84a9-4e87-8642-5e2198f0f874 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:06.925525 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 908/1810] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:06.929638 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc351faf-7f51-40c4-b44c-3ee99e720811 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:06.940310 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc351faf-7f51-40c4-b44c-3ee99e720811 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:06.945071 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128871d-2703-4115-88a0-522a279aae6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:06.945618 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128871d-2703-4115-88a0-522a279aae6c admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:06.945898 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128871d-2703-4115-88a0-522a279aae6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:06.946164 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128871d-2703-4115-88a0-522a279aae6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:06.946791 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b128871d-2703-4115-88a0-522a279aae6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:06.948400 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b128871d-2703-4115-88a0-522a279aae6c admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:06.959948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 903/1811] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:43:06.964146 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d3917-84a9-4e87-8642-5e2198f0f874 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:06.974123 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d3917-84a9-4e87-8642-5e2198f0f874 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:06.980360 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5f559-82d0-4768-b790-7bbd38c51c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:06.980360 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5f559-82d0-4768-b790-7bbd38c51c7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:06.980360 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5f559-82d0-4768-b790-7bbd38c51c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:06.980360 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5f559-82d0-4768-b790-7bbd38c51c7b admin admin] PATH_INFO: `/v3/projects/2cb2e21ffdc046aabfd5c05bc8f5123b/users/92177a17953c4c579ac8aec0f350a000/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:06.995593 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f5f559-82d0-4768-b790-7bbd38c51c7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cb2e21ffdc046aabfd5c05bc8f5123b, user_id=92177a17953c4c579ac8aec0f350a000, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:06.998282 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f5f559-82d0-4768-b790-7bbd38c51c7b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:07.094866 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 909/1812] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:06 2022] PUT /identity/v3/projects/2cb2e21ffdc046aabfd5c05bc8f5123b/users/92177a17953c4c579ac8aec0f350a000/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:07.101172 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef2170-27d8-417e-a84b-6eeabd2eb01a None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:07.101462 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef2170-27d8-417e-a84b-6eeabd2eb01a None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:07.101910 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef2170-27d8-417e-a84b-6eeabd2eb01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:07.126652 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-c6ef2170-27d8-417e-a84b-6eeabd2eb01a None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:07.128709 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c6ef2170-27d8-417e-a84b-6eeabd2eb01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:07.205850 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 904/1813] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:43:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:07.215604 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5f559-82d0-4768-b790-7bbd38c51c7b admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:07.217826 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-39f5f559-82d0-4768-b790-7bbd38c51c7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:07.231445 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:07.291623 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5f559-82d0-4768-b790-7bbd38c51c7b admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:07.295628 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1585a-142b-43b9-b777-99188f42a687 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:07.296331 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1585a-142b-43b9-b777-99188f42a687 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:07.296610 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1585a-142b-43b9-b777-99188f42a687 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:07.300388 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1585a-142b-43b9-b777-99188f42a687 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:07.308253 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1585a-142b-43b9-b777-99188f42a687 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:07.309249 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1585a-142b-43b9-b777-99188f42a687 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:07.320172 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 910/1814] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:10.427649 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe4670-22ce-446a-859c-b1284a4baf48 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:10.428539 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe4670-22ce-446a-859c-b1284a4baf48 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:10.429100 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe4670-22ce-446a-859c-b1284a4baf48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:10.459343 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-56fe4670-22ce-446a-859c-b1284a4baf48 None None] MFA Rules not processed for user `193e45cadb3c4586ab94051c42cf5192`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:10.471522 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-56fe4670-22ce-446a-859c-b1284a4baf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:10.488558 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:10.562389 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 905/1815] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:43:10 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:43:12.027253 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1585a-142b-43b9-b777-99188f42a687 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:12.029984 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0cc1585a-142b-43b9-b777-99188f42a687 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:12.059286 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1585a-142b-43b9-b777-99188f42a687 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:12.081705 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307bee59-1368-4c4c-986b-53e68e1d897f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:12.082372 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bee59-1368-4c4c-986b-53e68e1d897f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:12.082651 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bee59-1368-4c4c-986b-53e68e1d897f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:12.082924 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bee59-1368-4c4c-986b-53e68e1d897f admin admin] PATH_INFO: `/v3/users/269f912b8d5b4a5181044688245dc635` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:12.084243 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307bee59-1368-4c4c-986b-53e68e1d897f admin admin] RBAC: Authorizing `identity:delete_user(user_id=269f912b8d5b4a5181044688245dc635)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:12.086188 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307bee59-1368-4c4c-986b-53e68e1d897f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:12.398266 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-307bee59-1368-4c4c-986b-53e68e1d897f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '269f912b8d5b4a5181044688245dc635'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:12.416974 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-307bee59-1368-4c4c-986b-53e68e1d897f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '269f912b8d5b4a5181044688245dc635'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:12.417767 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-307bee59-1368-4c4c-986b-53e68e1d897f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '269f912b8d5b4a5181044688245dc635'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:12.429715 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-307bee59-1368-4c4c-986b-53e68e1d897f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '269f912b8d5b4a5181044688245dc635'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:12.430741 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-307bee59-1368-4c4c-986b-53e68e1d897f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '269f912b8d5b4a5181044688245dc635'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:12.536485 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 911/1816] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:43:12 2022] DELETE /identity/v3/users/269f912b8d5b4a5181044688245dc635 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:12.538389 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdc38f-028f-45ab-aed1-c4120f7951ab None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:12.538808 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdc38f-028f-45ab-aed1-c4120f7951ab None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:12.538808 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdc38f-028f-45ab-aed1-c4120f7951ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:12.562323 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-24bdc38f-028f-45ab-aed1-c4120f7951ab None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:12.563699 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-24bdc38f-028f-45ab-aed1-c4120f7951ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:12.657624 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 906/1817] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:43:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:12.663049 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307bee59-1368-4c4c-986b-53e68e1d897f admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:12.665689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-307bee59-1368-4c4c-986b-53e68e1d897f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:12.777627 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307bee59-1368-4c4c-986b-53e68e1d897f admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:12.783736 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd884f11-c3e3-462a-9163-c33dd0efc3c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:12.784649 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd884f11-c3e3-462a-9163-c33dd0efc3c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:12.785394 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd884f11-c3e3-462a-9163-c33dd0efc3c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:12.786657 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd884f11-c3e3-462a-9163-c33dd0efc3c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:12.808279 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd884f11-c3e3-462a-9163-c33dd0efc3c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:12.808279 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd884f11-c3e3-462a-9163-c33dd0efc3c2 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:12.832895 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 912/1818] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:13.517061 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bdc38f-028f-45ab-aed1-c4120f7951ab None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:13.518721 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-24bdc38f-028f-45ab-aed1-c4120f7951ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:13.539688 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bdc38f-028f-45ab-aed1-c4120f7951ab None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:13.545274 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba59088-5c37-47d2-a730-84e0276842d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:13.545946 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba59088-5c37-47d2-a730-84e0276842d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:13.546222 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba59088-5c37-47d2-a730-84e0276842d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:13.546489 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba59088-5c37-47d2-a730-84e0276842d6 admin admin] PATH_INFO: `/v3/projects/a710ae4a244341bcafe05df6c7c10701` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:13.548125 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba59088-5c37-47d2-a730-84e0276842d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a710ae4a244341bcafe05df6c7c10701)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:13.551183 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba59088-5c37-47d2-a730-84e0276842d6 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:13.723523 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-aba59088-5c37-47d2-a730-84e0276842d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a710ae4a244341bcafe05df6c7c10701', 'request_id': 'req-aba59088-5c37-47d2-a730-84e0276842d6'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:13.734311 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-aba59088-5c37-47d2-a730-84e0276842d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a710ae4a244341bcafe05df6c7c10701', 'request_id': 'req-aba59088-5c37-47d2-a730-84e0276842d6'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:13.742153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-aba59088-5c37-47d2-a730-84e0276842d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a710ae4a244341bcafe05df6c7c10701', 'request_id': 'req-aba59088-5c37-47d2-a730-84e0276842d6'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:13.869039 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-aba59088-5c37-47d2-a730-84e0276842d6 admin admin] The token cache is being invalidate because project a710ae4a244341bcafe05df6c7c10701 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:43:13.869626 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-aba59088-5c37-47d2-a730-84e0276842d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:13.871414 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-aba59088-5c37-47d2-a730-84e0276842d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:13.876691 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 907/1819] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:43:13 2022] DELETE /identity/v3/projects/a710ae4a244341bcafe05df6c7c10701 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:13.883327 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191a763-8bb0-4c38-90e2-57cfd254e359 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:13.883780 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191a763-8bb0-4c38-90e2-57cfd254e359 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:13.883870 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191a763-8bb0-4c38-90e2-57cfd254e359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:13.929073 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8831fd-f7b9-47c3-a35b-778b2ed32b33 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:13.934716 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8831fd-f7b9-47c3-a35b-778b2ed32b33 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:13.934716 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8831fd-f7b9-47c3-a35b-778b2ed32b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:13.944745 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-3191a763-8bb0-4c38-90e2-57cfd254e359 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:13.946138 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3191a763-8bb0-4c38-90e2-57cfd254e359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:13.997687 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:14.020750 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-ca8831fd-f7b9-47c3-a35b-778b2ed32b33 None None] MFA Rules not processed for user `0c65f5001a224e0b92e94dc6df9f8f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:14.020750 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-ca8831fd-f7b9-47c3-a35b-778b2ed32b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:14.060955 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 913/1820] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:43:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:14.069870 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd43ae-144a-4c74-a844-38ba46c4558a None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:14.070162 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd43ae-144a-4c74-a844-38ba46c4558a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:14.070615 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd43ae-144a-4c74-a844-38ba46c4558a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:14.105807 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-f7dd43ae-144a-4c74-a844-38ba46c4558a None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:14.107366 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f7dd43ae-144a-4c74-a844-38ba46c4558a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:14.109930 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:14.119996 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 914/1821] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:14.123850 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dd43ae-144a-4c74-a844-38ba46c4558a None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:14.136732 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 908/1822] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Nov 2 07:43:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:14.150481 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dd43ae-144a-4c74-a844-38ba46c4558a None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:14.159794 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e69858-3dc4-4252-833e-7b5d23b3a283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:14.160464 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e69858-3dc4-4252-833e-7b5d23b3a283 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:14.160743 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e69858-3dc4-4252-833e-7b5d23b3a283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:14.161019 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e69858-3dc4-4252-833e-7b5d23b3a283 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:14.161751 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e69858-3dc4-4252-833e-7b5d23b3a283 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:43:14.162068 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e69858-3dc4-4252-833e-7b5d23b3a283 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:14.163692 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e69858-3dc4-4252-833e-7b5d23b3a283 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:14.188028 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 915/1823] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:43:14.193286 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8831fd-f7b9-47c3-a35b-778b2ed32b33 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:14.195409 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e69858-3dc4-4252-833e-7b5d23b3a283 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:14.201533 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f9e69858-3dc4-4252-833e-7b5d23b3a283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:14.209796 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8831fd-f7b9-47c3-a35b-778b2ed32b33 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:14.216933 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a092889-1f1c-4340-9796-b11dff511129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:14.217600 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a092889-1f1c-4340-9796-b11dff511129 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:14.217944 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a092889-1f1c-4340-9796-b11dff511129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:14.218281 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a092889-1f1c-4340-9796-b11dff511129 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:14.218990 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a092889-1f1c-4340-9796-b11dff511129 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:14.222594 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a092889-1f1c-4340-9796-b11dff511129 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:14.318520 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 909/1824] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:14 2022] POST /identity/v3/projects => generated 381 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:43:14.319631 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a092889-1f1c-4340-9796-b11dff511129 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:14.408082 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a092889-1f1c-4340-9796-b11dff511129 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:14.414539 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40f3b1-b601-45e1-8b13-c514407eda6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:14.415302 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40f3b1-b601-45e1-8b13-c514407eda6c admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:14.415715 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40f3b1-b601-45e1-8b13-c514407eda6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:14.415987 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40f3b1-b601-45e1-8b13-c514407eda6c admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:14.416692 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40f3b1-b601-45e1-8b13-c514407eda6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:14.418705 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40f3b1-b601-45e1-8b13-c514407eda6c admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:14.422804 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e69858-3dc4-4252-833e-7b5d23b3a283 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:14.521697 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 910/1825] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:14 2022] POST /identity/v3/users => generated 291 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:43:14.523608 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40f3b1-b601-45e1-8b13-c514407eda6c admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:14.544446 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40f3b1-b601-45e1-8b13-c514407eda6c admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:14.551786 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d78fd-02c0-4a06-ab25-2bafa4a00763 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d63a04c2d74c90b95a4f48c49ddb29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:14.554100 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d78fd-02c0-4a06-ab25-2bafa4a00763 service swift] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:14.554567 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d78fd-02c0-4a06-ab25-2bafa4a00763 service swift] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:14.555429 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d78fd-02c0-4a06-ab25-2bafa4a00763 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:14.558359 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad78f73-fa48-477c-9e2d-b92ba028ac85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:14.560071 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad78f73-fa48-477c-9e2d-b92ba028ac85 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:14.560677 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad78f73-fa48-477c-9e2d-b92ba028ac85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:14.562334 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad78f73-fa48-477c-9e2d-b92ba028ac85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:14.565470 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad78f73-fa48-477c-9e2d-b92ba028ac85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:14.569118 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad78f73-fa48-477c-9e2d-b92ba028ac85 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:14.608114 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 911/1826] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:14.619001 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad78f73-fa48-477c-9e2d-b92ba028ac85 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:14.630586 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad78f73-fa48-477c-9e2d-b92ba028ac85 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:14.635399 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc018f0c-fae7-4b82-b0f8-903470e99e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:14.636002 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc018f0c-fae7-4b82-b0f8-903470e99e73 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:14.636316 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc018f0c-fae7-4b82-b0f8-903470e99e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:14.636586 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc018f0c-fae7-4b82-b0f8-903470e99e73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:14.637207 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc018f0c-fae7-4b82-b0f8-903470e99e73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:14.638928 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc018f0c-fae7-4b82-b0f8-903470e99e73 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:14.649021 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d78fd-02c0-4a06-ab25-2bafa4a00763 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:14.650824 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 912/1827] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:14.650956 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d78fd-02c0-4a06-ab25-2bafa4a00763 service swift] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:14.654917 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc018f0c-fae7-4b82-b0f8-903470e99e73 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:14.664356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 916/1828] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Nov 2 07:43:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:43:14.666474 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc018f0c-fae7-4b82-b0f8-903470e99e73 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:14.671588 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598b606-e55b-4b43-93b7-d534bd41b1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:14.672456 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598b606-e55b-4b43-93b7-d534bd41b1d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:14.672731 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598b606-e55b-4b43-93b7-d534bd41b1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:14.673027 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598b606-e55b-4b43-93b7-d534bd41b1d5 admin admin] PATH_INFO: `/v3/projects/48d42fe4742240e48eb3775d20ab7fee/users/9f29c3bb32b2477aa93e38ec57061646/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:14.714892 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598b606-e55b-4b43-93b7-d534bd41b1d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48d42fe4742240e48eb3775d20ab7fee, user_id=9f29c3bb32b2477aa93e38ec57061646, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:14.717637 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598b606-e55b-4b43-93b7-d534bd41b1d5 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:14.842375 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 913/1829] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:14 2022] PUT /identity/v3/projects/48d42fe4742240e48eb3775d20ab7fee/users/9f29c3bb32b2477aa93e38ec57061646/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:43:14.844412 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc27ce-99d5-4345-9d8e-765a3cecbfd9 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:14.844930 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc27ce-99d5-4345-9d8e-765a3cecbfd9 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:14.845546 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc27ce-99d5-4345-9d8e-765a3cecbfd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:14.898000 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-b3dc27ce-99d5-4345-9d8e-765a3cecbfd9 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:14.905988 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b3dc27ce-99d5-4345-9d8e-765a3cecbfd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:15.075996 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 917/1830] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:43:15.093032 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598b606-e55b-4b43-93b7-d534bd41b1d5 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:15.094983 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a598b606-e55b-4b43-93b7-d534bd41b1d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:15.353765 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598b606-e55b-4b43-93b7-d534bd41b1d5 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:15.367494 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdecba0-f106-49b9-8425-ed971278cdbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:15.371444 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdecba0-f106-49b9-8425-ed971278cdbc service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:15.372012 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdecba0-f106-49b9-8425-ed971278cdbc service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:15.374626 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdecba0-f106-49b9-8425-ed971278cdbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:15.413922 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdecba0-f106-49b9-8425-ed971278cdbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:15.420029 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdecba0-f106-49b9-8425-ed971278cdbc service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:15.473212 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 914/1831] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:15.869606 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:16.190772 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d5877-edbe-4248-90aa-4b8526d7a49d None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:16.192566 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d5877-edbe-4248-90aa-4b8526d7a49d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:16.193015 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d5877-edbe-4248-90aa-4b8526d7a49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:16.250861 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-ce9d5877-edbe-4248-90aa-4b8526d7a49d None None] MFA Rules not processed for user `92177a17953c4c579ac8aec0f350a000`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:16.257364 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ce9d5877-edbe-4248-90aa-4b8526d7a49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:16.534098 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 918/1832] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:43:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:16.535303 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdecba0-f106-49b9-8425-ed971278cdbc service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:16.537027 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-8bdecba0-f106-49b9-8425-ed971278cdbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:16.557688 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdecba0-f106-49b9-8425-ed971278cdbc service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:16.572970 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2291ee91-b5d9-442c-90c7-1e686694c3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:16.573598 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291ee91-b5d9-442c-90c7-1e686694c3fd admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:16.573980 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291ee91-b5d9-442c-90c7-1e686694c3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:16.574126 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291ee91-b5d9-442c-90c7-1e686694c3fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:16.574761 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2291ee91-b5d9-442c-90c7-1e686694c3fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:16.579049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2291ee91-b5d9-442c-90c7-1e686694c3fd admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:16.634248 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:16.762393 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 915/1833] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:16 2022] POST /identity/v3/projects => generated 385 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:16.765684 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d5877-edbe-4248-90aa-4b8526d7a49d None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:16.804281 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d5877-edbe-4248-90aa-4b8526d7a49d None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:16.929929 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2c187-bbcd-4617-8f93-a22d763861ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:16.930571 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2c187-bbcd-4617-8f93-a22d763861ac admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:16.930851 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2c187-bbcd-4617-8f93-a22d763861ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:16.931126 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2c187-bbcd-4617-8f93-a22d763861ac admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:16.931779 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2c187-bbcd-4617-8f93-a22d763861ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:16.934999 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2c187-bbcd-4617-8f93-a22d763861ac admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:17.061546 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 919/1834] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:16 2022] POST /identity/v3/users => generated 299 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:17.063633 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2291ee91-b5d9-442c-90c7-1e686694c3fd admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:17.084490 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2291ee91-b5d9-442c-90c7-1e686694c3fd admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:17.110533 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d03b5-b56c-4b61-8506-783ecb4da7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:17.111873 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d03b5-b56c-4b61-8506-783ecb4da7c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:17.113835 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d03b5-b56c-4b61-8506-783ecb4da7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:17.114293 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d03b5-b56c-4b61-8506-783ecb4da7c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:17.115138 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d03b5-b56c-4b61-8506-783ecb4da7c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:17.117221 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d03b5-b56c-4b61-8506-783ecb4da7c7 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:17.147667 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2c187-bbcd-4617-8f93-a22d763861ac admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:17.157822 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 916/1835] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:17.165667 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2c187-bbcd-4617-8f93-a22d763861ac admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:17.186971 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7df696-2a4b-4305-962e-67cbc6528831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:17.187663 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7df696-2a4b-4305-962e-67cbc6528831 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:17.188037 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7df696-2a4b-4305-962e-67cbc6528831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:17.188321 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7df696-2a4b-4305-962e-67cbc6528831 admin admin] PATH_INFO: `/v3/projects/7dd44070793f454a9dc1916c16816469/users/5f6c3a40953b40a7be6d194dc33d9275/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:17.212621 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:17.240751 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7df696-2a4b-4305-962e-67cbc6528831 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dd44070793f454a9dc1916c16816469, user_id=5f6c3a40953b40a7be6d194dc33d9275, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:17.251141 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7df696-2a4b-4305-962e-67cbc6528831 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:17.402078 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 920/1836] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:17 2022] PUT /identity/v3/projects/7dd44070793f454a9dc1916c16816469/users/5f6c3a40953b40a7be6d194dc33d9275/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:43:17.403410 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d03b5-b56c-4b61-8506-783ecb4da7c7 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:17.419713 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d03b5-b56c-4b61-8506-783ecb4da7c7 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:17.504555 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940164f6-2fa0-4509-aef9-7af78e181c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:17.505522 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940164f6-2fa0-4509-aef9-7af78e181c5d admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:17.505889 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940164f6-2fa0-4509-aef9-7af78e181c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:17.506287 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940164f6-2fa0-4509-aef9-7af78e181c5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:17.507115 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940164f6-2fa0-4509-aef9-7af78e181c5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:17.509828 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940164f6-2fa0-4509-aef9-7af78e181c5d admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:17.541170 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 917/1837] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:17.547645 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7df696-2a4b-4305-962e-67cbc6528831 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:17.565130 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7df696-2a4b-4305-962e-67cbc6528831 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:17.598890 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d62094-53f8-4c38-b11c-51b4b18210dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:17.602617 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d62094-53f8-4c38-b11c-51b4b18210dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:17.602617 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d62094-53f8-4c38-b11c-51b4b18210dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:17.602617 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d62094-53f8-4c38-b11c-51b4b18210dd admin admin] PATH_INFO: `/v3/projects/7dd44070793f454a9dc1916c16816469/users/5f6c3a40953b40a7be6d194dc33d9275/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:17.636892 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d62094-53f8-4c38-b11c-51b4b18210dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dd44070793f454a9dc1916c16816469, user_id=5f6c3a40953b40a7be6d194dc33d9275, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:17.642245 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d62094-53f8-4c38-b11c-51b4b18210dd admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:17.672681 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 921/1838] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:17 2022] PUT /identity/v3/projects/7dd44070793f454a9dc1916c16816469/users/5f6c3a40953b40a7be6d194dc33d9275/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:19.601695 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637f820-4336-4744-9164-f3b34cc544f7 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:19.602961 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637f820-4336-4744-9164-f3b34cc544f7 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:19.603400 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637f820-4336-4744-9164-f3b34cc544f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:19.674511 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-d637f820-4336-4744-9164-f3b34cc544f7 None None] MFA Rules not processed for user `9f29c3bb32b2477aa93e38ec57061646`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:19.674511 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-d637f820-4336-4744-9164-f3b34cc544f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:19.765329 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 918/1839] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:43:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:19.778186 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d62094-53f8-4c38-b11c-51b4b18210dd admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:19.782828 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-40d62094-53f8-4c38-b11c-51b4b18210dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:19.873853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d62094-53f8-4c38-b11c-51b4b18210dd admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:19.879189 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131db831-fe5d-464a-899e-93dddb2d8dfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:19.880390 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131db831-fe5d-464a-899e-93dddb2d8dfd service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:19.880821 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131db831-fe5d-464a-899e-93dddb2d8dfd service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:19.881291 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131db831-fe5d-464a-899e-93dddb2d8dfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:19.892335 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131db831-fe5d-464a-899e-93dddb2d8dfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:19.895952 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131db831-fe5d-464a-899e-93dddb2d8dfd service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:19.908772 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 922/1840] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:19 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:23.594226 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ea63d-2627-4b2e-afe4-19f577669c72 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:23.594789 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ea63d-2627-4b2e-afe4-19f577669c72 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:23.594923 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ea63d-2627-4b2e-afe4-19f577669c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:23.615714 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-3c1ea63d-2627-4b2e-afe4-19f577669c72 None None] MFA Rules not processed for user `9f29c3bb32b2477aa93e38ec57061646`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:23.619502 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-3c1ea63d-2627-4b2e-afe4-19f577669c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:23.644125 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 919/1841] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:43:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:43:29.905216 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=36,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:30.679251 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22b745-4b1a-4abd-a204-97bb27639951 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:30.679538 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22b745-4b1a-4abd-a204-97bb27639951 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:30.679811 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22b745-4b1a-4abd-a204-97bb27639951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:30.767326 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-0b22b745-4b1a-4abd-a204-97bb27639951 None None] MFA Rules not processed for user `5f6c3a40953b40a7be6d194dc33d9275`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:30.768946 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0b22b745-4b1a-4abd-a204-97bb27639951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:30.966131 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 923/1842] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:43:30 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:30.975540 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ea63d-2627-4b2e-afe4-19f577669c72 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:30.977143 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-3c1ea63d-2627-4b2e-afe4-19f577669c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:31.115339 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ea63d-2627-4b2e-afe4-19f577669c72 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:31.126701 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fc0d3-762d-4dbb-81f4-a2d375b62957 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '475f6e94957a4ae2b1248c8035231ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:31.127496 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fc0d3-762d-4dbb-81f4-a2d375b62957 service glance] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:31.129194 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fc0d3-762d-4dbb-81f4-a2d375b62957 service glance] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:31.130780 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fc0d3-762d-4dbb-81f4-a2d375b62957 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:31.163059 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:31.233483 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166fc0d3-762d-4dbb-81f4-a2d375b62957 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:31.239213 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166fc0d3-762d-4dbb-81f4-a2d375b62957 service glance] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:31.303868 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 920/1843] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:31.770568 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09bf51-9343-49bf-9cc9-349712cf36f0 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:31.770568 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09bf51-9343-49bf-9cc9-349712cf36f0 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:31.770568 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09bf51-9343-49bf-9cc9-349712cf36f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:31.810170 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-0b09bf51-9343-49bf-9cc9-349712cf36f0 None None] MFA Rules not processed for user `0c65f5001a224e0b92e94dc6df9f8f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:31.811802 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0b09bf51-9343-49bf-9cc9-349712cf36f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:31.886780 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 924/1844] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Nov 2 07:43:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:31.931043 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fc0d3-762d-4dbb-81f4-a2d375b62957 service glance] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:32.056535 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fc0d3-762d-4dbb-81f4-a2d375b62957 service glance] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:32.073308 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9f752-35fd-4ee1-adeb-7589575e7091 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d63a04c2d74c90b95a4f48c49ddb29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:32.074130 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9f752-35fd-4ee1-adeb-7589575e7091 service swift] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:32.074580 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9f752-35fd-4ee1-adeb-7589575e7091 service swift] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:32.074981 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9f752-35fd-4ee1-adeb-7589575e7091 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:32.084739 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f9f752-35fd-4ee1-adeb-7589575e7091 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:32.086316 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f9f752-35fd-4ee1-adeb-7589575e7091 service swift] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:32.100171 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 921/1845] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Nov 2 07:43:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:43:38.875907 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5bc2d-4537-473b-b84c-697cedcbd47e None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:38.876786 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5bc2d-4537-473b-b84c-697cedcbd47e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:38.876786 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5bc2d-4537-473b-b84c-697cedcbd47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:38.898999 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-9ae5bc2d-4537-473b-b84c-697cedcbd47e None None] MFA Rules not processed for user `0c65f5001a224e0b92e94dc6df9f8f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:38.900495 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9ae5bc2d-4537-473b-b84c-697cedcbd47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:38.909189 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 925/1846] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Nov 2 07:43:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:38.932735 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9f752-35fd-4ee1-adeb-7589575e7091 service swift] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:38.950873 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9f752-35fd-4ee1-adeb-7589575e7091 service swift] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:38.958889 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a2d3d-c7c0-434a-9ed9-449996d78e80 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d63a04c2d74c90b95a4f48c49ddb29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:38.960332 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a2d3d-c7c0-434a-9ed9-449996d78e80 service swift] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:38.960769 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a2d3d-c7c0-434a-9ed9-449996d78e80 service swift] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:38.965111 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a2d3d-c7c0-434a-9ed9-449996d78e80 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:38.974393 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a2d3d-c7c0-434a-9ed9-449996d78e80 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:38.976185 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a2d3d-c7c0-434a-9ed9-449996d78e80 service swift] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:38.988137 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 922/1847] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Nov 2 07:43:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:43:47.960595 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e75554-2a0f-4ba9-a25b-8b686d0a0bb1 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:47.961656 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e75554-2a0f-4ba9-a25b-8b686d0a0bb1 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:47.962163 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e75554-2a0f-4ba9-a25b-8b686d0a0bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:48.038224 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-f1e75554-2a0f-4ba9-a25b-8b686d0a0bb1 None None] MFA Rules not processed for user `92177a17953c4c579ac8aec0f350a000`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:48.042551 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f1e75554-2a0f-4ba9-a25b-8b686d0a0bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:48.055965 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 926/1848] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:43:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:48.441586 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb55ca2-a201-4105-b89a-35dc4463c136 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:48.442109 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb55ca2-a201-4105-b89a-35dc4463c136 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:48.442237 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb55ca2-a201-4105-b89a-35dc4463c136 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:48.443493 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 923/1849] 10.222.0.16 () {54 vars in 921 bytes} [Wed Nov 2 07:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:43:48.452073 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54488f-13a6-49aa-8838-a2351da20256 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:48.454209 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54488f-13a6-49aa-8838-a2351da20256 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:48.454209 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54488f-13a6-49aa-8838-a2351da20256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:48.511284 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-bf54488f-13a6-49aa-8838-a2351da20256 None None] MFA Rules not processed for user `232210eabdfd4969a348d7333c50c438`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:48.514494 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-bf54488f-13a6-49aa-8838-a2351da20256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:48.639118 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 927/1850] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Nov 2 07:43:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:48.653497 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb55ca2-a201-4105-b89a-35dc4463c136 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:48.675239 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb55ca2-a201-4105-b89a-35dc4463c136 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:48.685520 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb42ad1-9295-40b6-90b3-16ce57faf732 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '475f6e94957a4ae2b1248c8035231ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:48.686511 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb42ad1-9295-40b6-90b3-16ce57faf732 service glance] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:48.687704 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb42ad1-9295-40b6-90b3-16ce57faf732 service glance] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:48.688858 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb42ad1-9295-40b6-90b3-16ce57faf732 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:48.709393 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb42ad1-9295-40b6-90b3-16ce57faf732 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:48.711221 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb42ad1-9295-40b6-90b3-16ce57faf732 service glance] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:48.735441 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 924/1851] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:49.092382 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14a615-dadb-41df-b6e3-c34a8a665041 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:49.092962 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14a615-dadb-41df-b6e3-c34a8a665041 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:49.092962 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14a615-dadb-41df-b6e3-c34a8a665041 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:49.095216 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 928/1852] 10.222.0.16 () {54 vars in 921 bytes} [Wed Nov 2 07:43:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:43:49.102219 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03ed36-f10a-4e09-b965-3105ce63261b None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:49.102509 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03ed36-f10a-4e09-b965-3105ce63261b None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:49.102782 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03ed36-f10a-4e09-b965-3105ce63261b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:49.125771 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-2d03ed36-f10a-4e09-b965-3105ce63261b None None] MFA Rules not processed for user `c35fe87fc263440980ce70680748e5af`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:49.127043 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-2d03ed36-f10a-4e09-b965-3105ce63261b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:49.252795 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 925/1853] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Nov 2 07:43:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:49.261351 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14a615-dadb-41df-b6e3-c34a8a665041 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:49.282204 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14a615-dadb-41df-b6e3-c34a8a665041 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:49.292361 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81aeac-0d8c-4ad3-82c6-d2ad51d64271 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:49.293018 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81aeac-0d8c-4ad3-82c6-d2ad51d64271 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:49.293297 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81aeac-0d8c-4ad3-82c6-d2ad51d64271 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:49.293730 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81aeac-0d8c-4ad3-82c6-d2ad51d64271 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:49.301485 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:49.305549 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a81aeac-0d8c-4ad3-82c6-d2ad51d64271 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:49.307378 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a81aeac-0d8c-4ad3-82c6-d2ad51d64271 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:49.319371 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 929/1854] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:49.421707 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc772514-c941-4538-8c89-1dea8ccd83f4 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:49.422277 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc772514-c941-4538-8c89-1dea8ccd83f4 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:49.422626 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc772514-c941-4538-8c89-1dea8ccd83f4 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:49.423995 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 926/1855] 10.222.0.16 () {54 vars in 921 bytes} [Wed Nov 2 07:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:43:49.430819 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355651b4-69e5-4751-bb57-48030b4b98a0 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:49.431443 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355651b4-69e5-4751-bb57-48030b4b98a0 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:49.431951 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355651b4-69e5-4751-bb57-48030b4b98a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:49.474182 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-355651b4-69e5-4751-bb57-48030b4b98a0 None None] MFA Rules not processed for user `232210eabdfd4969a348d7333c50c438`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:49.476397 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-355651b4-69e5-4751-bb57-48030b4b98a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:49.494073 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 930/1856] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Nov 2 07:43:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:49.508343 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc772514-c941-4538-8c89-1dea8ccd83f4 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:49.511022 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-cc772514-c941-4538-8c89-1dea8ccd83f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:49.528848 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc772514-c941-4538-8c89-1dea8ccd83f4 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:49.535065 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7097ead-e95f-4d51-9d0e-a5aa42fdc902 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:49.536575 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7097ead-e95f-4d51-9d0e-a5aa42fdc902 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:49.537050 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7097ead-e95f-4d51-9d0e-a5aa42fdc902 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:49.537651 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7097ead-e95f-4d51-9d0e-a5aa42fdc902 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:49.558843 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7097ead-e95f-4d51-9d0e-a5aa42fdc902 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:49.569318 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7097ead-e95f-4d51-9d0e-a5aa42fdc902 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:49.583093 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 927/1857] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:59.460104 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=5 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:59.577345 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=93 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:02.605652 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6b697-6e39-4f9a-ac28-6885abffc694 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:02.606214 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6b697-6e39-4f9a-ac28-6885abffc694 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:02.606214 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6b697-6e39-4f9a-ac28-6885abffc694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:02.627544 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-c9a6b697-6e39-4f9a-ac28-6885abffc694 None None] MFA Rules not processed for user `0c65f5001a224e0b92e94dc6df9f8f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:02.628797 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c9a6b697-6e39-4f9a-ac28-6885abffc694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:02.636108 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 931/1858] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Nov 2 07:44:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:02.648906 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7097ead-e95f-4d51-9d0e-a5aa42fdc902 service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:02.660504 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7097ead-e95f-4d51-9d0e-a5aa42fdc902 service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:02.665502 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e450fc-55f7-46ed-8c19-621f2bdf6915 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d63a04c2d74c90b95a4f48c49ddb29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:02.666166 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e450fc-55f7-46ed-8c19-621f2bdf6915 service swift] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:02.666461 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e450fc-55f7-46ed-8c19-621f2bdf6915 service swift] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:02.666718 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e450fc-55f7-46ed-8c19-621f2bdf6915 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:02.675807 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e450fc-55f7-46ed-8c19-621f2bdf6915 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:02.677411 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e450fc-55f7-46ed-8c19-621f2bdf6915 service swift] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:02.685681 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 928/1859] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Nov 2 07:44:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:44:04.501254 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e801a-6287-489f-91b0-4eb9fa33b87a None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:04.501753 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e801a-6287-489f-91b0-4eb9fa33b87a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:04.502054 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e801a-6287-489f-91b0-4eb9fa33b87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:04.523312 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-ad6e801a-6287-489f-91b0-4eb9fa33b87a None None] MFA Rules not processed for user `0c65f5001a224e0b92e94dc6df9f8f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:04.524581 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ad6e801a-6287-489f-91b0-4eb9fa33b87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:04.531776 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 932/1860] 10.222.0.16 () {58 vars in 967 bytes} [Wed Nov 2 07:44:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:04.553230 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e450fc-55f7-46ed-8c19-621f2bdf6915 service swift] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:04.572715 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e450fc-55f7-46ed-8c19-621f2bdf6915 service swift] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:04.577889 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ff274-b6aa-4471-b0a8-4b115adfa631 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d63a04c2d74c90b95a4f48c49ddb29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:04.578613 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ff274-b6aa-4471-b0a8-4b115adfa631 service swift] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:04.578915 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ff274-b6aa-4471-b0a8-4b115adfa631 service swift] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:04.579187 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ff274-b6aa-4471-b0a8-4b115adfa631 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:04.589019 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93ff274-b6aa-4471-b0a8-4b115adfa631 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:04.590583 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93ff274-b6aa-4471-b0a8-4b115adfa631 service swift] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:04.598707 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 929/1861] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Nov 2 07:44:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 07:44:09.693645 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d08a34-5a11-4b8d-9bc2-b68fb0d333f0 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:09.694252 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d08a34-5a11-4b8d-9bc2-b68fb0d333f0 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:09.694252 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d08a34-5a11-4b8d-9bc2-b68fb0d333f0 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:09.695543 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 933/1862] 10.222.0.16 () {54 vars in 921 bytes} [Wed Nov 2 07:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:44:09.706708 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287350e-8fd5-47e2-a0a8-8fcfc18c4f52 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:09.708735 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287350e-8fd5-47e2-a0a8-8fcfc18c4f52 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:09.714395 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287350e-8fd5-47e2-a0a8-8fcfc18c4f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:09.731925 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-c287350e-8fd5-47e2-a0a8-8fcfc18c4f52 None None] MFA Rules not processed for user `741c9fc71c80438faa037c85f4997c3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:09.733179 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c287350e-8fd5-47e2-a0a8-8fcfc18c4f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:09.821404 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 930/1863] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Nov 2 07:44:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:44:09.835127 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d08a34-5a11-4b8d-9bc2-b68fb0d333f0 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:09.837111 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-29d08a34-5a11-4b8d-9bc2-b68fb0d333f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:09.872856 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d08a34-5a11-4b8d-9bc2-b68fb0d333f0 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:09.887980 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a6fa4-9b63-486c-a85e-4ead25aab928 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '741c9fc71c80438faa037c85f4997c3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:09.891692 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a6fa4-9b63-486c-a85e-4ead25aab928 service placement] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:09.891692 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a6fa4-9b63-486c-a85e-4ead25aab928 service placement] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:09.891692 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a6fa4-9b63-486c-a85e-4ead25aab928 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:09.901157 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a6fa4-9b63-486c-a85e-4ead25aab928 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:09.903574 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a6fa4-9b63-486c-a85e-4ead25aab928 service placement] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:09.916363 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 934/1864] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:44:09.924118 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287350e-8fd5-47e2-a0a8-8fcfc18c4f52 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:09.943360 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c287350e-8fd5-47e2-a0a8-8fcfc18c4f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:10.073450 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287350e-8fd5-47e2-a0a8-8fcfc18c4f52 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:10.078302 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d95fd-ec1d-4398-99e3-c0706e59b310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:10.078831 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d95fd-ec1d-4398-99e3-c0706e59b310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:10.079105 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d95fd-ec1d-4398-99e3-c0706e59b310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:10.079372 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d95fd-ec1d-4398-99e3-c0706e59b310 admin admin] PATH_INFO: `/v3/users/4c1f411e3e3f4d2a8c2cab3d5ac05411` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:10.080589 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d95fd-ec1d-4398-99e3-c0706e59b310 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c1f411e3e3f4d2a8c2cab3d5ac05411)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:10.082674 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d95fd-ec1d-4398-99e3-c0706e59b310 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:10.515121 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-0c1d95fd-ec1d-4398-99e3-c0706e59b310 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c1f411e3e3f4d2a8c2cab3d5ac05411'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:10.530747 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-0c1d95fd-ec1d-4398-99e3-c0706e59b310 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c1f411e3e3f4d2a8c2cab3d5ac05411'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:10.537327 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:10.539668 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-0c1d95fd-ec1d-4398-99e3-c0706e59b310 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c1f411e3e3f4d2a8c2cab3d5ac05411'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:10.540427 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-0c1d95fd-ec1d-4398-99e3-c0706e59b310 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c1f411e3e3f4d2a8c2cab3d5ac05411'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:10.541047 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-0c1d95fd-ec1d-4398-99e3-c0706e59b310 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c1f411e3e3f4d2a8c2cab3d5ac05411'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:10.847847 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 931/1865] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:44:09 2022] DELETE /identity/v3/users/4c1f411e3e3f4d2a8c2cab3d5ac05411 => generated 0 bytes in 924 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:11.166995 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a6fa4-9b63-486c-a85e-4ead25aab928 service placement] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:11.194323 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a6fa4-9b63-486c-a85e-4ead25aab928 service placement] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:11.299769 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a238155f-3f66-4306-95a9-7a0490268d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:11.300468 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238155f-3f66-4306-95a9-7a0490268d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:11.301709 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238155f-3f66-4306-95a9-7a0490268d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:11.302398 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238155f-3f66-4306-95a9-7a0490268d1d admin admin] PATH_INFO: `/v3/projects/270fb02de7b34458b28272689606d249` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:11.304161 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a238155f-3f66-4306-95a9-7a0490268d1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=270fb02de7b34458b28272689606d249)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:11.306777 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a238155f-3f66-4306-95a9-7a0490268d1d admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:11.506077 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a238155f-3f66-4306-95a9-7a0490268d1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '270fb02de7b34458b28272689606d249', 'request_id': 'req-a238155f-3f66-4306-95a9-7a0490268d1d'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:11.513812 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a238155f-3f66-4306-95a9-7a0490268d1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '270fb02de7b34458b28272689606d249', 'request_id': 'req-a238155f-3f66-4306-95a9-7a0490268d1d'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:11.524217 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a238155f-3f66-4306-95a9-7a0490268d1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '270fb02de7b34458b28272689606d249', 'request_id': 'req-a238155f-3f66-4306-95a9-7a0490268d1d'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:11.617486 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a238155f-3f66-4306-95a9-7a0490268d1d admin admin] The token cache is being invalidate because project 270fb02de7b34458b28272689606d249 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:44:11.619495 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a238155f-3f66-4306-95a9-7a0490268d1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:11.619992 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a238155f-3f66-4306-95a9-7a0490268d1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:11.623031 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 935/1866] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:44:11 2022] DELETE /identity/v3/projects/270fb02de7b34458b28272689606d249 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:11.628172 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22970407-c643-4a6e-ac70-a0b83f670a70 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:11.629538 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22970407-c643-4a6e-ac70-a0b83f670a70 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:11.630019 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22970407-c643-4a6e-ac70-a0b83f670a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:11.663801 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-22970407-c643-4a6e-ac70-a0b83f670a70 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:11.666684 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-22970407-c643-4a6e-ac70-a0b83f670a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:11.733455 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 932/1867] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:44:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:11.741811 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ffaf4-60af-465c-9628-a39a48366529 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:11.742332 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ffaf4-60af-465c-9628-a39a48366529 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:11.742739 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ffaf4-60af-465c-9628-a39a48366529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:11.764988 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-175ffaf4-60af-465c-9628-a39a48366529 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:11.766411 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-175ffaf4-60af-465c-9628-a39a48366529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:11.778333 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 936/1868] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:44:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:11.780629 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22970407-c643-4a6e-ac70-a0b83f670a70 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:11.792866 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22970407-c643-4a6e-ac70-a0b83f670a70 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:11.797605 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10993d83-6b79-46d6-aa32-f6da021175e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:11.798275 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10993d83-6b79-46d6-aa32-f6da021175e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:11.798620 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10993d83-6b79-46d6-aa32-f6da021175e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:11.798956 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10993d83-6b79-46d6-aa32-f6da021175e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:11.799662 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10993d83-6b79-46d6-aa32-f6da021175e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:44:11.800025 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10993d83-6b79-46d6-aa32-f6da021175e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:11.802341 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10993d83-6b79-46d6-aa32-f6da021175e2 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:11.817930 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 933/1869] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:44:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:44:11.820869 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ffaf4-60af-465c-9628-a39a48366529 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:11.830171 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ffaf4-60af-465c-9628-a39a48366529 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:11.835045 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d244f-4a10-40c6-a5d5-d345bf1440af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:11.835638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d244f-4a10-40c6-a5d5-d345bf1440af admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:11.835907 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d244f-4a10-40c6-a5d5-d345bf1440af admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:11.836208 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d244f-4a10-40c6-a5d5-d345bf1440af admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:11.836829 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d244f-4a10-40c6-a5d5-d345bf1440af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:11.838716 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d244f-4a10-40c6-a5d5-d345bf1440af admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:11.960694 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 937/1870] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:44:11 2022] POST /identity/v3/projects => generated 365 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:44:11.966688 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10993d83-6b79-46d6-aa32-f6da021175e2 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:11.977586 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10993d83-6b79-46d6-aa32-f6da021175e2 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:12.033417 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4bb53-05e7-4633-8bc7-19f4aa5f6aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:12.033944 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4bb53-05e7-4633-8bc7-19f4aa5f6aa7 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:12.034218 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4bb53-05e7-4633-8bc7-19f4aa5f6aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:12.034484 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4bb53-05e7-4633-8bc7-19f4aa5f6aa7 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:12.035648 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4bb53-05e7-4633-8bc7-19f4aa5f6aa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:12.037573 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4bb53-05e7-4633-8bc7-19f4aa5f6aa7 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:12.122006 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 934/1871] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:44:11 2022] POST /identity/v3/users => generated 283 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:44:12.123443 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d244f-4a10-40c6-a5d5-d345bf1440af admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:12.135360 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d244f-4a10-40c6-a5d5-d345bf1440af admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:12.140370 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17722dce-2e5a-41e0-abbe-aff615d203b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:12.140984 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17722dce-2e5a-41e0-abbe-aff615d203b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:12.141262 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17722dce-2e5a-41e0-abbe-aff615d203b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:12.141534 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17722dce-2e5a-41e0-abbe-aff615d203b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:12.142178 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17722dce-2e5a-41e0-abbe-aff615d203b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:12.143790 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17722dce-2e5a-41e0-abbe-aff615d203b0 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:12.155487 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 938/1872] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:44:12.159733 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4bb53-05e7-4633-8bc7-19f4aa5f6aa7 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:12.170328 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4bb53-05e7-4633-8bc7-19f4aa5f6aa7 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:12.174868 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3645b50-8b80-49eb-830f-8849a348c745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:12.175465 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3645b50-8b80-49eb-830f-8849a348c745 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:12.175784 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3645b50-8b80-49eb-830f-8849a348c745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:12.176080 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3645b50-8b80-49eb-830f-8849a348c745 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:12.176726 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3645b50-8b80-49eb-830f-8849a348c745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:12.178329 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3645b50-8b80-49eb-830f-8849a348c745 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:12.189207 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 935/1873] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:44:12.194167 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17722dce-2e5a-41e0-abbe-aff615d203b0 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:12.204847 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17722dce-2e5a-41e0-abbe-aff615d203b0 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:12.210181 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811dd72f-18ff-4a2e-baeb-57e4cf52372a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:12.211403 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811dd72f-18ff-4a2e-baeb-57e4cf52372a admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:12.211857 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811dd72f-18ff-4a2e-baeb-57e4cf52372a admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:12.212328 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811dd72f-18ff-4a2e-baeb-57e4cf52372a admin admin] PATH_INFO: `/v3/projects/89ec1ae42e6149fda7f8c40d5bd39d94/users/46d661ed403d4ce8bbe2b3df4bebe18f/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:12.231274 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811dd72f-18ff-4a2e-baeb-57e4cf52372a admin admin] RBAC: Authorizing `identity:create_grant(project_id=89ec1ae42e6149fda7f8c40d5bd39d94, user_id=46d661ed403d4ce8bbe2b3df4bebe18f, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:12.234099 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811dd72f-18ff-4a2e-baeb-57e4cf52372a admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:12.330693 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:12.335522 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 939/1874] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:44:12 2022] PUT /identity/v3/projects/89ec1ae42e6149fda7f8c40d5bd39d94/users/46d661ed403d4ce8bbe2b3df4bebe18f/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:12.347125 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b36816-1cf5-447c-801f-1734b47acc29 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:12.347954 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b36816-1cf5-447c-801f-1734b47acc29 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:12.348296 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b36816-1cf5-447c-801f-1734b47acc29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:12.379787 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-39b36816-1cf5-447c-801f-1734b47acc29 None None] MFA Rules not processed for user `46d661ed403d4ce8bbe2b3df4bebe18f`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:12.381209 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-39b36816-1cf5-447c-801f-1734b47acc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:12.428367 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:12.449132 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 936/1875] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:44:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:12.461382 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811dd72f-18ff-4a2e-baeb-57e4cf52372a admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:12.463120 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-811dd72f-18ff-4a2e-baeb-57e4cf52372a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:12.520597 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811dd72f-18ff-4a2e-baeb-57e4cf52372a admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:12.525163 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ddd2d4-bc5e-44cf-b9d9-67dabc18feb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:12.525770 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddd2d4-bc5e-44cf-b9d9-67dabc18feb6 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:12.526047 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddd2d4-bc5e-44cf-b9d9-67dabc18feb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:12.526318 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddd2d4-bc5e-44cf-b9d9-67dabc18feb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:12.536008 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ddd2d4-bc5e-44cf-b9d9-67dabc18feb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:12.537555 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ddd2d4-bc5e-44cf-b9d9-67dabc18feb6 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:12.547003 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 940/1876] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:12.884336 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13658e-ff79-46d0-9611-e1b78f599538 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:12.885343 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13658e-ff79-46d0-9611-e1b78f599538 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:12.885343 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13658e-ff79-46d0-9611-e1b78f599538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:12.904540 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-de13658e-ff79-46d0-9611-e1b78f599538 None None] MFA Rules not processed for user `0c65f5001a224e0b92e94dc6df9f8f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:12.905817 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-de13658e-ff79-46d0-9611-e1b78f599538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:12.966536 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 937/1877] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Nov 2 07:44:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:12.983648 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ddd2d4-bc5e-44cf-b9d9-67dabc18feb6 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:12.985046 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-66ddd2d4-bc5e-44cf-b9d9-67dabc18feb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:13.058126 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ddd2d4-bc5e-44cf-b9d9-67dabc18feb6 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:13.063057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae440f3-3774-4787-bd43-dcc89a38d767 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d63a04c2d74c90b95a4f48c49ddb29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:13.063660 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae440f3-3774-4787-bd43-dcc89a38d767 service swift] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:13.063965 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae440f3-3774-4787-bd43-dcc89a38d767 service swift] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:13.064249 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae440f3-3774-4787-bd43-dcc89a38d767 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:13.072962 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae440f3-3774-4787-bd43-dcc89a38d767 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:13.075498 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae440f3-3774-4787-bd43-dcc89a38d767 service swift] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:13.083261 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 941/1878] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Nov 2 07:44:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:44:22.959874 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=32 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:23.079679 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=58 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:26.544722 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13658e-ff79-46d0-9611-e1b78f599538 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:26.547340 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-de13658e-ff79-46d0-9611-e1b78f599538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:26.666754 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13658e-ff79-46d0-9611-e1b78f599538 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:26.688522 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b24e84-7dce-4f05-9e4e-0d8975f2e812 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '741c9fc71c80438faa037c85f4997c3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:26.689230 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b24e84-7dce-4f05-9e4e-0d8975f2e812 service placement] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:26.689573 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b24e84-7dce-4f05-9e4e-0d8975f2e812 service placement] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:26.689847 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b24e84-7dce-4f05-9e4e-0d8975f2e812 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:26.693420 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-08b24e84-7dce-4f05-9e4e-0d8975f2e812 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:26.731401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b24e84-7dce-4f05-9e4e-0d8975f2e812 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:26.733071 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b24e84-7dce-4f05-9e4e-0d8975f2e812 service placement] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:26.744961 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 938/1879] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:32.203536 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571d347-5386-469d-a43f-bbda35afe402 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:32.203536 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571d347-5386-469d-a43f-bbda35afe402 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:32.204151 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571d347-5386-469d-a43f-bbda35afe402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:32.225543 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-d571d347-5386-469d-a43f-bbda35afe402 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:32.227020 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d571d347-5386-469d-a43f-bbda35afe402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:32.307871 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 942/1880] 10.222.0.45 () {58 vars in 1016 bytes} [Wed Nov 2 07:44:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:32.414391 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b24e84-7dce-4f05-9e4e-0d8975f2e812 service placement] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:32.416200 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-08b24e84-7dce-4f05-9e4e-0d8975f2e812 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:32.499343 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b24e84-7dce-4f05-9e4e-0d8975f2e812 service placement] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:32.505903 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac1cfd-2fdc-424f-9d3d-2bfa8e9e8885 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:32.506758 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac1cfd-2fdc-424f-9d3d-2bfa8e9e8885 service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:32.507144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac1cfd-2fdc-424f-9d3d-2bfa8e9e8885 service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:32.507565 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac1cfd-2fdc-424f-9d3d-2bfa8e9e8885 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:32.517307 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac1cfd-2fdc-424f-9d3d-2bfa8e9e8885 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:32.518897 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac1cfd-2fdc-424f-9d3d-2bfa8e9e8885 service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:32.529165 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 939/1881] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:34.243786 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974c17b-62f8-495b-941b-47fbf64fef70 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:34.244328 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974c17b-62f8-495b-941b-47fbf64fef70 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:34.244440 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974c17b-62f8-495b-941b-47fbf64fef70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:34.264555 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-a974c17b-62f8-495b-941b-47fbf64fef70 None None] MFA Rules not processed for user `0c65f5001a224e0b92e94dc6df9f8f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:34.265760 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a974c17b-62f8-495b-941b-47fbf64fef70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:34.273638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 943/1882] 10.222.0.16 () {58 vars in 967 bytes} [Wed Nov 2 07:44:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:34.297150 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac1cfd-2fdc-424f-9d3d-2bfa8e9e8885 service nova] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:34.312719 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac1cfd-2fdc-424f-9d3d-2bfa8e9e8885 service nova] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:34.318475 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aad146-ced0-4bd5-869b-72e34c4ef65f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d63a04c2d74c90b95a4f48c49ddb29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:34.319093 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aad146-ced0-4bd5-869b-72e34c4ef65f service swift] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:34.319534 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aad146-ced0-4bd5-869b-72e34c4ef65f service swift] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:34.319670 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aad146-ced0-4bd5-869b-72e34c4ef65f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:34.330661 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aad146-ced0-4bd5-869b-72e34c4ef65f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:34.332393 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aad146-ced0-4bd5-869b-72e34c4ef65f service swift] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:34.341817 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 940/1883] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Nov 2 07:44:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:44:38.816800 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67461127-a1e6-48c9-aed9-af7ff3c764bf None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:38.817557 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67461127-a1e6-48c9-aed9-af7ff3c764bf None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:38.817557 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67461127-a1e6-48c9-aed9-af7ff3c764bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:38.837865 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-67461127-a1e6-48c9-aed9-af7ff3c764bf None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:38.839074 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-67461127-a1e6-48c9-aed9-af7ff3c764bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:38.847071 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 944/1884] 10.222.0.45 () {58 vars in 1016 bytes} [Wed Nov 2 07:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:38.901779 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aad146-ced0-4bd5-869b-72e34c4ef65f service swift] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:38.915118 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aad146-ced0-4bd5-869b-72e34c4ef65f service swift] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:38.920631 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9dceee-ca9d-4a30-b067-b300e76c7f2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:38.921237 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9dceee-ca9d-4a30-b067-b300e76c7f2e service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:38.921514 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9dceee-ca9d-4a30-b067-b300e76c7f2e service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:38.921849 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9dceee-ca9d-4a30-b067-b300e76c7f2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:38.930588 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9dceee-ca9d-4a30-b067-b300e76c7f2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:38.935265 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9dceee-ca9d-4a30-b067-b300e76c7f2e service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:38.960259 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 941/1885] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:40.327213 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67461127-a1e6-48c9-aed9-af7ff3c764bf None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:40.328841 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-67461127-a1e6-48c9-aed9-af7ff3c764bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:40.392820 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67461127-a1e6-48c9-aed9-af7ff3c764bf None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:40.396935 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acceeac2-2b5c-474e-be70-8fe8ed57a072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:40.397543 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acceeac2-2b5c-474e-be70-8fe8ed57a072 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:40.397817 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acceeac2-2b5c-474e-be70-8fe8ed57a072 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:40.398087 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acceeac2-2b5c-474e-be70-8fe8ed57a072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:40.399815 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-acceeac2-2b5c-474e-be70-8fe8ed57a072 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:40.467497 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acceeac2-2b5c-474e-be70-8fe8ed57a072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:40.468894 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acceeac2-2b5c-474e-be70-8fe8ed57a072 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:40.478488 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 945/1886] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:40 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:46.717205 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd98992-236e-4489-a989-40b79d277362 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:46.717205 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd98992-236e-4489-a989-40b79d277362 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:46.717205 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd98992-236e-4489-a989-40b79d277362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:46.759629 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-bfd98992-236e-4489-a989-40b79d277362 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:46.760906 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-bfd98992-236e-4489-a989-40b79d277362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:46.779749 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 942/1887] 10.222.0.45 () {58 vars in 1016 bytes} [Wed Nov 2 07:44:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:46.992040 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acceeac2-2b5c-474e-be70-8fe8ed57a072 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:46.998570 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-acceeac2-2b5c-474e-be70-8fe8ed57a072 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:47.018171 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acceeac2-2b5c-474e-be70-8fe8ed57a072 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:47.030411 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1dd476-5f53-44d1-81a0-41a6a65bd79d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:47.030411 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1dd476-5f53-44d1-81a0-41a6a65bd79d service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:47.030411 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1dd476-5f53-44d1-81a0-41a6a65bd79d service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:47.030411 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1dd476-5f53-44d1-81a0-41a6a65bd79d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:47.037567 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1dd476-5f53-44d1-81a0-41a6a65bd79d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:47.039364 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1dd476-5f53-44d1-81a0-41a6a65bd79d service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:47.050125 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 946/1888] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:44:51.558014 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71fd5f-6da7-4ec5-bf41-34c3e598d30e None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:51.558557 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71fd5f-6da7-4ec5-bf41-34c3e598d30e None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:51.558557 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71fd5f-6da7-4ec5-bf41-34c3e598d30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:51.579742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-ce71fd5f-6da7-4ec5-bf41-34c3e598d30e None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:51.581164 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-ce71fd5f-6da7-4ec5-bf41-34c3e598d30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:51.590487 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 943/1889] 10.222.0.45 () {58 vars in 1016 bytes} [Wed Nov 2 07:44:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:51.634231 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1dd476-5f53-44d1-81a0-41a6a65bd79d service nova] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:51.654084 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1dd476-5f53-44d1-81a0-41a6a65bd79d service nova] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:51.656499 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b9b57-7d5f-4801-8009-c0bf9b5ab72e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:51.657165 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b9b57-7d5f-4801-8009-c0bf9b5ab72e service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:51.657447 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b9b57-7d5f-4801-8009-c0bf9b5ab72e service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:51.657713 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b9b57-7d5f-4801-8009-c0bf9b5ab72e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:51.667735 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b9b57-7d5f-4801-8009-c0bf9b5ab72e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:51.669387 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b9b57-7d5f-4801-8009-c0bf9b5ab72e service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:51.681877 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 947/1890] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:52.032740 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc430c3-fc59-4ae5-8fc2-17683723daf7 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:52.033025 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc430c3-fc59-4ae5-8fc2-17683723daf7 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:52.033299 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc430c3-fc59-4ae5-8fc2-17683723daf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:52.053998 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-bbc430c3-fc59-4ae5-8fc2-17683723daf7 None None] MFA Rules not processed for user `047b50cfb513438dbda9cdd89b578062`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:52.055206 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-bbc430c3-fc59-4ae5-8fc2-17683723daf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:52.084449 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:52.109643 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 944/1891] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:44:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:55.835849 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda45c5-be19-495e-be25-a0c1897edff6 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:55.836373 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda45c5-be19-495e-be25-a0c1897edff6 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:55.840720 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda45c5-be19-495e-be25-a0c1897edff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:55.844778 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=96 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:55.857656 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-2fda45c5-be19-495e-be25-a0c1897edff6 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:55.859112 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2fda45c5-be19-495e-be25-a0c1897edff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:55.869567 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 948/1892] 10.222.0.45 () {58 vars in 1016 bytes} [Wed Nov 2 07:44:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:55.894895 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc430c3-fc59-4ae5-8fc2-17683723daf7 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:55.909003 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc430c3-fc59-4ae5-8fc2-17683723daf7 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:55.921343 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73a189-7577-410e-b129-1420be234d16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:55.921991 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73a189-7577-410e-b129-1420be234d16 service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:55.922275 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73a189-7577-410e-b129-1420be234d16 service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:55.922549 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73a189-7577-410e-b129-1420be234d16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:55.932530 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73a189-7577-410e-b129-1420be234d16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:55.934131 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73a189-7577-410e-b129-1420be234d16 service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:55.945163 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 945/1893] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:44:57.139506 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda45c5-be19-495e-be25-a0c1897edff6 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:57.151771 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda45c5-be19-495e-be25-a0c1897edff6 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:57.161469 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ccdde-7e90-4d98-9418-8122ad1abe11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:57.162234 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ccdde-7e90-4d98-9418-8122ad1abe11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:57.162592 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ccdde-7e90-4d98-9418-8122ad1abe11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:57.162941 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ccdde-7e90-4d98-9418-8122ad1abe11 admin admin] PATH_INFO: `/v3/users/46d661ed403d4ce8bbe2b3df4bebe18f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:57.168562 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ccdde-7e90-4d98-9418-8122ad1abe11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46d661ed403d4ce8bbe2b3df4bebe18f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:57.168562 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ccdde-7e90-4d98-9418-8122ad1abe11 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:57.398015 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0d4ccdde-7e90-4d98-9418-8122ad1abe11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46d661ed403d4ce8bbe2b3df4bebe18f'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:57.414279 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0d4ccdde-7e90-4d98-9418-8122ad1abe11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46d661ed403d4ce8bbe2b3df4bebe18f'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:57.415078 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0d4ccdde-7e90-4d98-9418-8122ad1abe11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46d661ed403d4ce8bbe2b3df4bebe18f'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:57.422153 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0d4ccdde-7e90-4d98-9418-8122ad1abe11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46d661ed403d4ce8bbe2b3df4bebe18f'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:57.422999 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0d4ccdde-7e90-4d98-9418-8122ad1abe11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46d661ed403d4ce8bbe2b3df4bebe18f'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:57.524315 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 949/1894] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:44:57 2022] DELETE /identity/v3/users/46d661ed403d4ce8bbe2b3df4bebe18f => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:57.528847 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e01fa-95db-4041-a1e5-6831605bfb78 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:57.529284 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e01fa-95db-4041-a1e5-6831605bfb78 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:57.529388 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e01fa-95db-4041-a1e5-6831605bfb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:57.548745 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-f37e01fa-95db-4041-a1e5-6831605bfb78 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:57.549930 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f37e01fa-95db-4041-a1e5-6831605bfb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:57.612851 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 946/1895] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:44:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:44:57.626112 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ccdde-7e90-4d98-9418-8122ad1abe11 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:57.629876 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0d4ccdde-7e90-4d98-9418-8122ad1abe11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:57.700160 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ccdde-7e90-4d98-9418-8122ad1abe11 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:57.706494 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d424382-d5b1-46f5-842b-8121f866b4fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:57.707280 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d424382-d5b1-46f5-842b-8121f866b4fb service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:57.707630 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d424382-d5b1-46f5-842b-8121f866b4fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:57.707931 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d424382-d5b1-46f5-842b-8121f866b4fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:57.718349 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d424382-d5b1-46f5-842b-8121f866b4fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:57.719869 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d424382-d5b1-46f5-842b-8121f866b4fb service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:57.730596 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 950/1896] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:44:58.301691 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e01fa-95db-4041-a1e5-6831605bfb78 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:58.303552 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f37e01fa-95db-4041-a1e5-6831605bfb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:58.331515 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e01fa-95db-4041-a1e5-6831605bfb78 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:58.336932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2288381-698d-4a20-b6cf-56d5083fbd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:58.337573 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2288381-698d-4a20-b6cf-56d5083fbd60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:58.337847 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2288381-698d-4a20-b6cf-56d5083fbd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:58.338115 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2288381-698d-4a20-b6cf-56d5083fbd60 admin admin] PATH_INFO: `/v3/projects/89ec1ae42e6149fda7f8c40d5bd39d94` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:58.339249 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2288381-698d-4a20-b6cf-56d5083fbd60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89ec1ae42e6149fda7f8c40d5bd39d94)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:58.341221 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2288381-698d-4a20-b6cf-56d5083fbd60 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:58.447008 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f2288381-698d-4a20-b6cf-56d5083fbd60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89ec1ae42e6149fda7f8c40d5bd39d94', 'request_id': 'req-f2288381-698d-4a20-b6cf-56d5083fbd60'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:58.453431 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f2288381-698d-4a20-b6cf-56d5083fbd60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89ec1ae42e6149fda7f8c40d5bd39d94', 'request_id': 'req-f2288381-698d-4a20-b6cf-56d5083fbd60'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:58.460554 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f2288381-698d-4a20-b6cf-56d5083fbd60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89ec1ae42e6149fda7f8c40d5bd39d94', 'request_id': 'req-f2288381-698d-4a20-b6cf-56d5083fbd60'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:58.548546 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f2288381-698d-4a20-b6cf-56d5083fbd60 admin admin] The token cache is being invalidate because project 89ec1ae42e6149fda7f8c40d5bd39d94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:44:58.549184 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f2288381-698d-4a20-b6cf-56d5083fbd60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:58.549738 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f2288381-698d-4a20-b6cf-56d5083fbd60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:58.551518 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 947/1897] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:44:58 2022] DELETE /identity/v3/projects/89ec1ae42e6149fda7f8c40d5bd39d94 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:44:58.556400 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200bd77-0d20-4d7b-8825-e93d38a48481 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:58.558525 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200bd77-0d20-4d7b-8825-e93d38a48481 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:58.558800 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200bd77-0d20-4d7b-8825-e93d38a48481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:58.581035 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-b200bd77-0d20-4d7b-8825-e93d38a48481 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:58.583086 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b200bd77-0d20-4d7b-8825-e93d38a48481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:58.660336 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 951/1898] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:44:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:58.661912 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d393e34-c407-4e83-81cf-412fde384e99 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:58.662208 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d393e34-c407-4e83-81cf-412fde384e99 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:58.662463 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d393e34-c407-4e83-81cf-412fde384e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:58.685531 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-0d393e34-c407-4e83-81cf-412fde384e99 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:58.686722 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-0d393e34-c407-4e83-81cf-412fde384e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:58.699343 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 948/1899] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:44:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:44:58.703491 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200bd77-0d20-4d7b-8825-e93d38a48481 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:58.718156 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200bd77-0d20-4d7b-8825-e93d38a48481 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:58.724040 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0f158-0097-4254-a6df-248357b9dc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:58.724807 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0f158-0097-4254-a6df-248357b9dc41 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:58.725228 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0f158-0097-4254-a6df-248357b9dc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:58.725504 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0f158-0097-4254-a6df-248357b9dc41 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:58.726153 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0f158-0097-4254-a6df-248357b9dc41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:44:58.726456 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0f158-0097-4254-a6df-248357b9dc41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:58.728194 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0f158-0097-4254-a6df-248357b9dc41 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:58.736034 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:58.743254 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 952/1900] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:44:58.747107 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d393e34-c407-4e83-81cf-412fde384e99 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:58.759280 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d393e34-c407-4e83-81cf-412fde384e99 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:58.764882 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e27a0-53a0-4eb3-b420-4d65961700e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:58.765589 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e27a0-53a0-4eb3-b420-4d65961700e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:58.765940 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e27a0-53a0-4eb3-b420-4d65961700e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:58.766350 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e27a0-53a0-4eb3-b420-4d65961700e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:58.767282 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e27a0-53a0-4eb3-b420-4d65961700e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:58.773397 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e27a0-53a0-4eb3-b420-4d65961700e3 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:58.880604 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 949/1901] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:44:58 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:44:58.884272 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0f158-0097-4254-a6df-248357b9dc41 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:58.894729 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0f158-0097-4254-a6df-248357b9dc41 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:58.957107 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eeaf90-f421-495c-b51e-5d106182ce61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:58.957782 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eeaf90-f421-495c-b51e-5d106182ce61 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:58.958099 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eeaf90-f421-495c-b51e-5d106182ce61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:58.958399 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eeaf90-f421-495c-b51e-5d106182ce61 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:58.959185 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eeaf90-f421-495c-b51e-5d106182ce61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:58.961007 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eeaf90-f421-495c-b51e-5d106182ce61 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:59.060426 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 953/1902] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:44:58 2022] POST /identity/v3/users => generated 286 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:44:59.064389 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e27a0-53a0-4eb3-b420-4d65961700e3 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:59.075527 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e27a0-53a0-4eb3-b420-4d65961700e3 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:59.081086 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16adc7-19da-41cf-b774-c49cf1daa561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:59.081721 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16adc7-19da-41cf-b774-c49cf1daa561 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:59.082268 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16adc7-19da-41cf-b774-c49cf1daa561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:59.082694 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16adc7-19da-41cf-b774-c49cf1daa561 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:59.083332 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab16adc7-19da-41cf-b774-c49cf1daa561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:59.084957 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab16adc7-19da-41cf-b774-c49cf1daa561 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:59.096792 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 950/1903] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:44:59.101138 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eeaf90-f421-495c-b51e-5d106182ce61 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:59.111372 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eeaf90-f421-495c-b51e-5d106182ce61 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:59.117245 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca8b65-92c1-41e6-ae5a-a799421dc3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:59.117866 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca8b65-92c1-41e6-ae5a-a799421dc3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:59.118261 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca8b65-92c1-41e6-ae5a-a799421dc3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:59.118540 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca8b65-92c1-41e6-ae5a-a799421dc3b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:59.119179 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ca8b65-92c1-41e6-ae5a-a799421dc3b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:59.120795 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ca8b65-92c1-41e6-ae5a-a799421dc3b7 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:59.132472 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 954/1904] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:44:59.136630 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16adc7-19da-41cf-b774-c49cf1daa561 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:59.146494 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16adc7-19da-41cf-b774-c49cf1daa561 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:59.151080 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c29a46-a422-489f-bba8-cdfe7be6955d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:59.151728 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c29a46-a422-489f-bba8-cdfe7be6955d admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:59.152003 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c29a46-a422-489f-bba8-cdfe7be6955d admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:59.152316 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c29a46-a422-489f-bba8-cdfe7be6955d admin admin] PATH_INFO: `/v3/projects/d7ca319da2d34a36ab4ca3b04d381189/users/8054e1352b414daaafe1ff3604f70936/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:59.161270 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:59.167479 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c29a46-a422-489f-bba8-cdfe7be6955d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7ca319da2d34a36ab4ca3b04d381189, user_id=8054e1352b414daaafe1ff3604f70936, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:59.170137 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c29a46-a422-489f-bba8-cdfe7be6955d admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:59.289290 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 951/1905] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:44:59 2022] PUT /identity/v3/projects/d7ca319da2d34a36ab4ca3b04d381189/users/8054e1352b414daaafe1ff3604f70936/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:59.300459 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc776e-adca-43ff-a7f0-4bb05976c134 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:59.301431 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc776e-adca-43ff-a7f0-4bb05976c134 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:59.301959 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc776e-adca-43ff-a7f0-4bb05976c134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:59.329638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-b3dc776e-adca-43ff-a7f0-4bb05976c134 None None] MFA Rules not processed for user `8054e1352b414daaafe1ff3604f70936`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:59.330830 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b3dc776e-adca-43ff-a7f0-4bb05976c134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:59.393881 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 955/1906] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:44:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:59.404956 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c29a46-a422-489f-bba8-cdfe7be6955d admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:59.406603 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-46c29a46-a422-489f-bba8-cdfe7be6955d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:59.463566 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c29a46-a422-489f-bba8-cdfe7be6955d admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:59.467627 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64eda6e-75bc-4cd9-b5e2-1f625272b0bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:59.468292 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64eda6e-75bc-4cd9-b5e2-1f625272b0bc service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:59.468576 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64eda6e-75bc-4cd9-b5e2-1f625272b0bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:59.468851 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64eda6e-75bc-4cd9-b5e2-1f625272b0bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:59.478138 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64eda6e-75bc-4cd9-b5e2-1f625272b0bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:59.479565 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64eda6e-75bc-4cd9-b5e2-1f625272b0bc service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:59.488929 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 952/1907] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:59.514457 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc776e-adca-43ff-a7f0-4bb05976c134 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:59.578902 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc776e-adca-43ff-a7f0-4bb05976c134 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:59.584286 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0189e73-df15-40d5-98ba-49d17c8c41c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:59.584915 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0189e73-df15-40d5-98ba-49d17c8c41c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:59.585193 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0189e73-df15-40d5-98ba-49d17c8c41c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:59.585464 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0189e73-df15-40d5-98ba-49d17c8c41c7 admin admin] PATH_INFO: `/v3/users/8054e1352b414daaafe1ff3604f70936` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:59.586586 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0189e73-df15-40d5-98ba-49d17c8c41c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8054e1352b414daaafe1ff3604f70936)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:59.588531 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0189e73-df15-40d5-98ba-49d17c8c41c7 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:59.593900 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:59.746541 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e0189e73-df15-40d5-98ba-49d17c8c41c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8054e1352b414daaafe1ff3604f70936'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:59.760664 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e0189e73-df15-40d5-98ba-49d17c8c41c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8054e1352b414daaafe1ff3604f70936'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:59.761414 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e0189e73-df15-40d5-98ba-49d17c8c41c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8054e1352b414daaafe1ff3604f70936'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:59.768874 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e0189e73-df15-40d5-98ba-49d17c8c41c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8054e1352b414daaafe1ff3604f70936'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:59.770155 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e0189e73-df15-40d5-98ba-49d17c8c41c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8054e1352b414daaafe1ff3604f70936'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:59.880482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 956/1908] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:44:59 2022] DELETE /identity/v3/users/8054e1352b414daaafe1ff3604f70936 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:59.885094 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1c9d8-ebef-4abd-a9f7-2992f624d0d6 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:59.885580 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1c9d8-ebef-4abd-a9f7-2992f624d0d6 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:59.885674 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1c9d8-ebef-4abd-a9f7-2992f624d0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:59.905853 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-75d1c9d8-ebef-4abd-a9f7-2992f624d0d6 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:59.907052 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-75d1c9d8-ebef-4abd-a9f7-2992f624d0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:59.979573 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 953/1909] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:44:59.989655 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0189e73-df15-40d5-98ba-49d17c8c41c7 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:59.991053 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e0189e73-df15-40d5-98ba-49d17c8c41c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:00.069838 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0189e73-df15-40d5-98ba-49d17c8c41c7 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:00.073601 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7fa4f9-5195-44b6-a06f-170f17fbe08f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:00.074345 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fa4f9-5195-44b6-a06f-170f17fbe08f service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:00.074697 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fa4f9-5195-44b6-a06f-170f17fbe08f service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:00.075029 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fa4f9-5195-44b6-a06f-170f17fbe08f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:00.084717 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7fa4f9-5195-44b6-a06f-170f17fbe08f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:00.086155 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7fa4f9-5195-44b6-a06f-170f17fbe08f service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:00.091048 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2bf61-cedf-4cb6-9dd5-d9bb2cc291f0 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:00.091552 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2bf61-cedf-4cb6-9dd5-d9bb2cc291f0 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:00.091978 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2bf61-cedf-4cb6-9dd5-d9bb2cc291f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:00.096286 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 957/1910] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:45:00.121429 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-2df2bf61-cedf-4cb6-9dd5-d9bb2cc291f0 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:00.122658 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-2df2bf61-cedf-4cb6-9dd5-d9bb2cc291f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:00.131388 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 954/1911] 10.222.0.45 () {58 vars in 1016 bytes} [Wed Nov 2 07:45:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:45:00.154380 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7fa4f9-5195-44b6-a06f-170f17fbe08f service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:00.156078 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-1a7fa4f9-5195-44b6-a06f-170f17fbe08f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:00.241780 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7fa4f9-5195-44b6-a06f-170f17fbe08f service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:00.247669 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8f618-0e29-4b3b-a4a5-886304963fed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:00.248311 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8f618-0e29-4b3b-a4a5-886304963fed service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:00.248595 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8f618-0e29-4b3b-a4a5-886304963fed service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:00.248866 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8f618-0e29-4b3b-a4a5-886304963fed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:00.257102 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec8f618-0e29-4b3b-a4a5-886304963fed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:00.258763 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec8f618-0e29-4b3b-a4a5-886304963fed service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:00.268188 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 958/1912] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:45:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:45:00.558618 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2bf61-cedf-4cb6-9dd5-d9bb2cc291f0 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:00.560084 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-2df2bf61-cedf-4cb6-9dd5-d9bb2cc291f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:00.572478 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2bf61-cedf-4cb6-9dd5-d9bb2cc291f0 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:00.577415 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b891f-4862-4d59-b564-82dd2132cd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:00.588203 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b891f-4862-4d59-b564-82dd2132cd51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:00.588203 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b891f-4862-4d59-b564-82dd2132cd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:00.588203 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b891f-4862-4d59-b564-82dd2132cd51 admin admin] PATH_INFO: `/v3/projects/d7ca319da2d34a36ab4ca3b04d381189` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:00.588203 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b891f-4862-4d59-b564-82dd2132cd51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7ca319da2d34a36ab4ca3b04d381189)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:00.588203 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b891f-4862-4d59-b564-82dd2132cd51 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:00.720333 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b22b891f-4862-4d59-b564-82dd2132cd51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7ca319da2d34a36ab4ca3b04d381189', 'request_id': 'req-b22b891f-4862-4d59-b564-82dd2132cd51'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:00.726781 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b22b891f-4862-4d59-b564-82dd2132cd51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7ca319da2d34a36ab4ca3b04d381189', 'request_id': 'req-b22b891f-4862-4d59-b564-82dd2132cd51'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:00.732177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b22b891f-4862-4d59-b564-82dd2132cd51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7ca319da2d34a36ab4ca3b04d381189', 'request_id': 'req-b22b891f-4862-4d59-b564-82dd2132cd51'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:00.842359 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b22b891f-4862-4d59-b564-82dd2132cd51 admin admin] The token cache is being invalidate because project d7ca319da2d34a36ab4ca3b04d381189 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:45:00.842644 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b22b891f-4862-4d59-b564-82dd2132cd51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:00.843292 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b22b891f-4862-4d59-b564-82dd2132cd51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:00.844823 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 955/1913] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:45:00 2022] DELETE /identity/v3/projects/d7ca319da2d34a36ab4ca3b04d381189 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:45:10.264080 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=83,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:10.838441 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:18.004065 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01cf69a-650c-4219-aa05-27be59644e7c None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:18.005096 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01cf69a-650c-4219-aa05-27be59644e7c None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:18.005246 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01cf69a-650c-4219-aa05-27be59644e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:18.024569 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-a01cf69a-650c-4219-aa05-27be59644e7c None None] MFA Rules not processed for user `193e45cadb3c4586ab94051c42cf5192`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:18.025764 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a01cf69a-650c-4219-aa05-27be59644e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:18.079913 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 959/1914] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:45:18 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:45:23.200647 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897ccc8-6da4-4069-a9ce-3553389c5f59 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:23.201158 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897ccc8-6da4-4069-a9ce-3553389c5f59 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:23.201158 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897ccc8-6da4-4069-a9ce-3553389c5f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:23.230558 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-c897ccc8-6da4-4069-a9ce-3553389c5f59 None None] MFA Rules not processed for user `9f29c3bb32b2477aa93e38ec57061646`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:23.232004 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c897ccc8-6da4-4069-a9ce-3553389c5f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:23.334030 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 956/1915] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:45:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:45:28.073313 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=25 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:33.325588 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=25 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:36.558374 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1df01-b761-43c0-9730-cfe3f7fba2a9 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:36.558886 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1df01-b761-43c0-9730-cfe3f7fba2a9 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:36.559048 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1df01-b761-43c0-9730-cfe3f7fba2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:36.581958 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-2cf1df01-b761-43c0-9730-cfe3f7fba2a9 None None] MFA Rules not processed for user `6fc9296c011d4712949ec015ea157762`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:36.583389 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2cf1df01-b761-43c0-9730-cfe3f7fba2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:36.653480 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 960/1916] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:45:36 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:45:46.043097 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27da8f-84ef-453b-9eb6-0816892aae97 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:46.043689 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27da8f-84ef-453b-9eb6-0816892aae97 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:46.043689 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27da8f-84ef-453b-9eb6-0816892aae97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:46.070788 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-8b27da8f-84ef-453b-9eb6-0816892aae97 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:46.072221 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-8b27da8f-84ef-453b-9eb6-0816892aae97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:46.144514 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 957/1917] 10.222.0.45 () {58 vars in 1016 bytes} [Wed Nov 2 07:45:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:45:46.169278 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1df01-b761-43c0-9730-cfe3f7fba2a9 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:46.170682 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2cf1df01-b761-43c0-9730-cfe3f7fba2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:46.249738 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1df01-b761-43c0-9730-cfe3f7fba2a9 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:46.250888 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa794310-2d18-4e0d-80e3-93a52d24d563 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:46.251501 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa794310-2d18-4e0d-80e3-93a52d24d563 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:46.251781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa794310-2d18-4e0d-80e3-93a52d24d563 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:46.252068 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa794310-2d18-4e0d-80e3-93a52d24d563 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:46.261387 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa794310-2d18-4e0d-80e3-93a52d24d563 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:46.262971 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa794310-2d18-4e0d-80e3-93a52d24d563 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:46.272657 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 961/1918] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:45:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:45:50.480486 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4ae8d-bbad-4a6e-abbc-69bc82006019 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:50.480939 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4ae8d-bbad-4a6e-abbc-69bc82006019 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:50.481019 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4ae8d-bbad-4a6e-abbc-69bc82006019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:50.507383 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-ddc4ae8d-bbad-4a6e-abbc-69bc82006019 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:50.508736 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-ddc4ae8d-bbad-4a6e-abbc-69bc82006019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:50.517171 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 958/1919] 10.222.0.45 () {58 vars in 1016 bytes} [Wed Nov 2 07:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:45:50.542396 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa794310-2d18-4e0d-80e3-93a52d24d563 service nova] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:50.554507 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa794310-2d18-4e0d-80e3-93a52d24d563 service nova] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:50.560275 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3afdd4-d376-4eb4-8a35-598dc4066116 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:50.560870 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3afdd4-d376-4eb4-8a35-598dc4066116 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:50.562841 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3afdd4-d376-4eb4-8a35-598dc4066116 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:50.562841 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3afdd4-d376-4eb4-8a35-598dc4066116 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:50.569939 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3afdd4-d376-4eb4-8a35-598dc4066116 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:50.571517 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3afdd4-d376-4eb4-8a35-598dc4066116 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:50.580960 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 962/1920] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:45:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:45:54.351773 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b59e1e-09e3-417f-b85d-767a8515bf69 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:54.352241 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b59e1e-09e3-417f-b85d-767a8515bf69 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:54.352373 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b59e1e-09e3-417f-b85d-767a8515bf69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:54.372669 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-31b59e1e-09e3-417f-b85d-767a8515bf69 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:54.373869 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-31b59e1e-09e3-417f-b85d-767a8515bf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:54.382939 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 959/1921] 10.222.0.45 () {58 vars in 1016 bytes} [Wed Nov 2 07:45:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:45:54.476597 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3afdd4-d376-4eb4-8a35-598dc4066116 service nova] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:54.478011 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-1b3afdd4-d376-4eb4-8a35-598dc4066116 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:54.492893 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3afdd4-d376-4eb4-8a35-598dc4066116 service nova] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:54.498346 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743d2a5-dffc-4c47-ab95-a38052a0e0df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:54.498939 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743d2a5-dffc-4c47-ab95-a38052a0e0df service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:54.499262 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743d2a5-dffc-4c47-ab95-a38052a0e0df service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:54.499486 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743d2a5-dffc-4c47-ab95-a38052a0e0df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:54.508254 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743d2a5-dffc-4c47-ab95-a38052a0e0df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:54.509813 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743d2a5-dffc-4c47-ab95-a38052a0e0df service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:54.519065 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 963/1922] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:45:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:46:00.672649 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537412df-4dc3-4535-91ff-24b05bc2d131 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:00.673145 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537412df-4dc3-4535-91ff-24b05bc2d131 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:00.673242 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537412df-4dc3-4535-91ff-24b05bc2d131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:00.693056 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-537412df-4dc3-4535-91ff-24b05bc2d131 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:46:00.694242 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-537412df-4dc3-4535-91ff-24b05bc2d131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:00.701948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 960/1923] 10.222.0.45 () {58 vars in 1016 bytes} [Wed Nov 2 07:46:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:46:00.730106 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743d2a5-dffc-4c47-ab95-a38052a0e0df service nova] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:00.735737 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=72 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:46:00.742136 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743d2a5-dffc-4c47-ab95-a38052a0e0df service nova] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:00.747741 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf643fd-2f13-4f6c-8b61-5a4ec32ddc38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:00.748366 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf643fd-2f13-4f6c-8b61-5a4ec32ddc38 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:00.748642 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf643fd-2f13-4f6c-8b61-5a4ec32ddc38 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:00.748909 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf643fd-2f13-4f6c-8b61-5a4ec32ddc38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:00.757784 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf643fd-2f13-4f6c-8b61-5a4ec32ddc38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:00.759359 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf643fd-2f13-4f6c-8b61-5a4ec32ddc38 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:00.769646 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 964/1924] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:46:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:46:04.928175 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54dbed-3887-4dc2-9453-393890908be0 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:04.928665 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54dbed-3887-4dc2-9453-393890908be0 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:04.928745 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54dbed-3887-4dc2-9453-393890908be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:04.954844 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-bb54dbed-3887-4dc2-9453-393890908be0 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:46:04.956676 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-bb54dbed-3887-4dc2-9453-393890908be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:04.969150 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 961/1925] 10.222.0.45 () {58 vars in 1016 bytes} [Wed Nov 2 07:46:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:46:04.988298 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf643fd-2f13-4f6c-8b61-5a4ec32ddc38 service nova] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:05.005692 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf643fd-2f13-4f6c-8b61-5a4ec32ddc38 service nova] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:05.012320 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e24f9d-c843-4bea-aa83-641fb0728d03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:05.012931 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e24f9d-c843-4bea-aa83-641fb0728d03 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:05.013212 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e24f9d-c843-4bea-aa83-641fb0728d03 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:05.013602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e24f9d-c843-4bea-aa83-641fb0728d03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:05.023341 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e24f9d-c843-4bea-aa83-641fb0728d03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:05.024971 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e24f9d-c843-4bea-aa83-641fb0728d03 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:05.035597 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 965/1926] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:46:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:46:06.542696 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb54dbed-3887-4dc2-9453-393890908be0 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:06.544154 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-bb54dbed-3887-4dc2-9453-393890908be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:06.599436 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb54dbed-3887-4dc2-9453-393890908be0 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:06.602928 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ae633-60f1-454d-a2bd-dcce44d0f5b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:06.603523 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ae633-60f1-454d-a2bd-dcce44d0f5b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:06.603798 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ae633-60f1-454d-a2bd-dcce44d0f5b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:06.604087 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ae633-60f1-454d-a2bd-dcce44d0f5b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:06.605831 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e55ae633-60f1-454d-a2bd-dcce44d0f5b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:06.618877 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ae633-60f1-454d-a2bd-dcce44d0f5b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:06.620352 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ae633-60f1-454d-a2bd-dcce44d0f5b8 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:06.631517 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 962/1927] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:46:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:46:11.007488 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e24f9d-c843-4bea-aa83-641fb0728d03 service nova] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:11.009159 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-92e24f9d-c843-4bea-aa83-641fb0728d03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:11.021861 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e24f9d-c843-4bea-aa83-641fb0728d03 service nova] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:11.025471 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec10b8-16cc-423d-89a6-d4dfdd314e14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:11.026072 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec10b8-16cc-423d-89a6-d4dfdd314e14 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:11.026354 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec10b8-16cc-423d-89a6-d4dfdd314e14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:11.026620 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec10b8-16cc-423d-89a6-d4dfdd314e14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:11.028430 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-83ec10b8-16cc-423d-89a6-d4dfdd314e14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:11.042272 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec10b8-16cc-423d-89a6-d4dfdd314e14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:11.043703 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec10b8-16cc-423d-89a6-d4dfdd314e14 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:11.055616 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 966/1928] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:46:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:46:16.626665 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=65 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:46:20.224106 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc1f80-a3af-4336-aff7-2245c199c15b None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:20.226613 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc1f80-a3af-4336-aff7-2245c199c15b None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:20.226613 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc1f80-a3af-4336-aff7-2245c199c15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:20.243723 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-14dc1f80-a3af-4336-aff7-2245c199c15b None None] MFA Rules not processed for user `047b50cfb513438dbda9cdd89b578062`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:46:20.244973 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-14dc1f80-a3af-4336-aff7-2245c199c15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:20.299478 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 963/1929] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:46:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:46:20.545769 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec10b8-16cc-423d-89a6-d4dfdd314e14 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:20.554757 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec10b8-16cc-423d-89a6-d4dfdd314e14 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:20.558341 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887e5d4-4f60-4281-bc25-5b64afb31ebc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:20.558939 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887e5d4-4f60-4281-bc25-5b64afb31ebc service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:20.559217 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887e5d4-4f60-4281-bc25-5b64afb31ebc service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:20.559488 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887e5d4-4f60-4281-bc25-5b64afb31ebc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:20.561329 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8887e5d4-4f60-4281-bc25-5b64afb31ebc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:20.572702 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8887e5d4-4f60-4281-bc25-5b64afb31ebc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:20.574158 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8887e5d4-4f60-4281-bc25-5b64afb31ebc service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:20.583472 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 967/1930] 10.222.0.16 () {60 vars in 1396 bytes} [Wed Nov 2 07:46:20 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3262 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:46:20.649195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc1f80-a3af-4336-aff7-2245c199c15b None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:20.658965 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc1f80-a3af-4336-aff7-2245c199c15b None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:20.662502 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a7a39-f739-493e-89f5-4ef201ba689b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:20.663093 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a7a39-f739-493e-89f5-4ef201ba689b service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:20.663371 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a7a39-f739-493e-89f5-4ef201ba689b service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:20.663643 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a7a39-f739-493e-89f5-4ef201ba689b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:20.665377 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-4a9a7a39-f739-493e-89f5-4ef201ba689b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:20.674449 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a7a39-f739-493e-89f5-4ef201ba689b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:20.676410 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a7a39-f739-493e-89f5-4ef201ba689b service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:20.684122 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 964/1931] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:46:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:46:21.093257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887e5d4-4f60-4281-bc25-5b64afb31ebc service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:21.094706 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8887e5d4-4f60-4281-bc25-5b64afb31ebc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:21.166932 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887e5d4-4f60-4281-bc25-5b64afb31ebc service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:21.171701 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ff5ac-dba9-4df3-9bf7-d2946b35af41 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '741c9fc71c80438faa037c85f4997c3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:21.172330 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ff5ac-dba9-4df3-9bf7-d2946b35af41 service placement] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:21.172606 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ff5ac-dba9-4df3-9bf7-d2946b35af41 service placement] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:21.172874 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ff5ac-dba9-4df3-9bf7-d2946b35af41 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:21.174683 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7c5ff5ac-dba9-4df3-9bf7-d2946b35af41 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:21.186536 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ff5ac-dba9-4df3-9bf7-d2946b35af41 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:21.188133 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ff5ac-dba9-4df3-9bf7-d2946b35af41 service placement] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:21.197826 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 968/1932] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:46:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:46:26.054575 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a7a39-f739-493e-89f5-4ef201ba689b service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:26.056065 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-4a9a7a39-f739-493e-89f5-4ef201ba689b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:26.120979 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a7a39-f739-493e-89f5-4ef201ba689b service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:26.124720 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db0dfd-d30f-44c9-b655-bee7070f43ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:26.125340 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db0dfd-d30f-44c9-b655-bee7070f43ef service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:26.125949 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db0dfd-d30f-44c9-b655-bee7070f43ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:26.125949 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db0dfd-d30f-44c9-b655-bee7070f43ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:26.130414 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-50db0dfd-d30f-44c9-b655-bee7070f43ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:26.144491 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db0dfd-d30f-44c9-b655-bee7070f43ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:26.146234 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db0dfd-d30f-44c9-b655-bee7070f43ef service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:26.156610 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 965/1933] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:46:26 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:46:30.719227 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ff5ac-dba9-4df3-9bf7-d2946b35af41 service placement] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:30.744606 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ff5ac-dba9-4df3-9bf7-d2946b35af41 service placement] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:30.748245 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08387f55-5eaa-4093-ad5e-c571fbfc0797 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:30.749093 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08387f55-5eaa-4093-ad5e-c571fbfc0797 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:30.749564 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08387f55-5eaa-4093-ad5e-c571fbfc0797 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:30.750080 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08387f55-5eaa-4093-ad5e-c571fbfc0797 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:30.752190 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-08387f55-5eaa-4093-ad5e-c571fbfc0797 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:30.763255 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08387f55-5eaa-4093-ad5e-c571fbfc0797 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:30.765184 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08387f55-5eaa-4093-ad5e-c571fbfc0797 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:30.769080 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=60 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:46:30.777255 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 969/1934] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:46:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:46:36.151744 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=57 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:46:39.062943 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b83d34-96d7-4cca-b58d-3079862251ea None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:39.062943 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b83d34-96d7-4cca-b58d-3079862251ea None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:39.062943 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b83d34-96d7-4cca-b58d-3079862251ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:39.080675 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-b5b83d34-96d7-4cca-b58d-3079862251ea None None] MFA Rules not processed for user `a483f57a4bab4d499d8fa8585d8622d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:46:39.081858 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-b5b83d34-96d7-4cca-b58d-3079862251ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:39.136264 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 966/1935] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:46:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:46:39.439621 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08387f55-5eaa-4093-ad5e-c571fbfc0797 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:39.449296 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08387f55-5eaa-4093-ad5e-c571fbfc0797 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:39.453206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1cf4b-9aaf-42ef-a2f9-6a6eecdcc1ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:39.453819 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1cf4b-9aaf-42ef-a2f9-6a6eecdcc1ae service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:39.454095 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1cf4b-9aaf-42ef-a2f9-6a6eecdcc1ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:39.454368 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1cf4b-9aaf-42ef-a2f9-6a6eecdcc1ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:39.456233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-50d1cf4b-9aaf-42ef-a2f9-6a6eecdcc1ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:39.466860 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d1cf4b-9aaf-42ef-a2f9-6a6eecdcc1ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:39.470137 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d1cf4b-9aaf-42ef-a2f9-6a6eecdcc1ae service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:39.476911 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 970/1936] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:46:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:46:41.115614 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b83d34-96d7-4cca-b58d-3079862251ea None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:41.128297 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b83d34-96d7-4cca-b58d-3079862251ea None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:41.134144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb9eaf-b7c7-4eed-aded-c73b3b28634b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:41.139304 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb9eaf-b7c7-4eed-aded-c73b3b28634b service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:41.139304 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb9eaf-b7c7-4eed-aded-c73b3b28634b service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:41.139304 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb9eaf-b7c7-4eed-aded-c73b3b28634b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:41.139304 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-dccb9eaf-b7c7-4eed-aded-c73b3b28634b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:41.149243 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb9eaf-b7c7-4eed-aded-c73b3b28634b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:41.150814 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb9eaf-b7c7-4eed-aded-c73b3b28634b service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:41.162992 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 967/1937] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:46:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:46:43.060861 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1cf4b-9aaf-42ef-a2f9-6a6eecdcc1ae service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:43.075293 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1cf4b-9aaf-42ef-a2f9-6a6eecdcc1ae service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:43.082631 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e43f40-8cde-4339-b008-f4c45b0af5c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:43.083786 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e43f40-8cde-4339-b008-f4c45b0af5c8 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:43.084073 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e43f40-8cde-4339-b008-f4c45b0af5c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:43.084387 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e43f40-8cde-4339-b008-f4c45b0af5c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:43.086459 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f4e43f40-8cde-4339-b008-f4c45b0af5c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:43.100186 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e43f40-8cde-4339-b008-f4c45b0af5c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:43.101886 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e43f40-8cde-4339-b008-f4c45b0af5c8 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:43.112987 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 971/1938] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:46:43 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:46:43.652225 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9511b1-282c-4125-a3e3-5753226d41f2 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:43.652723 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9511b1-282c-4125-a3e3-5753226d41f2 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:43.652823 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9511b1-282c-4125-a3e3-5753226d41f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:43.672717 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-0d9511b1-282c-4125-a3e3-5753226d41f2 None None] MFA Rules not processed for user `0c65f5001a224e0b92e94dc6df9f8f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:46:43.674092 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-0d9511b1-282c-4125-a3e3-5753226d41f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:43.753867 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 968/1939] 10.222.0.16 () {58 vars in 967 bytes} [Wed Nov 2 07:46:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:46:43.885108 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e43f40-8cde-4339-b008-f4c45b0af5c8 service nova] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:43.887169 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f4e43f40-8cde-4339-b008-f4c45b0af5c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:43.991080 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e43f40-8cde-4339-b008-f4c45b0af5c8 service nova] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:43.997230 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1856e-a6f3-4ff6-8d50-dcc50b96c845 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d63a04c2d74c90b95a4f48c49ddb29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:43.997854 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1856e-a6f3-4ff6-8d50-dcc50b96c845 service swift] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:43.998135 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1856e-a6f3-4ff6-8d50-dcc50b96c845 service swift] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:43.998495 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1856e-a6f3-4ff6-8d50-dcc50b96c845 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:44.008266 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c1856e-a6f3-4ff6-8d50-dcc50b96c845 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:44.009878 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c1856e-a6f3-4ff6-8d50-dcc50b96c845 service swift] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:44.019082 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 972/1940] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Nov 2 07:46:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:46:45.268127 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9511b1-282c-4125-a3e3-5753226d41f2 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:45.273867 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1856e-a6f3-4ff6-8d50-dcc50b96c845 service swift] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:45.300396 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9511b1-282c-4125-a3e3-5753226d41f2 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:45.300744 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1856e-a6f3-4ff6-8d50-dcc50b96c845 service swift] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:45.305567 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52579e2f-cc36-4619-9f28-3bb59219715e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:45.306417 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52579e2f-cc36-4619-9f28-3bb59219715e service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:45.306712 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52579e2f-cc36-4619-9f28-3bb59219715e service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:45.306883 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc82ba2-5221-473a-bd25-02c5f97e7a1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:45.307047 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52579e2f-cc36-4619-9f28-3bb59219715e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:45.307696 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc82ba2-5221-473a-bd25-02c5f97e7a1f service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:45.308144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc82ba2-5221-473a-bd25-02c5f97e7a1f service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:45.308506 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc82ba2-5221-473a-bd25-02c5f97e7a1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:45.309683 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-52579e2f-cc36-4619-9f28-3bb59219715e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:45.310592 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-ffc82ba2-5221-473a-bd25-02c5f97e7a1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:45.326251 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc82ba2-5221-473a-bd25-02c5f97e7a1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:45.327686 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52579e2f-cc36-4619-9f28-3bb59219715e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:45.328139 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc82ba2-5221-473a-bd25-02c5f97e7a1f service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:45.329436 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52579e2f-cc36-4619-9f28-3bb59219715e service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:45.341885 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 969/1941] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:46:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:46:45.342538 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 973/1942] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:46:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:46:47.790657 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc82ba2-5221-473a-bd25-02c5f97e7a1f service nova] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:47.793596 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-ffc82ba2-5221-473a-bd25-02c5f97e7a1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:47.812467 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc82ba2-5221-473a-bd25-02c5f97e7a1f service nova] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:47.821500 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a37e7-489f-49d6-9f70-e3a6daf4bb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:47.822281 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a37e7-489f-49d6-9f70-e3a6daf4bb00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:47.822572 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a37e7-489f-49d6-9f70-e3a6daf4bb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:47.822845 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a37e7-489f-49d6-9f70-e3a6daf4bb00 admin admin] PATH_INFO: `/v3/users/9f29c3bb32b2477aa93e38ec57061646` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:47.824094 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a37e7-489f-49d6-9f70-e3a6daf4bb00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f29c3bb32b2477aa93e38ec57061646)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:47.826103 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a37e7-489f-49d6-9f70-e3a6daf4bb00 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:48.024457 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-db7a37e7-489f-49d6-9f70-e3a6daf4bb00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f29c3bb32b2477aa93e38ec57061646'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:48.040819 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-db7a37e7-489f-49d6-9f70-e3a6daf4bb00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f29c3bb32b2477aa93e38ec57061646'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:48.048288 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-db7a37e7-489f-49d6-9f70-e3a6daf4bb00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f29c3bb32b2477aa93e38ec57061646'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:48.049035 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-db7a37e7-489f-49d6-9f70-e3a6daf4bb00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f29c3bb32b2477aa93e38ec57061646'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:48.050073 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-db7a37e7-489f-49d6-9f70-e3a6daf4bb00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f29c3bb32b2477aa93e38ec57061646'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:48.054165 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:46:48.134350 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 970/1943] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:46:47 2022] DELETE /identity/v3/users/9f29c3bb32b2477aa93e38ec57061646 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:46:48.377482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52579e2f-cc36-4619-9f28-3bb59219715e service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:48.392660 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52579e2f-cc36-4619-9f28-3bb59219715e service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:48.457618 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f406f5-a85c-49ea-9609-b97493b74ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:48.458544 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f406f5-a85c-49ea-9609-b97493b74ccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:48.458815 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f406f5-a85c-49ea-9609-b97493b74ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:48.459086 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f406f5-a85c-49ea-9609-b97493b74ccc admin admin] PATH_INFO: `/v3/projects/48d42fe4742240e48eb3775d20ab7fee` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:48.460301 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f406f5-a85c-49ea-9609-b97493b74ccc admin admin] RBAC: Authorizing `identity:delete_project(project_id=48d42fe4742240e48eb3775d20ab7fee)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:48.462563 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f406f5-a85c-49ea-9609-b97493b74ccc admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:48.587433 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e3f406f5-a85c-49ea-9609-b97493b74ccc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48d42fe4742240e48eb3775d20ab7fee', 'request_id': 'req-e3f406f5-a85c-49ea-9609-b97493b74ccc'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:48.589109 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:46:48.595190 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e3f406f5-a85c-49ea-9609-b97493b74ccc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48d42fe4742240e48eb3775d20ab7fee', 'request_id': 'req-e3f406f5-a85c-49ea-9609-b97493b74ccc'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:48.604404 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e3f406f5-a85c-49ea-9609-b97493b74ccc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48d42fe4742240e48eb3775d20ab7fee', 'request_id': 'req-e3f406f5-a85c-49ea-9609-b97493b74ccc'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:48.662788 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e3f406f5-a85c-49ea-9609-b97493b74ccc admin admin] The token cache is being invalidate because project 48d42fe4742240e48eb3775d20ab7fee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:46:48.663232 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e3f406f5-a85c-49ea-9609-b97493b74ccc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:48.663919 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e3f406f5-a85c-49ea-9609-b97493b74ccc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:48.665830 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 974/1944] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:46:48 2022] DELETE /identity/v3/projects/48d42fe4742240e48eb3775d20ab7fee => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:46:53.095658 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a37e7-489f-49d6-9f70-e3a6daf4bb00 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:53.098315 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-db7a37e7-489f-49d6-9f70-e3a6daf4bb00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:53.114781 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a37e7-489f-49d6-9f70-e3a6daf4bb00 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:53.198251 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da51de-3c8d-4258-b984-3e76f8e4d142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:53.199140 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da51de-3c8d-4258-b984-3e76f8e4d142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:53.199483 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da51de-3c8d-4258-b984-3e76f8e4d142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:53.199968 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da51de-3c8d-4258-b984-3e76f8e4d142 admin admin] PATH_INFO: `/v3/users/193e45cadb3c4586ab94051c42cf5192` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:53.201880 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da51de-3c8d-4258-b984-3e76f8e4d142 admin admin] RBAC: Authorizing `identity:delete_user(user_id=193e45cadb3c4586ab94051c42cf5192)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:53.204182 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da51de-3c8d-4258-b984-3e76f8e4d142 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:53.385668 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b8da51de-3c8d-4258-b984-3e76f8e4d142 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '193e45cadb3c4586ab94051c42cf5192'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:53.400042 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b8da51de-3c8d-4258-b984-3e76f8e4d142 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '193e45cadb3c4586ab94051c42cf5192'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:53.407615 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b8da51de-3c8d-4258-b984-3e76f8e4d142 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '193e45cadb3c4586ab94051c42cf5192'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:53.408585 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b8da51de-3c8d-4258-b984-3e76f8e4d142 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '193e45cadb3c4586ab94051c42cf5192'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:53.409481 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b8da51de-3c8d-4258-b984-3e76f8e4d142 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '193e45cadb3c4586ab94051c42cf5192'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:53.513629 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 971/1945] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:46:53 2022] DELETE /identity/v3/users/193e45cadb3c4586ab94051c42cf5192 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:46:53.744337 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f406f5-a85c-49ea-9609-b97493b74ccc admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:53.746389 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e3f406f5-a85c-49ea-9609-b97493b74ccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:53.759883 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f406f5-a85c-49ea-9609-b97493b74ccc admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:53.825921 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb438d-4717-41bf-8f23-8ec60b7fe414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:53.826588 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb438d-4717-41bf-8f23-8ec60b7fe414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:53.826867 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb438d-4717-41bf-8f23-8ec60b7fe414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:53.827139 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb438d-4717-41bf-8f23-8ec60b7fe414 admin admin] PATH_INFO: `/v3/projects/faaf91ebd0fc4c278fccac280201f61c` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:53.828300 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb438d-4717-41bf-8f23-8ec60b7fe414 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faaf91ebd0fc4c278fccac280201f61c)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:53.830221 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb438d-4717-41bf-8f23-8ec60b7fe414 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:53.960399 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7ccb438d-4717-41bf-8f23-8ec60b7fe414 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faaf91ebd0fc4c278fccac280201f61c', 'request_id': 'req-7ccb438d-4717-41bf-8f23-8ec60b7fe414'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:53.966015 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7ccb438d-4717-41bf-8f23-8ec60b7fe414 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faaf91ebd0fc4c278fccac280201f61c', 'request_id': 'req-7ccb438d-4717-41bf-8f23-8ec60b7fe414'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:53.973545 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7ccb438d-4717-41bf-8f23-8ec60b7fe414 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faaf91ebd0fc4c278fccac280201f61c', 'request_id': 'req-7ccb438d-4717-41bf-8f23-8ec60b7fe414'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:54.060756 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7ccb438d-4717-41bf-8f23-8ec60b7fe414 admin admin] The token cache is being invalidate because project faaf91ebd0fc4c278fccac280201f61c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:46:54.061037 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7ccb438d-4717-41bf-8f23-8ec60b7fe414 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:54.062089 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7ccb438d-4717-41bf-8f23-8ec60b7fe414 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:54.063216 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 975/1946] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:46:53 2022] DELETE /identity/v3/projects/faaf91ebd0fc4c278fccac280201f61c => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:46:54.069800 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c1a90-c7ce-46f2-b066-a4aa6f01f256 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:54.070080 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c1a90-c7ce-46f2-b066-a4aa6f01f256 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:54.070495 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c1a90-c7ce-46f2-b066-a4aa6f01f256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:54.091123 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-fa9c1a90-c7ce-46f2-b066-a4aa6f01f256 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:46:54.094612 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-fa9c1a90-c7ce-46f2-b066-a4aa6f01f256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:54.157487 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 972/1947] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:46:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:46:54.159458 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed12b83-c3c5-4983-84f0-8716d96e3931 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:54.159902 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed12b83-c3c5-4983-84f0-8716d96e3931 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:54.160216 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed12b83-c3c5-4983-84f0-8716d96e3931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:54.183009 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-8ed12b83-c3c5-4983-84f0-8716d96e3931 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:46:54.184278 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8ed12b83-c3c5-4983-84f0-8716d96e3931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:54.194725 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 976/1948] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:46:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:46:54.198719 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c1a90-c7ce-46f2-b066-a4aa6f01f256 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:54.208954 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c1a90-c7ce-46f2-b066-a4aa6f01f256 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:54.214264 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d77e4-2672-4de6-87ec-a5a2383121b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:54.214883 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d77e4-2672-4de6-87ec-a5a2383121b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:54.215162 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d77e4-2672-4de6-87ec-a5a2383121b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:54.215594 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d77e4-2672-4de6-87ec-a5a2383121b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:54.216459 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d77e4-2672-4de6-87ec-a5a2383121b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:46:54.218576 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d77e4-2672-4de6-87ec-a5a2383121b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:54.220219 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d77e4-2672-4de6-87ec-a5a2383121b0 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:54.245712 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 973/1949] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:46:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:46:54.248954 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed12b83-c3c5-4983-84f0-8716d96e3931 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:54.259025 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed12b83-c3c5-4983-84f0-8716d96e3931 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:54.273270 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ec683-2d77-470f-af76-2a4c15bebdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:54.273918 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ec683-2d77-470f-af76-2a4c15bebdd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:54.274194 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ec683-2d77-470f-af76-2a4c15bebdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:54.274465 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ec683-2d77-470f-af76-2a4c15bebdd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:54.275497 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ec683-2d77-470f-af76-2a4c15bebdd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:54.277349 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ec683-2d77-470f-af76-2a4c15bebdd5 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:54.558834 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 977/1950] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:46:54 2022] POST /identity/v3/projects => generated 383 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:46:54.563198 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d77e4-2672-4de6-87ec-a5a2383121b0 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:54.569446 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:46:54.577268 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d77e4-2672-4de6-87ec-a5a2383121b0 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:54.646112 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632aa1d5-3986-4622-b22d-ea2bad7f1a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:54.647313 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632aa1d5-3986-4622-b22d-ea2bad7f1a2d admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:54.647830 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632aa1d5-3986-4622-b22d-ea2bad7f1a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:54.651346 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632aa1d5-3986-4622-b22d-ea2bad7f1a2d admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:54.651346 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632aa1d5-3986-4622-b22d-ea2bad7f1a2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:54.651346 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632aa1d5-3986-4622-b22d-ea2bad7f1a2d admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:54.726236 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 974/1951] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:46:54 2022] POST /identity/v3/users => generated 292 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:46:54.730125 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ec683-2d77-470f-af76-2a4c15bebdd5 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:54.742985 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ec683-2d77-470f-af76-2a4c15bebdd5 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:54.748694 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca45aba-674b-43d0-be45-8fd4138b6688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:54.749618 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca45aba-674b-43d0-be45-8fd4138b6688 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:54.750071 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca45aba-674b-43d0-be45-8fd4138b6688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:54.750559 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca45aba-674b-43d0-be45-8fd4138b6688 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:54.751386 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca45aba-674b-43d0-be45-8fd4138b6688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:54.753030 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca45aba-674b-43d0-be45-8fd4138b6688 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:54.764601 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 978/1952] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:46:54.768376 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632aa1d5-3986-4622-b22d-ea2bad7f1a2d admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:54.780161 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632aa1d5-3986-4622-b22d-ea2bad7f1a2d admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:54.786682 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73386b-ef3a-4451-9d90-cff3404a29c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:54.787317 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73386b-ef3a-4451-9d90-cff3404a29c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:54.787595 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73386b-ef3a-4451-9d90-cff3404a29c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:54.787867 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73386b-ef3a-4451-9d90-cff3404a29c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:54.788610 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e73386b-ef3a-4451-9d90-cff3404a29c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:54.790293 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e73386b-ef3a-4451-9d90-cff3404a29c8 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:54.805400 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 975/1953] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:46:54.806719 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca45aba-674b-43d0-be45-8fd4138b6688 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:54.817366 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca45aba-674b-43d0-be45-8fd4138b6688 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:54.822671 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d375619d-efcd-40b4-b43b-050e40a68865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:54.823544 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375619d-efcd-40b4-b43b-050e40a68865 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:54.824080 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375619d-efcd-40b4-b43b-050e40a68865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:54.824356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375619d-efcd-40b4-b43b-050e40a68865 admin admin] PATH_INFO: `/v3/projects/63f3cb6628994a8c9deb4a9dcf69f0f3/users/042a1b1914fb4892920cf7ace3e8869d/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:54.841065 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d375619d-efcd-40b4-b43b-050e40a68865 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63f3cb6628994a8c9deb4a9dcf69f0f3, user_id=042a1b1914fb4892920cf7ace3e8869d, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:54.843730 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d375619d-efcd-40b4-b43b-050e40a68865 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:54.954605 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73386b-ef3a-4451-9d90-cff3404a29c8 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:54.960106 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-2e73386b-ef3a-4451-9d90-cff3404a29c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:54.960319 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 979/1954] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:46:54 2022] PUT /identity/v3/projects/63f3cb6628994a8c9deb4a9dcf69f0f3/users/042a1b1914fb4892920cf7ace3e8869d/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:46:54.968529 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad378d5-8502-4aa2-abf5-59a6b1e1f386 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:54.968862 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad378d5-8502-4aa2-abf5-59a6b1e1f386 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:54.969138 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad378d5-8502-4aa2-abf5-59a6b1e1f386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:54.981302 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:46:55.002943 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-fad378d5-8502-4aa2-abf5-59a6b1e1f386 None None] MFA Rules not processed for user `042a1b1914fb4892920cf7ace3e8869d`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:46:55.005253 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-fad378d5-8502-4aa2-abf5-59a6b1e1f386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:55.053908 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73386b-ef3a-4451-9d90-cff3404a29c8 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:55.106928 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 980/1955] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:46:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:46:55.122014 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad378d5-8502-4aa2-abf5-59a6b1e1f386 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:55.123874 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-fad378d5-8502-4aa2-abf5-59a6b1e1f386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:55.179295 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820ae75-a39c-4674-b360-031b5b774a1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:55.181075 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820ae75-a39c-4674-b360-031b5b774a1b service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:55.181364 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820ae75-a39c-4674-b360-031b5b774a1b service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:55.181647 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820ae75-a39c-4674-b360-031b5b774a1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:55.192677 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-3820ae75-a39c-4674-b360-031b5b774a1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:55.219039 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820ae75-a39c-4674-b360-031b5b774a1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:55.221927 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820ae75-a39c-4674-b360-031b5b774a1b service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:55.239945 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 976/1956] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:46:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:46:55.281874 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad378d5-8502-4aa2-abf5-59a6b1e1f386 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:55.297868 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a5888-cd45-449f-bda0-40dc4b2d4673 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:55.298491 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a5888-cd45-449f-bda0-40dc4b2d4673 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:55.298767 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a5888-cd45-449f-bda0-40dc4b2d4673 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:55.299038 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a5888-cd45-449f-bda0-40dc4b2d4673 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:55.310610 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a5888-cd45-449f-bda0-40dc4b2d4673 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:55.314419 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a5888-cd45-449f-bda0-40dc4b2d4673 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:55.326574 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 981/1957] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:46:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:46:57.668544 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820ae75-a39c-4674-b360-031b5b774a1b service nova] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:57.670787 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-3820ae75-a39c-4674-b360-031b5b774a1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:57.678652 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:46:57.746860 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820ae75-a39c-4674-b360-031b5b774a1b service nova] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:57.751992 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf93a6-4914-480a-92c8-eb9fa65e87f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:57.754439 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf93a6-4914-480a-92c8-eb9fa65e87f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:57.754439 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf93a6-4914-480a-92c8-eb9fa65e87f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:57.754439 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf93a6-4914-480a-92c8-eb9fa65e87f8 admin admin] PATH_INFO: `/v3/users/92177a17953c4c579ac8aec0f350a000` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:57.755425 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf93a6-4914-480a-92c8-eb9fa65e87f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92177a17953c4c579ac8aec0f350a000)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:57.757578 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf93a6-4914-480a-92c8-eb9fa65e87f8 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:57.995686 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-32cf93a6-4914-480a-92c8-eb9fa65e87f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92177a17953c4c579ac8aec0f350a000'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:58.008851 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-32cf93a6-4914-480a-92c8-eb9fa65e87f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92177a17953c4c579ac8aec0f350a000'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:58.015822 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-32cf93a6-4914-480a-92c8-eb9fa65e87f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92177a17953c4c579ac8aec0f350a000'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:58.016577 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-32cf93a6-4914-480a-92c8-eb9fa65e87f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92177a17953c4c579ac8aec0f350a000'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:58.019751 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-32cf93a6-4914-480a-92c8-eb9fa65e87f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92177a17953c4c579ac8aec0f350a000'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:58.095697 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 977/1958] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:46:57 2022] DELETE /identity/v3/users/92177a17953c4c579ac8aec0f350a000 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:46:58.392712 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a5888-cd45-449f-bda0-40dc4b2d4673 service nova] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:58.409032 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a5888-cd45-449f-bda0-40dc4b2d4673 service nova] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:58.507014 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0593e2-cf89-431e-a289-dab828c401c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:58.508152 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0593e2-cf89-431e-a289-dab828c401c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:58.508431 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0593e2-cf89-431e-a289-dab828c401c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:58.508695 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0593e2-cf89-431e-a289-dab828c401c9 admin admin] PATH_INFO: `/v3/projects/2cb2e21ffdc046aabfd5c05bc8f5123b` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:58.510572 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0593e2-cf89-431e-a289-dab828c401c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cb2e21ffdc046aabfd5c05bc8f5123b)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:58.511967 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0593e2-cf89-431e-a289-dab828c401c9 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:58.537434 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:46:58.657919 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7d0593e2-cf89-431e-a289-dab828c401c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cb2e21ffdc046aabfd5c05bc8f5123b', 'request_id': 'req-7d0593e2-cf89-431e-a289-dab828c401c9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:58.664490 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7d0593e2-cf89-431e-a289-dab828c401c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cb2e21ffdc046aabfd5c05bc8f5123b', 'request_id': 'req-7d0593e2-cf89-431e-a289-dab828c401c9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:58.672225 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7d0593e2-cf89-431e-a289-dab828c401c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cb2e21ffdc046aabfd5c05bc8f5123b', 'request_id': 'req-7d0593e2-cf89-431e-a289-dab828c401c9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:59.146622 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7d0593e2-cf89-431e-a289-dab828c401c9 admin admin] The token cache is being invalidate because project 2cb2e21ffdc046aabfd5c05bc8f5123b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:46:59.146912 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7d0593e2-cf89-431e-a289-dab828c401c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:59.147536 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7d0593e2-cf89-431e-a289-dab828c401c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:59.155158 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 982/1959] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:46:58 2022] DELETE /identity/v3/projects/2cb2e21ffdc046aabfd5c05bc8f5123b => generated 0 bytes in 757 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:46:59.155296 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf93a6-4914-480a-92c8-eb9fa65e87f8 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:59.155296 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-32cf93a6-4914-480a-92c8-eb9fa65e87f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:59.168941 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf93a6-4914-480a-92c8-eb9fa65e87f8 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:59.229771 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4999a55-9244-467f-ab8f-cce637de6e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:59.230492 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4999a55-9244-467f-ab8f-cce637de6e99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:59.230725 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4999a55-9244-467f-ab8f-cce637de6e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:59.230998 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4999a55-9244-467f-ab8f-cce637de6e99 admin admin] PATH_INFO: `/v3/users/5f6c3a40953b40a7be6d194dc33d9275` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:59.232272 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4999a55-9244-467f-ab8f-cce637de6e99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f6c3a40953b40a7be6d194dc33d9275)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:59.234243 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4999a55-9244-467f-ab8f-cce637de6e99 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:59.330853 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:46:59.447041 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f4999a55-9244-467f-ab8f-cce637de6e99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f6c3a40953b40a7be6d194dc33d9275'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:59.463321 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f4999a55-9244-467f-ab8f-cce637de6e99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f6c3a40953b40a7be6d194dc33d9275'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:59.474328 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f4999a55-9244-467f-ab8f-cce637de6e99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f6c3a40953b40a7be6d194dc33d9275'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:59.475314 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f4999a55-9244-467f-ab8f-cce637de6e99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f6c3a40953b40a7be6d194dc33d9275'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:59.475956 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f4999a55-9244-467f-ab8f-cce637de6e99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f6c3a40953b40a7be6d194dc33d9275'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:59.567799 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 978/1960] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:46:59 2022] DELETE /identity/v3/users/5f6c3a40953b40a7be6d194dc33d9275 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:46:59.858490 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0593e2-cf89-431e-a289-dab828c401c9 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:59.862954 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7d0593e2-cf89-431e-a289-dab828c401c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:59.883033 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0593e2-cf89-431e-a289-dab828c401c9 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:59.960972 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5dcf17-0b5c-4a3f-b02a-edc12930c4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:59.961613 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dcf17-0b5c-4a3f-b02a-edc12930c4ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:59.961821 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dcf17-0b5c-4a3f-b02a-edc12930c4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:59.962105 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dcf17-0b5c-4a3f-b02a-edc12930c4ba admin admin] PATH_INFO: `/v3/projects/7dd44070793f454a9dc1916c16816469` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:59.963641 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5dcf17-0b5c-4a3f-b02a-edc12930c4ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dd44070793f454a9dc1916c16816469)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:59.965836 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5dcf17-0b5c-4a3f-b02a-edc12930c4ba admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:00.073625 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1b5dcf17-0b5c-4a3f-b02a-edc12930c4ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dd44070793f454a9dc1916c16816469', 'request_id': 'req-1b5dcf17-0b5c-4a3f-b02a-edc12930c4ba'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:00.079685 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1b5dcf17-0b5c-4a3f-b02a-edc12930c4ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dd44070793f454a9dc1916c16816469', 'request_id': 'req-1b5dcf17-0b5c-4a3f-b02a-edc12930c4ba'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:00.089568 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1b5dcf17-0b5c-4a3f-b02a-edc12930c4ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dd44070793f454a9dc1916c16816469', 'request_id': 'req-1b5dcf17-0b5c-4a3f-b02a-edc12930c4ba'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:00.176218 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1b5dcf17-0b5c-4a3f-b02a-edc12930c4ba admin admin] The token cache is being invalidate because project 7dd44070793f454a9dc1916c16816469 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:47:00.176713 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1b5dcf17-0b5c-4a3f-b02a-edc12930c4ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:00.177375 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1b5dcf17-0b5c-4a3f-b02a-edc12930c4ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:00.179879 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 983/1961] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:46:59 2022] DELETE /identity/v3/projects/7dd44070793f454a9dc1916c16816469 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:01.778278 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4999a55-9244-467f-ab8f-cce637de6e99 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:01.778760 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f4999a55-9244-467f-ab8f-cce637de6e99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:01.791542 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4999a55-9244-467f-ab8f-cce637de6e99 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:01.846548 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2df3e-9c64-473d-b0ce-a1a85d40e95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:01.847173 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2df3e-9c64-473d-b0ce-a1a85d40e95c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:01.847452 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2df3e-9c64-473d-b0ce-a1a85d40e95c admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:01.847758 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2df3e-9c64-473d-b0ce-a1a85d40e95c admin admin] PATH_INFO: `/v3/users/042a1b1914fb4892920cf7ace3e8869d` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:01.849422 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b2df3e-9c64-473d-b0ce-a1a85d40e95c admin admin] RBAC: Authorizing `identity:delete_user(user_id=042a1b1914fb4892920cf7ace3e8869d)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:01.851324 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b2df3e-9c64-473d-b0ce-a1a85d40e95c admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:02.063537 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-88b2df3e-9c64-473d-b0ce-a1a85d40e95c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '042a1b1914fb4892920cf7ace3e8869d'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:02.075440 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-88b2df3e-9c64-473d-b0ce-a1a85d40e95c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '042a1b1914fb4892920cf7ace3e8869d'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:02.082488 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-88b2df3e-9c64-473d-b0ce-a1a85d40e95c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '042a1b1914fb4892920cf7ace3e8869d'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:02.083109 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-88b2df3e-9c64-473d-b0ce-a1a85d40e95c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '042a1b1914fb4892920cf7ace3e8869d'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:02.083741 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-88b2df3e-9c64-473d-b0ce-a1a85d40e95c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '042a1b1914fb4892920cf7ace3e8869d'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:02.146773 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 979/1962] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:47:01 2022] DELETE /identity/v3/users/042a1b1914fb4892920cf7ace3e8869d => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:02.151195 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d6d9e-c04e-4c49-9a18-e799af5169ee None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:02.151713 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d6d9e-c04e-4c49-9a18-e799af5169ee None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:02.151806 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d6d9e-c04e-4c49-9a18-e799af5169ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:02.172236 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-2d7d6d9e-c04e-4c49-9a18-e799af5169ee None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:02.173434 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2d7d6d9e-c04e-4c49-9a18-e799af5169ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:02.205884 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:02.231251 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 984/1963] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:47:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:02.241924 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2df3e-9c64-473d-b0ce-a1a85d40e95c admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:02.243297 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-88b2df3e-9c64-473d-b0ce-a1a85d40e95c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:02.269363 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:02.303277 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2df3e-9c64-473d-b0ce-a1a85d40e95c admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:02.306875 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3ae14-0e8b-4a48-b18c-e6e08e232583 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:02.307473 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3ae14-0e8b-4a48-b18c-e6e08e232583 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:02.307746 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3ae14-0e8b-4a48-b18c-e6e08e232583 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:02.308014 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3ae14-0e8b-4a48-b18c-e6e08e232583 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:02.317011 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea3ae14-0e8b-4a48-b18c-e6e08e232583 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:02.318369 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea3ae14-0e8b-4a48-b18c-e6e08e232583 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:02.327710 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 980/1964] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:47:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:47:02.709411 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d6d9e-c04e-4c49-9a18-e799af5169ee None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:02.710875 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2d7d6d9e-c04e-4c49-9a18-e799af5169ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:02.726036 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d6d9e-c04e-4c49-9a18-e799af5169ee None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:02.731391 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea15f1-b911-4b1d-939a-27990d36218f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:02.732155 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea15f1-b911-4b1d-939a-27990d36218f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:02.732443 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea15f1-b911-4b1d-939a-27990d36218f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:02.734155 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea15f1-b911-4b1d-939a-27990d36218f admin admin] PATH_INFO: `/v3/projects/63f3cb6628994a8c9deb4a9dcf69f0f3` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:02.734155 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ea15f1-b911-4b1d-939a-27990d36218f admin admin] RBAC: Authorizing `identity:delete_project(project_id=63f3cb6628994a8c9deb4a9dcf69f0f3)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:02.735968 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ea15f1-b911-4b1d-939a-27990d36218f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:02.828208 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-21ea15f1-b911-4b1d-939a-27990d36218f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63f3cb6628994a8c9deb4a9dcf69f0f3', 'request_id': 'req-21ea15f1-b911-4b1d-939a-27990d36218f'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:02.834691 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-21ea15f1-b911-4b1d-939a-27990d36218f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63f3cb6628994a8c9deb4a9dcf69f0f3', 'request_id': 'req-21ea15f1-b911-4b1d-939a-27990d36218f'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:02.841067 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-21ea15f1-b911-4b1d-939a-27990d36218f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63f3cb6628994a8c9deb4a9dcf69f0f3', 'request_id': 'req-21ea15f1-b911-4b1d-939a-27990d36218f'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:02.913033 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-21ea15f1-b911-4b1d-939a-27990d36218f admin admin] The token cache is being invalidate because project 63f3cb6628994a8c9deb4a9dcf69f0f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:47:02.913324 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-21ea15f1-b911-4b1d-939a-27990d36218f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:02.913951 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-21ea15f1-b911-4b1d-939a-27990d36218f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:02.916316 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 985/1965] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:47:02 2022] DELETE /identity/v3/projects/63f3cb6628994a8c9deb4a9dcf69f0f3 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:02.921285 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc220f-5f7b-4c5e-9b6b-511aabb8e690 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:02.921811 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc220f-5f7b-4c5e-9b6b-511aabb8e690 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:02.921811 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc220f-5f7b-4c5e-9b6b-511aabb8e690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:02.942626 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-0dfc220f-5f7b-4c5e-9b6b-511aabb8e690 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:02.943761 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-0dfc220f-5f7b-4c5e-9b6b-511aabb8e690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:03.001724 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 981/1966] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:47:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:03.010118 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a813e-4c06-4e5f-b719-5195c1dd18e8 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:03.010405 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a813e-4c06-4e5f-b719-5195c1dd18e8 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:03.010680 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a813e-4c06-4e5f-b719-5195c1dd18e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:03.030998 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-562a813e-4c06-4e5f-b719-5195c1dd18e8 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:03.032236 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-562a813e-4c06-4e5f-b719-5195c1dd18e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:03.041030 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 986/1967] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:47:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:03.045174 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc220f-5f7b-4c5e-9b6b-511aabb8e690 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:03.054841 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc220f-5f7b-4c5e-9b6b-511aabb8e690 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:03.060876 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1120c-6dd2-4b0f-a56f-f71d3446b77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:03.061506 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1120c-6dd2-4b0f-a56f-f71d3446b77d admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:03.061912 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1120c-6dd2-4b0f-a56f-f71d3446b77d admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:03.062198 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1120c-6dd2-4b0f-a56f-f71d3446b77d admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:03.062938 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee1120c-6dd2-4b0f-a56f-f71d3446b77d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:47:03.063245 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee1120c-6dd2-4b0f-a56f-f71d3446b77d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:03.064899 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee1120c-6dd2-4b0f-a56f-f71d3446b77d admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:03.078912 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 982/1968] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:47:03.083760 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a813e-4c06-4e5f-b719-5195c1dd18e8 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:03.093214 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a813e-4c06-4e5f-b719-5195c1dd18e8 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:03.099679 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113af986-f9a9-4447-841f-b194c9a04085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:03.100397 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113af986-f9a9-4447-841f-b194c9a04085 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:03.100742 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113af986-f9a9-4447-841f-b194c9a04085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:03.101077 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113af986-f9a9-4447-841f-b194c9a04085 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:03.102569 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113af986-f9a9-4447-841f-b194c9a04085 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:03.104621 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113af986-f9a9-4447-841f-b194c9a04085 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:03.217903 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 987/1969] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:47:03 2022] POST /identity/v3/projects => generated 405 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:47:03.221695 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1120c-6dd2-4b0f-a56f-f71d3446b77d admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:03.232551 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1120c-6dd2-4b0f-a56f-f71d3446b77d admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:03.292212 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352199e5-dca9-4cc5-a042-8286374eb78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:03.292880 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352199e5-dca9-4cc5-a042-8286374eb78a admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:03.293154 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352199e5-dca9-4cc5-a042-8286374eb78a admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:03.293422 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352199e5-dca9-4cc5-a042-8286374eb78a admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:03.294050 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352199e5-dca9-4cc5-a042-8286374eb78a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:03.295942 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352199e5-dca9-4cc5-a042-8286374eb78a admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:03.410936 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 983/1970] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:47:03 2022] POST /identity/v3/users => generated 303 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:47:03.415273 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113af986-f9a9-4447-841f-b194c9a04085 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:03.425525 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113af986-f9a9-4447-841f-b194c9a04085 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:03.430571 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf45869-3d29-4709-a081-1dd22ad91d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:03.431163 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf45869-3d29-4709-a081-1dd22ad91d13 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:03.431477 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf45869-3d29-4709-a081-1dd22ad91d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:03.431747 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf45869-3d29-4709-a081-1dd22ad91d13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:03.432524 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf45869-3d29-4709-a081-1dd22ad91d13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:03.434104 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf45869-3d29-4709-a081-1dd22ad91d13 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:03.444023 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 988/1971] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:47:03.447926 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352199e5-dca9-4cc5-a042-8286374eb78a admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:03.457841 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352199e5-dca9-4cc5-a042-8286374eb78a admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:03.462319 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a3997-c037-40c4-9b0e-0666cf45a4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:03.462902 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a3997-c037-40c4-9b0e-0666cf45a4cb admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:03.463174 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a3997-c037-40c4-9b0e-0666cf45a4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:03.463444 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a3997-c037-40c4-9b0e-0666cf45a4cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:03.464095 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4a3997-c037-40c4-9b0e-0666cf45a4cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:03.465706 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4a3997-c037-40c4-9b0e-0666cf45a4cb admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:03.476568 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 984/1972] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:47:03.480574 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf45869-3d29-4709-a081-1dd22ad91d13 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:03.491015 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf45869-3d29-4709-a081-1dd22ad91d13 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:03.495677 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e57f76b-7dc2-44dc-a9fb-6f44b00965c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:03.496342 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57f76b-7dc2-44dc-a9fb-6f44b00965c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:03.496618 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57f76b-7dc2-44dc-a9fb-6f44b00965c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:03.496886 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57f76b-7dc2-44dc-a9fb-6f44b00965c0 admin admin] PATH_INFO: `/v3/projects/9fec64202b2f43038dcaba3624f69984/users/23002d48209945c2bb53555c4871c173/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:03.513685 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e57f76b-7dc2-44dc-a9fb-6f44b00965c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fec64202b2f43038dcaba3624f69984, user_id=23002d48209945c2bb53555c4871c173, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:03.517250 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e57f76b-7dc2-44dc-a9fb-6f44b00965c0 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:03.597723 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 989/1973] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:47:03 2022] PUT /identity/v3/projects/9fec64202b2f43038dcaba3624f69984/users/23002d48209945c2bb53555c4871c173/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:03.602870 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c10a25-06f2-476b-bd82-dba1cdba21cc None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:03.603175 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c10a25-06f2-476b-bd82-dba1cdba21cc None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:03.603442 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c10a25-06f2-476b-bd82-dba1cdba21cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:03.622135 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-34c10a25-06f2-476b-bd82-dba1cdba21cc None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:03.624496 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-34c10a25-06f2-476b-bd82-dba1cdba21cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:03.649681 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:03.683851 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 985/1974] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:47:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:03.694112 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e57f76b-7dc2-44dc-a9fb-6f44b00965c0 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:03.695795 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8e57f76b-7dc2-44dc-a9fb-6f44b00965c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:03.752128 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e57f76b-7dc2-44dc-a9fb-6f44b00965c0 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:03.756392 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a1462-aa47-49e8-a5b4-44d498267954 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:03.756990 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a1462-aa47-49e8-a5b4-44d498267954 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:03.757261 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a1462-aa47-49e8-a5b4-44d498267954 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:03.757526 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a1462-aa47-49e8-a5b4-44d498267954 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:03.766383 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a1462-aa47-49e8-a5b4-44d498267954 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:03.767800 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a1462-aa47-49e8-a5b4-44d498267954 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:03.777246 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 990/1975] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:47:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:47:04.965636 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e71011-749f-42dc-a6b4-447f7bd1cbee None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:04.966133 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e71011-749f-42dc-a6b4-447f7bd1cbee None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:04.966470 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e71011-749f-42dc-a6b4-447f7bd1cbee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:04.997693 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-56e71011-749f-42dc-a6b4-447f7bd1cbee None None] MFA Rules not processed for user `23002d48209945c2bb53555c4871c173`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:04.998914 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-56e71011-749f-42dc-a6b4-447f7bd1cbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:05.070630 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 986/1976] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:47:04 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:05.074668 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a1462-aa47-49e8-a5b4-44d498267954 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:05.079843 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:05.085755 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a1462-aa47-49e8-a5b4-44d498267954 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:05.090437 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c8df4-9195-4bde-be28-6f4471ba6b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:05.091100 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c8df4-9195-4bde-be28-6f4471ba6b97 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:05.091441 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c8df4-9195-4bde-be28-6f4471ba6b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:05.091775 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c8df4-9195-4bde-be28-6f4471ba6b97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:05.092499 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c8df4-9195-4bde-be28-6f4471ba6b97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:05.094458 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c8df4-9195-4bde-be28-6f4471ba6b97 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:05.178503 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 991/1977] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:47:05 2022] POST /identity/v3/projects => generated 405 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:47:05.182081 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e71011-749f-42dc-a6b4-447f7bd1cbee None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:05.194271 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e71011-749f-42dc-a6b4-447f7bd1cbee None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:05.249626 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a872d-47c3-448c-af0d-00e10cc254fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:05.250522 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a872d-47c3-448c-af0d-00e10cc254fd admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:05.250799 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a872d-47c3-448c-af0d-00e10cc254fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:05.251085 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a872d-47c3-448c-af0d-00e10cc254fd admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:05.251721 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a872d-47c3-448c-af0d-00e10cc254fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:05.253793 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a872d-47c3-448c-af0d-00e10cc254fd admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:05.319345 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 987/1978] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:47:05 2022] POST /identity/v3/users => generated 309 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:47:05.323484 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c8df4-9195-4bde-be28-6f4471ba6b97 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:05.334985 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c8df4-9195-4bde-be28-6f4471ba6b97 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:05.340064 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e859265-2357-4bb0-99d2-f04abe5904fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:05.340792 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e859265-2357-4bb0-99d2-f04abe5904fb admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:05.341152 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e859265-2357-4bb0-99d2-f04abe5904fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:05.341483 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e859265-2357-4bb0-99d2-f04abe5904fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:05.342177 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e859265-2357-4bb0-99d2-f04abe5904fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:05.343844 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e859265-2357-4bb0-99d2-f04abe5904fb admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:05.354541 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 992/1979] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:47:05.358675 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a872d-47c3-448c-af0d-00e10cc254fd admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:05.368801 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a872d-47c3-448c-af0d-00e10cc254fd admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:05.373408 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c741d-1edd-4d64-bdd9-caa0d2566cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:05.374045 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c741d-1edd-4d64-bdd9-caa0d2566cd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:05.374320 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c741d-1edd-4d64-bdd9-caa0d2566cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:05.374592 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c741d-1edd-4d64-bdd9-caa0d2566cd5 admin admin] PATH_INFO: `/v3/projects/3ffd2f822d7b4e3c9cecbd5a5f047ed2/users/fba1e885406242e0a8f52f345c9d5d63/roles/9252c356af254127896f3626d925a88a` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:05.389213 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c741d-1edd-4d64-bdd9-caa0d2566cd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ffd2f822d7b4e3c9cecbd5a5f047ed2, user_id=fba1e885406242e0a8f52f345c9d5d63, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:05.391791 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c741d-1edd-4d64-bdd9-caa0d2566cd5 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:05.455888 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 988/1980] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:47:05 2022] PUT /identity/v3/projects/3ffd2f822d7b4e3c9cecbd5a5f047ed2/users/fba1e885406242e0a8f52f345c9d5d63/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:05.460006 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e859265-2357-4bb0-99d2-f04abe5904fb admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:05.469905 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e859265-2357-4bb0-99d2-f04abe5904fb admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:05.530716 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6223ac-13a2-4c7c-bac2-8769ebdff1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:05.531487 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6223ac-13a2-4c7c-bac2-8769ebdff1aa admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:05.531955 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6223ac-13a2-4c7c-bac2-8769ebdff1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:05.532262 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6223ac-13a2-4c7c-bac2-8769ebdff1aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:05.532929 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6223ac-13a2-4c7c-bac2-8769ebdff1aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:05.535160 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6223ac-13a2-4c7c-bac2-8769ebdff1aa admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:05.550665 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 993/1981] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:47:05.552915 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c741d-1edd-4d64-bdd9-caa0d2566cd5 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:05.565618 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c741d-1edd-4d64-bdd9-caa0d2566cd5 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:05.572777 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ee234-1287-4baf-b7f3-992866cdddd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:05.572777 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ee234-1287-4baf-b7f3-992866cdddd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:05.572777 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ee234-1287-4baf-b7f3-992866cdddd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:05.572777 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ee234-1287-4baf-b7f3-992866cdddd7 admin admin] PATH_INFO: `/v3/projects/3ffd2f822d7b4e3c9cecbd5a5f047ed2/users/fba1e885406242e0a8f52f345c9d5d63/roles/9252c356af254127896f3626d925a88a` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:05.575333 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ee234-1287-4baf-b7f3-992866cdddd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ffd2f822d7b4e3c9cecbd5a5f047ed2, user_id=fba1e885406242e0a8f52f345c9d5d63, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:05.579440 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ee234-1287-4baf-b7f3-992866cdddd7 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:05.592912 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 989/1982] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:47:05 2022] PUT /identity/v3/projects/3ffd2f822d7b4e3c9cecbd5a5f047ed2/users/fba1e885406242e0a8f52f345c9d5d63/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:05.709705 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d2731-6190-438f-ae65-b6480cc27ff6 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:05.709990 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d2731-6190-438f-ae65-b6480cc27ff6 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:05.710269 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d2731-6190-438f-ae65-b6480cc27ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:05.731371 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-729d2731-6190-438f-ae65-b6480cc27ff6 None None] MFA Rules not processed for user `0c65f5001a224e0b92e94dc6df9f8f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:05.732744 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-729d2731-6190-438f-ae65-b6480cc27ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:05.792918 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 994/1983] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Nov 2 07:47:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:05.805499 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ee234-1287-4baf-b7f3-992866cdddd7 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:05.807174 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c63ee234-1287-4baf-b7f3-992866cdddd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:05.821778 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:05.875829 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ee234-1287-4baf-b7f3-992866cdddd7 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:05.880937 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dae6dd-fcca-4f51-b42a-4ec71fe1872d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d63a04c2d74c90b95a4f48c49ddb29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:05.881546 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dae6dd-fcca-4f51-b42a-4ec71fe1872d service swift] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:05.881822 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dae6dd-fcca-4f51-b42a-4ec71fe1872d service swift] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:05.882091 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dae6dd-fcca-4f51-b42a-4ec71fe1872d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:05.891127 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dae6dd-fcca-4f51-b42a-4ec71fe1872d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:05.892725 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dae6dd-fcca-4f51-b42a-4ec71fe1872d service swift] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:05.901702 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 990/1984] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Nov 2 07:47:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:47:06.874901 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172bbaf-20f8-4aed-bea7-1019d71db0f0 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:06.875448 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172bbaf-20f8-4aed-bea7-1019d71db0f0 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:06.875707 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172bbaf-20f8-4aed-bea7-1019d71db0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:06.936952 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-9172bbaf-20f8-4aed-bea7-1019d71db0f0 None None] MFA Rules not processed for user `fba1e885406242e0a8f52f345c9d5d63`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:06.943579 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9172bbaf-20f8-4aed-bea7-1019d71db0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:07.068191 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:07.079699 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 995/1985] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:47:06 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:47:08.577084 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dae6dd-fcca-4f51-b42a-4ec71fe1872d service swift] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:08.659121 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dae6dd-fcca-4f51-b42a-4ec71fe1872d service swift] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:08.666608 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d682f-7db0-4cad-9f58-d0234d6a725b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:08.667278 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d682f-7db0-4cad-9f58-d0234d6a725b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:08.667559 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d682f-7db0-4cad-9f58-d0234d6a725b admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:08.667838 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d682f-7db0-4cad-9f58-d0234d6a725b admin admin] PATH_INFO: `/v3/users/23002d48209945c2bb53555c4871c173` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:08.669178 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d682f-7db0-4cad-9f58-d0234d6a725b admin admin] RBAC: Authorizing `identity:delete_user(user_id=23002d48209945c2bb53555c4871c173)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:08.671250 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d682f-7db0-4cad-9f58-d0234d6a725b admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:09.310215 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2b1d682f-7db0-4cad-9f58-d0234d6a725b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23002d48209945c2bb53555c4871c173'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:09.323213 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2b1d682f-7db0-4cad-9f58-d0234d6a725b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23002d48209945c2bb53555c4871c173'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:09.330627 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2b1d682f-7db0-4cad-9f58-d0234d6a725b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23002d48209945c2bb53555c4871c173'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:09.331344 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2b1d682f-7db0-4cad-9f58-d0234d6a725b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23002d48209945c2bb53555c4871c173'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:09.332020 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2b1d682f-7db0-4cad-9f58-d0234d6a725b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23002d48209945c2bb53555c4871c173'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:09.399001 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 991/1986] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:47:08 2022] DELETE /identity/v3/users/23002d48209945c2bb53555c4871c173 => generated 0 bytes in 823 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:09.819522 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172bbaf-20f8-4aed-bea7-1019d71db0f0 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:09.839480 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172bbaf-20f8-4aed-bea7-1019d71db0f0 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:09.930017 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0001b-ab4b-4362-ace1-7e59f6522633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:09.930669 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0001b-ab4b-4362-ace1-7e59f6522633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:09.930948 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0001b-ab4b-4362-ace1-7e59f6522633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:09.931220 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0001b-ab4b-4362-ace1-7e59f6522633 admin admin] PATH_INFO: `/v3/projects/9fec64202b2f43038dcaba3624f69984` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:09.932410 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b0001b-ab4b-4362-ace1-7e59f6522633 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fec64202b2f43038dcaba3624f69984)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:09.934406 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b0001b-ab4b-4362-ace1-7e59f6522633 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:10.061685 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-98b0001b-ab4b-4362-ace1-7e59f6522633 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fec64202b2f43038dcaba3624f69984', 'request_id': 'req-98b0001b-ab4b-4362-ace1-7e59f6522633'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:10.070336 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-98b0001b-ab4b-4362-ace1-7e59f6522633 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fec64202b2f43038dcaba3624f69984', 'request_id': 'req-98b0001b-ab4b-4362-ace1-7e59f6522633'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:10.079171 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-98b0001b-ab4b-4362-ace1-7e59f6522633 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fec64202b2f43038dcaba3624f69984', 'request_id': 'req-98b0001b-ab4b-4362-ace1-7e59f6522633'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:10.165299 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-98b0001b-ab4b-4362-ace1-7e59f6522633 admin admin] The token cache is being invalidate because project 9fec64202b2f43038dcaba3624f69984 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:47:10.165691 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-98b0001b-ab4b-4362-ace1-7e59f6522633 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:10.166479 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-98b0001b-ab4b-4362-ace1-7e59f6522633 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:10.168103 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 996/1987] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:47:09 2022] DELETE /identity/v3/projects/9fec64202b2f43038dcaba3624f69984 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:10.172694 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d682f-7db0-4cad-9f58-d0234d6a725b admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:10.174676 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-2b1d682f-7db0-4cad-9f58-d0234d6a725b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:10.190224 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d682f-7db0-4cad-9f58-d0234d6a725b admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:10.210917 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:10.260838 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e10ccd-368a-419c-8a8d-7065ea41f988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:10.261611 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e10ccd-368a-419c-8a8d-7065ea41f988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:10.261895 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e10ccd-368a-419c-8a8d-7065ea41f988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:10.262222 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e10ccd-368a-419c-8a8d-7065ea41f988 admin admin] PATH_INFO: `/v3/users/fba1e885406242e0a8f52f345c9d5d63` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:10.269067 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e10ccd-368a-419c-8a8d-7065ea41f988 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fba1e885406242e0a8f52f345c9d5d63)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:10.272447 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e10ccd-368a-419c-8a8d-7065ea41f988 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:10.518431 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d3e10ccd-368a-419c-8a8d-7065ea41f988 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fba1e885406242e0a8f52f345c9d5d63'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:10.537910 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d3e10ccd-368a-419c-8a8d-7065ea41f988 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fba1e885406242e0a8f52f345c9d5d63'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:10.547233 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d3e10ccd-368a-419c-8a8d-7065ea41f988 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fba1e885406242e0a8f52f345c9d5d63'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:10.547982 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d3e10ccd-368a-419c-8a8d-7065ea41f988 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fba1e885406242e0a8f52f345c9d5d63'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:10.548815 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d3e10ccd-368a-419c-8a8d-7065ea41f988 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fba1e885406242e0a8f52f345c9d5d63'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:10.640024 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 992/1988] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:47:10 2022] DELETE /identity/v3/users/fba1e885406242e0a8f52f345c9d5d63 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:10.943764 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0001b-ab4b-4362-ace1-7e59f6522633 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:10.943764 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-98b0001b-ab4b-4362-ace1-7e59f6522633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:10.969300 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0001b-ab4b-4362-ace1-7e59f6522633 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:11.049250 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a343f26-be50-4c24-b5b9-0200903ee05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:11.050051 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a343f26-be50-4c24-b5b9-0200903ee05d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:11.050432 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a343f26-be50-4c24-b5b9-0200903ee05d admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:11.050831 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a343f26-be50-4c24-b5b9-0200903ee05d admin admin] PATH_INFO: `/v3/projects/3ffd2f822d7b4e3c9cecbd5a5f047ed2` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:11.053136 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a343f26-be50-4c24-b5b9-0200903ee05d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ffd2f822d7b4e3c9cecbd5a5f047ed2)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:11.056557 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a343f26-be50-4c24-b5b9-0200903ee05d admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:11.152644 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:11.173668 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0a343f26-be50-4c24-b5b9-0200903ee05d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ffd2f822d7b4e3c9cecbd5a5f047ed2', 'request_id': 'req-0a343f26-be50-4c24-b5b9-0200903ee05d'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:11.179841 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0a343f26-be50-4c24-b5b9-0200903ee05d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ffd2f822d7b4e3c9cecbd5a5f047ed2', 'request_id': 'req-0a343f26-be50-4c24-b5b9-0200903ee05d'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:11.188729 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0a343f26-be50-4c24-b5b9-0200903ee05d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ffd2f822d7b4e3c9cecbd5a5f047ed2', 'request_id': 'req-0a343f26-be50-4c24-b5b9-0200903ee05d'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:11.267337 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0a343f26-be50-4c24-b5b9-0200903ee05d admin admin] The token cache is being invalidate because project 3ffd2f822d7b4e3c9cecbd5a5f047ed2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:47:11.267727 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0a343f26-be50-4c24-b5b9-0200903ee05d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:11.271687 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0a343f26-be50-4c24-b5b9-0200903ee05d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:11.273701 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 997/1989] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:47:10 2022] DELETE /identity/v3/projects/3ffd2f822d7b4e3c9cecbd5a5f047ed2 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:11.278875 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acff9c-1004-4c34-96a7-ef5e9662f977 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:11.279374 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acff9c-1004-4c34-96a7-ef5e9662f977 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:11.280706 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acff9c-1004-4c34-96a7-ef5e9662f977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:11.302054 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-b9acff9c-1004-4c34-96a7-ef5e9662f977 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:11.303846 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-b9acff9c-1004-4c34-96a7-ef5e9662f977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:11.380228 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 993/1990] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:47:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:11.390060 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eee882-6236-4e4b-b872-434cfe7c24f0 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:11.390348 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eee882-6236-4e4b-b872-434cfe7c24f0 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:11.390641 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eee882-6236-4e4b-b872-434cfe7c24f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:11.414899 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-c9eee882-6236-4e4b-b872-434cfe7c24f0 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:11.416157 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c9eee882-6236-4e4b-b872-434cfe7c24f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:11.427923 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 998/1991] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:47:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:11.433230 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9acff9c-1004-4c34-96a7-ef5e9662f977 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:11.446618 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9acff9c-1004-4c34-96a7-ef5e9662f977 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:11.451365 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8b4e7-737a-4525-8a5e-93d079bb0130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:11.451969 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8b4e7-737a-4525-8a5e-93d079bb0130 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:11.452457 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8b4e7-737a-4525-8a5e-93d079bb0130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:11.452727 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8b4e7-737a-4525-8a5e-93d079bb0130 admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:11.453360 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e8b4e7-737a-4525-8a5e-93d079bb0130 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:47:11.453658 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e8b4e7-737a-4525-8a5e-93d079bb0130 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:11.455239 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e8b4e7-737a-4525-8a5e-93d079bb0130 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:11.471274 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 994/1992] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:47:11.482701 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eee882-6236-4e4b-b872-434cfe7c24f0 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:11.493297 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eee882-6236-4e4b-b872-434cfe7c24f0 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:11.499310 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc86ea-ff61-4139-a2da-a35bc4b78407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:11.499926 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc86ea-ff61-4139-a2da-a35bc4b78407 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:11.500231 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc86ea-ff61-4139-a2da-a35bc4b78407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:11.501133 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc86ea-ff61-4139-a2da-a35bc4b78407 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:11.501785 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc86ea-ff61-4139-a2da-a35bc4b78407 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:11.503707 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc86ea-ff61-4139-a2da-a35bc4b78407 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:11.602982 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 999/1993] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:47:11 2022] POST /identity/v3/projects => generated 381 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:47:11.606898 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8b4e7-737a-4525-8a5e-93d079bb0130 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:11.618471 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8b4e7-737a-4525-8a5e-93d079bb0130 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:11.652621 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:11.704816 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c65acc-734d-40b0-803b-e51d9fdc6324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:11.705580 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c65acc-734d-40b0-803b-e51d9fdc6324 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:11.705958 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c65acc-734d-40b0-803b-e51d9fdc6324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:11.706333 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c65acc-734d-40b0-803b-e51d9fdc6324 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:11.708290 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c65acc-734d-40b0-803b-e51d9fdc6324 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:11.710376 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c65acc-734d-40b0-803b-e51d9fdc6324 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:11.873547 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 995/1994] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:47:11 2022] POST /identity/v3/users => generated 291 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:47:11.877780 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc86ea-ff61-4139-a2da-a35bc4b78407 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:11.890174 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc86ea-ff61-4139-a2da-a35bc4b78407 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:11.896362 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089377da-940f-441f-b3f5-ff097b68e2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:11.900190 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089377da-940f-441f-b3f5-ff097b68e2c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:11.900190 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089377da-940f-441f-b3f5-ff097b68e2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:11.900190 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089377da-940f-441f-b3f5-ff097b68e2c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:11.900190 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089377da-940f-441f-b3f5-ff097b68e2c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:11.900190 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089377da-940f-441f-b3f5-ff097b68e2c5 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:11.915513 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1000/1995] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:47:11.919766 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c65acc-734d-40b0-803b-e51d9fdc6324 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:11.930795 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c65acc-734d-40b0-803b-e51d9fdc6324 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:11.936138 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccdea1b-4f29-4385-aa1e-b1a7bc048e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:11.936875 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdea1b-4f29-4385-aa1e-b1a7bc048e6d admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:11.937217 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdea1b-4f29-4385-aa1e-b1a7bc048e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:11.937487 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdea1b-4f29-4385-aa1e-b1a7bc048e6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:11.938125 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccdea1b-4f29-4385-aa1e-b1a7bc048e6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:11.940098 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccdea1b-4f29-4385-aa1e-b1a7bc048e6d admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:11.955269 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 996/1996] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:47:11.956456 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089377da-940f-441f-b3f5-ff097b68e2c5 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:11.967744 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089377da-940f-441f-b3f5-ff097b68e2c5 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:11.973351 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6fd8a7-fa47-436f-b858-17612c89607c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:11.977237 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fd8a7-fa47-436f-b858-17612c89607c admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:11.977237 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fd8a7-fa47-436f-b858-17612c89607c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:11.977237 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fd8a7-fa47-436f-b858-17612c89607c admin admin] PATH_INFO: `/v3/projects/5063f7d7d7424339a46a9f556a62d73c/users/70135e568d8648b5aabb5b8177dbb4b2/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:11.991912 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6fd8a7-fa47-436f-b858-17612c89607c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5063f7d7d7424339a46a9f556a62d73c, user_id=70135e568d8648b5aabb5b8177dbb4b2, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:11.994979 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6fd8a7-fa47-436f-b858-17612c89607c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:12.062045 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1001/1997] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:47:11 2022] PUT /identity/v3/projects/5063f7d7d7424339a46a9f556a62d73c/users/70135e568d8648b5aabb5b8177dbb4b2/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:12.074161 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea619e-d2e9-412c-b68c-99f1e8f37877 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:12.074648 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea619e-d2e9-412c-b68c-99f1e8f37877 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:12.075099 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea619e-d2e9-412c-b68c-99f1e8f37877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:12.108820 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-fcea619e-d2e9-412c-b68c-99f1e8f37877 None None] MFA Rules not processed for user `70135e568d8648b5aabb5b8177dbb4b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:12.110060 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-fcea619e-d2e9-412c-b68c-99f1e8f37877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:12.186180 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 997/1998] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:47:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:12.190867 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6fd8a7-fa47-436f-b858-17612c89607c admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:12.267961 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6fd8a7-fa47-436f-b858-17612c89607c admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:12.277167 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148fcb6f-a828-4373-ac09-c588f9ff435a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:12.277872 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fcb6f-a828-4373-ac09-c588f9ff435a admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:12.278239 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fcb6f-a828-4373-ac09-c588f9ff435a admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:12.278703 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fcb6f-a828-4373-ac09-c588f9ff435a admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:12.279043 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148fcb6f-a828-4373-ac09-c588f9ff435a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:12.283089 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148fcb6f-a828-4373-ac09-c588f9ff435a admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:12.387094 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1002/1999] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:47:12 2022] POST /identity/v3/projects => generated 379 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:47:12.388808 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea619e-d2e9-412c-b68c-99f1e8f37877 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:12.401126 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea619e-d2e9-412c-b68c-99f1e8f37877 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:12.468766 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75b6af-9b01-4d50-bccf-b1678166da98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:12.469297 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75b6af-9b01-4d50-bccf-b1678166da98 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:12.469575 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75b6af-9b01-4d50-bccf-b1678166da98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:12.469937 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75b6af-9b01-4d50-bccf-b1678166da98 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:12.470639 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a75b6af-9b01-4d50-bccf-b1678166da98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:12.472869 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a75b6af-9b01-4d50-bccf-b1678166da98 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:12.793884 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 998/2000] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:47:12 2022] POST /identity/v3/users => generated 296 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:47:12.797708 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148fcb6f-a828-4373-ac09-c588f9ff435a admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:12.809080 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148fcb6f-a828-4373-ac09-c588f9ff435a admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:12.813709 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ca160-9c58-40e6-b678-20356833a851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:12.826789 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ca160-9c58-40e6-b678-20356833a851 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:12.826789 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ca160-9c58-40e6-b678-20356833a851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:12.826789 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ca160-9c58-40e6-b678-20356833a851 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:12.826789 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ca160-9c58-40e6-b678-20356833a851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:12.826789 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ca160-9c58-40e6-b678-20356833a851 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:12.828552 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1003/2001] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:47:12.832788 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75b6af-9b01-4d50-bccf-b1678166da98 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:12.844735 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75b6af-9b01-4d50-bccf-b1678166da98 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:12.849824 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec67eec-886a-4f12-b68b-d66bf00dbd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:12.850574 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec67eec-886a-4f12-b68b-d66bf00dbd45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:12.850856 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec67eec-886a-4f12-b68b-d66bf00dbd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:12.851172 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec67eec-886a-4f12-b68b-d66bf00dbd45 admin admin] PATH_INFO: `/v3/projects/c3f5effd91074ce086cbc498a532e50d/users/37b4ce500f164ea9860a13f37e50cdc6/roles/9252c356af254127896f3626d925a88a` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:12.868868 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec67eec-886a-4f12-b68b-d66bf00dbd45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3f5effd91074ce086cbc498a532e50d, user_id=37b4ce500f164ea9860a13f37e50cdc6, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:12.871732 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec67eec-886a-4f12-b68b-d66bf00dbd45 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:12.946633 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 999/2002] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:47:12 2022] PUT /identity/v3/projects/c3f5effd91074ce086cbc498a532e50d/users/37b4ce500f164ea9860a13f37e50cdc6/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:12.950471 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ca160-9c58-40e6-b678-20356833a851 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:12.962147 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ca160-9c58-40e6-b678-20356833a851 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:12.987192 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:13.041010 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3825fe-e618-475c-8ddb-16667c4bddc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:13.041637 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3825fe-e618-475c-8ddb-16667c4bddc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:13.041919 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3825fe-e618-475c-8ddb-16667c4bddc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:13.042229 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3825fe-e618-475c-8ddb-16667c4bddc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:13.042877 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3825fe-e618-475c-8ddb-16667c4bddc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:13.044754 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3825fe-e618-475c-8ddb-16667c4bddc9 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:13.060674 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1004/2003] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:47:13.061823 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec67eec-886a-4f12-b68b-d66bf00dbd45 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:13.068430 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:13.075979 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec67eec-886a-4f12-b68b-d66bf00dbd45 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:13.079401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7bf5a-48af-4954-b7e0-da6ef5e9be44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:13.080134 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7bf5a-48af-4954-b7e0-da6ef5e9be44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:13.080418 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7bf5a-48af-4954-b7e0-da6ef5e9be44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:13.080689 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7bf5a-48af-4954-b7e0-da6ef5e9be44 admin admin] PATH_INFO: `/v3/projects/c3f5effd91074ce086cbc498a532e50d/users/37b4ce500f164ea9860a13f37e50cdc6/roles/9252c356af254127896f3626d925a88a` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:13.083506 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf7bf5a-48af-4954-b7e0-da6ef5e9be44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3f5effd91074ce086cbc498a532e50d, user_id=37b4ce500f164ea9860a13f37e50cdc6, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:13.086328 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf7bf5a-48af-4954-b7e0-da6ef5e9be44 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:13.098746 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1000/2004] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:47:13 2022] PUT /identity/v3/projects/c3f5effd91074ce086cbc498a532e50d/users/37b4ce500f164ea9860a13f37e50cdc6/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:47:13.108900 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2d3d2-c183-44a4-9884-109cee225686 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:13.109314 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2d3d2-c183-44a4-9884-109cee225686 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:13.109701 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2d3d2-c183-44a4-9884-109cee225686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:13.140945 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-5ef2d3d2-c183-44a4-9884-109cee225686 None None] MFA Rules not processed for user `37b4ce500f164ea9860a13f37e50cdc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:13.142450 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5ef2d3d2-c183-44a4-9884-109cee225686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:13.242219 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1005/2005] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:47:13 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:13.253599 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7bf5a-48af-4954-b7e0-da6ef5e9be44 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:13.256764 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-bcf7bf5a-48af-4954-b7e0-da6ef5e9be44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:13.327276 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7bf5a-48af-4954-b7e0-da6ef5e9be44 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:13.331925 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ad47b-ce99-46cb-8e12-830abd39b899 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:13.333331 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ad47b-ce99-46cb-8e12-830abd39b899 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:13.333621 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ad47b-ce99-46cb-8e12-830abd39b899 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:13.333860 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ad47b-ce99-46cb-8e12-830abd39b899 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:13.348214 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ad47b-ce99-46cb-8e12-830abd39b899 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:13.349813 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ad47b-ce99-46cb-8e12-830abd39b899 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:13.371732 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1001/2006] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:47:13 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:47:14.342309 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef2d3d2-c183-44a4-9884-109cee225686 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:14.356197 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef2d3d2-c183-44a4-9884-109cee225686 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:14.361230 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92870b-b11e-4f37-a39f-07d4e5d06258 tempest-VolumeQuotaClassesTest-959679441 tempest-VolumeQuotaClassesTest-959679441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37b4ce500f164ea9860a13f37e50cdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f5effd91074ce086cbc498a532e50d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:14.361970 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92870b-b11e-4f37-a39f-07d4e5d06258 tempest-VolumeQuotaClassesTest-959679441 tempest-VolumeQuotaClassesTest-959679441-project-admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:14.362271 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92870b-b11e-4f37-a39f-07d4e5d06258 tempest-VolumeQuotaClassesTest-959679441 tempest-VolumeQuotaClassesTest-959679441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:14.362552 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92870b-b11e-4f37-a39f-07d4e5d06258 tempest-VolumeQuotaClassesTest-959679441 tempest-VolumeQuotaClassesTest-959679441-project-admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:14.363241 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92870b-b11e-4f37-a39f-07d4e5d06258 tempest-VolumeQuotaClassesTest-959679441 tempest-VolumeQuotaClassesTest-959679441-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:47:14.365626 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92870b-b11e-4f37-a39f-07d4e5d06258 tempest-VolumeQuotaClassesTest-959679441 tempest-VolumeQuotaClassesTest-959679441-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:14.366159 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92870b-b11e-4f37-a39f-07d4e5d06258 tempest-VolumeQuotaClassesTest-959679441 tempest-VolumeQuotaClassesTest-959679441-project-admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:14.384175 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1006/2007] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:47:14.384764 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ad47b-ce99-46cb-8e12-830abd39b899 service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:14.395969 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ad47b-ce99-46cb-8e12-830abd39b899 service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:14.400570 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd67fe3-b0e8-4b9c-b463-99662ae8d5a5 tempest-VolumeQuotaClassesTest-959679441 tempest-VolumeQuotaClassesTest-959679441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37b4ce500f164ea9860a13f37e50cdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f5effd91074ce086cbc498a532e50d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:14.401185 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd67fe3-b0e8-4b9c-b463-99662ae8d5a5 tempest-VolumeQuotaClassesTest-959679441 tempest-VolumeQuotaClassesTest-959679441-project-admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:14.401468 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd67fe3-b0e8-4b9c-b463-99662ae8d5a5 tempest-VolumeQuotaClassesTest-959679441 tempest-VolumeQuotaClassesTest-959679441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:14.401748 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd67fe3-b0e8-4b9c-b463-99662ae8d5a5 tempest-VolumeQuotaClassesTest-959679441 tempest-VolumeQuotaClassesTest-959679441-project-admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:14.402379 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd67fe3-b0e8-4b9c-b463-99662ae8d5a5 tempest-VolumeQuotaClassesTest-959679441 tempest-VolumeQuotaClassesTest-959679441-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:14.404286 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd67fe3-b0e8-4b9c-b463-99662ae8d5a5 tempest-VolumeQuotaClassesTest-959679441 tempest-VolumeQuotaClassesTest-959679441-project-admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:14.495937 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1002/2008] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:47:14 2022] POST /identity/v3/projects => generated 355 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:47:14.497676 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92870b-b11e-4f37-a39f-07d4e5d06258 tempest-VolumeQuotaClassesTest-959679441 tempest-VolumeQuotaClassesTest-959679441-project-admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:14.510095 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92870b-b11e-4f37-a39f-07d4e5d06258 tempest-VolumeQuotaClassesTest-959679441 tempest-VolumeQuotaClassesTest-959679441-project-admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:14.580125 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee6460-c4ee-4497-9a97-f64b5e3565af tempest-VolumeQuotaClassesTest-959679441 tempest-VolumeQuotaClassesTest-959679441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37b4ce500f164ea9860a13f37e50cdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f5effd91074ce086cbc498a532e50d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:14.580929 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee6460-c4ee-4497-9a97-f64b5e3565af tempest-VolumeQuotaClassesTest-959679441 tempest-VolumeQuotaClassesTest-959679441-project-admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:14.581412 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee6460-c4ee-4497-9a97-f64b5e3565af tempest-VolumeQuotaClassesTest-959679441 tempest-VolumeQuotaClassesTest-959679441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:14.581975 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee6460-c4ee-4497-9a97-f64b5e3565af tempest-VolumeQuotaClassesTest-959679441 tempest-VolumeQuotaClassesTest-959679441-project-admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:14.582982 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee6460-c4ee-4497-9a97-f64b5e3565af tempest-VolumeQuotaClassesTest-959679441 tempest-VolumeQuotaClassesTest-959679441-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:47:14.583361 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee6460-c4ee-4497-9a97-f64b5e3565af tempest-VolumeQuotaClassesTest-959679441 tempest-VolumeQuotaClassesTest-959679441-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:14.585064 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee6460-c4ee-4497-9a97-f64b5e3565af tempest-VolumeQuotaClassesTest-959679441 tempest-VolumeQuotaClassesTest-959679441-project-admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:14.602511 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1007/2009] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:47:14.641464 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd67fe3-b0e8-4b9c-b463-99662ae8d5a5 tempest-VolumeQuotaClassesTest-959679441 tempest-VolumeQuotaClassesTest-959679441-project-admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:14.654740 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd67fe3-b0e8-4b9c-b463-99662ae8d5a5 tempest-VolumeQuotaClassesTest-959679441 tempest-VolumeQuotaClassesTest-959679441-project-admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:14.663630 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993dd78c-9a01-456d-aaac-e1f6a08770e0 tempest-VolumeQuotaClassesTest-959679441 tempest-VolumeQuotaClassesTest-959679441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37b4ce500f164ea9860a13f37e50cdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f5effd91074ce086cbc498a532e50d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:14.664340 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dd78c-9a01-456d-aaac-e1f6a08770e0 tempest-VolumeQuotaClassesTest-959679441 tempest-VolumeQuotaClassesTest-959679441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:14.664624 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dd78c-9a01-456d-aaac-e1f6a08770e0 tempest-VolumeQuotaClassesTest-959679441 tempest-VolumeQuotaClassesTest-959679441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:14.665073 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dd78c-9a01-456d-aaac-e1f6a08770e0 tempest-VolumeQuotaClassesTest-959679441 tempest-VolumeQuotaClassesTest-959679441-project-admin] PATH_INFO: `/v3/projects/65e2adbac1044278ab5e45003b97b419` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:14.666204 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993dd78c-9a01-456d-aaac-e1f6a08770e0 tempest-VolumeQuotaClassesTest-959679441 tempest-VolumeQuotaClassesTest-959679441-project-admin] RBAC: Authorizing `identity:delete_project(project_id=65e2adbac1044278ab5e45003b97b419)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:14.668145 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993dd78c-9a01-456d-aaac-e1f6a08770e0 tempest-VolumeQuotaClassesTest-959679441 tempest-VolumeQuotaClassesTest-959679441-project-admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:14.781374 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-993dd78c-9a01-456d-aaac-e1f6a08770e0 tempest-VolumeQuotaClassesTest-959679441 tempest-VolumeQuotaClassesTest-959679441-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65e2adbac1044278ab5e45003b97b419', 'request_id': 'req-993dd78c-9a01-456d-aaac-e1f6a08770e0'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:14.788863 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-993dd78c-9a01-456d-aaac-e1f6a08770e0 tempest-VolumeQuotaClassesTest-959679441 tempest-VolumeQuotaClassesTest-959679441-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65e2adbac1044278ab5e45003b97b419', 'request_id': 'req-993dd78c-9a01-456d-aaac-e1f6a08770e0'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:14.795487 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-993dd78c-9a01-456d-aaac-e1f6a08770e0 tempest-VolumeQuotaClassesTest-959679441 tempest-VolumeQuotaClassesTest-959679441-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65e2adbac1044278ab5e45003b97b419', 'request_id': 'req-993dd78c-9a01-456d-aaac-e1f6a08770e0'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:14.877770 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-993dd78c-9a01-456d-aaac-e1f6a08770e0 tempest-VolumeQuotaClassesTest-959679441 tempest-VolumeQuotaClassesTest-959679441-project-admin] The token cache is being invalidate because project 65e2adbac1044278ab5e45003b97b419 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:47:14.878056 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-993dd78c-9a01-456d-aaac-e1f6a08770e0 tempest-VolumeQuotaClassesTest-959679441 tempest-VolumeQuotaClassesTest-959679441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:14.879379 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-993dd78c-9a01-456d-aaac-e1f6a08770e0 tempest-VolumeQuotaClassesTest-959679441 tempest-VolumeQuotaClassesTest-959679441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:14.882700 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1003/2010] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:47:14 2022] DELETE /identity/v3/projects/65e2adbac1044278ab5e45003b97b419 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:15.524867 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee6460-c4ee-4497-9a97-f64b5e3565af tempest-VolumeQuotaClassesTest-959679441 tempest-VolumeQuotaClassesTest-959679441-project-admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:15.530582 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-39ee6460-c4ee-4497-9a97-f64b5e3565af tempest-VolumeQuotaClassesTest-959679441 tempest-VolumeQuotaClassesTest-959679441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:15.586227 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:15.631914 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee6460-c4ee-4497-9a97-f64b5e3565af tempest-VolumeQuotaClassesTest-959679441 tempest-VolumeQuotaClassesTest-959679441-project-admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:15.709902 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420a120-1323-4eef-bf34-b02268c8c177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:15.710413 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420a120-1323-4eef-bf34-b02268c8c177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:15.710630 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420a120-1323-4eef-bf34-b02268c8c177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:15.710905 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420a120-1323-4eef-bf34-b02268c8c177 admin admin] PATH_INFO: `/v3/users/70135e568d8648b5aabb5b8177dbb4b2` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:15.712373 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5420a120-1323-4eef-bf34-b02268c8c177 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70135e568d8648b5aabb5b8177dbb4b2)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:15.714627 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5420a120-1323-4eef-bf34-b02268c8c177 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:16.155265 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-5420a120-1323-4eef-bf34-b02268c8c177 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70135e568d8648b5aabb5b8177dbb4b2'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:16.168663 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-5420a120-1323-4eef-bf34-b02268c8c177 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70135e568d8648b5aabb5b8177dbb4b2'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:16.169380 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-5420a120-1323-4eef-bf34-b02268c8c177 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70135e568d8648b5aabb5b8177dbb4b2'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:16.177390 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-5420a120-1323-4eef-bf34-b02268c8c177 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70135e568d8648b5aabb5b8177dbb4b2'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:16.182817 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-5420a120-1323-4eef-bf34-b02268c8c177 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70135e568d8648b5aabb5b8177dbb4b2'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:16.268499 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1008/2011] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:47:15 2022] DELETE /identity/v3/users/70135e568d8648b5aabb5b8177dbb4b2 => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:16.273618 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e495d4-56ab-4a9b-a249-9c7426d4bb52 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:16.274101 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e495d4-56ab-4a9b-a249-9c7426d4bb52 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:16.274215 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e495d4-56ab-4a9b-a249-9c7426d4bb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:16.295328 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-28e495d4-56ab-4a9b-a249-9c7426d4bb52 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:16.296996 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-28e495d4-56ab-4a9b-a249-9c7426d4bb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:16.359560 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:16.375474 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1004/2012] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:47:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:16.386315 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420a120-1323-4eef-bf34-b02268c8c177 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:16.387754 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5420a120-1323-4eef-bf34-b02268c8c177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:16.474238 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420a120-1323-4eef-bf34-b02268c8c177 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:16.480905 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda48898-8946-4491-9668-6b7b50091faa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:16.481543 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda48898-8946-4491-9668-6b7b50091faa service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:16.481824 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda48898-8946-4491-9668-6b7b50091faa service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:16.482098 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda48898-8946-4491-9668-6b7b50091faa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:16.495982 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda48898-8946-4491-9668-6b7b50091faa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:16.497648 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda48898-8946-4491-9668-6b7b50091faa service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:16.502266 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:16.509577 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1009/2013] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:47:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:47:17.075167 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e495d4-56ab-4a9b-a249-9c7426d4bb52 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:17.076339 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-28e495d4-56ab-4a9b-a249-9c7426d4bb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:17.088848 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e495d4-56ab-4a9b-a249-9c7426d4bb52 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:17.095547 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db7069-1c28-4f38-9386-eb1f748bb8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:17.096351 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db7069-1c28-4f38-9386-eb1f748bb8ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:17.096635 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db7069-1c28-4f38-9386-eb1f748bb8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:17.096915 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db7069-1c28-4f38-9386-eb1f748bb8ce admin admin] PATH_INFO: `/v3/projects/5063f7d7d7424339a46a9f556a62d73c` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:17.098666 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db7069-1c28-4f38-9386-eb1f748bb8ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=5063f7d7d7424339a46a9f556a62d73c)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:17.100746 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db7069-1c28-4f38-9386-eb1f748bb8ce admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:17.209857 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e3db7069-1c28-4f38-9386-eb1f748bb8ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5063f7d7d7424339a46a9f556a62d73c', 'request_id': 'req-e3db7069-1c28-4f38-9386-eb1f748bb8ce'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:17.216508 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e3db7069-1c28-4f38-9386-eb1f748bb8ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5063f7d7d7424339a46a9f556a62d73c', 'request_id': 'req-e3db7069-1c28-4f38-9386-eb1f748bb8ce'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:17.222551 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e3db7069-1c28-4f38-9386-eb1f748bb8ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5063f7d7d7424339a46a9f556a62d73c', 'request_id': 'req-e3db7069-1c28-4f38-9386-eb1f748bb8ce'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:17.300085 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e3db7069-1c28-4f38-9386-eb1f748bb8ce admin admin] The token cache is being invalidate because project 5063f7d7d7424339a46a9f556a62d73c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:47:17.301223 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e3db7069-1c28-4f38-9386-eb1f748bb8ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:17.301789 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e3db7069-1c28-4f38-9386-eb1f748bb8ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:17.303271 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1005/2014] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:47:17 2022] DELETE /identity/v3/projects/5063f7d7d7424339a46a9f556a62d73c => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:17.307278 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda48898-8946-4491-9668-6b7b50091faa service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:17.317720 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda48898-8946-4491-9668-6b7b50091faa service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:17.374335 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def59dbf-5662-446e-892b-054be82641e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:17.374965 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def59dbf-5662-446e-892b-054be82641e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:17.375246 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def59dbf-5662-446e-892b-054be82641e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:17.375522 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def59dbf-5662-446e-892b-054be82641e7 admin admin] PATH_INFO: `/v3/users/37b4ce500f164ea9860a13f37e50cdc6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:17.377232 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def59dbf-5662-446e-892b-054be82641e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37b4ce500f164ea9860a13f37e50cdc6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:17.379917 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def59dbf-5662-446e-892b-054be82641e7 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:17.583493 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-def59dbf-5662-446e-892b-054be82641e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37b4ce500f164ea9860a13f37e50cdc6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:17.596278 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-def59dbf-5662-446e-892b-054be82641e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37b4ce500f164ea9860a13f37e50cdc6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:17.596935 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-def59dbf-5662-446e-892b-054be82641e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37b4ce500f164ea9860a13f37e50cdc6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:17.605306 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-def59dbf-5662-446e-892b-054be82641e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37b4ce500f164ea9860a13f37e50cdc6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:17.605946 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-def59dbf-5662-446e-892b-054be82641e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37b4ce500f164ea9860a13f37e50cdc6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:17.695479 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1010/2015] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:47:17 2022] DELETE /identity/v3/users/37b4ce500f164ea9860a13f37e50cdc6 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:18.440220 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db7069-1c28-4f38-9386-eb1f748bb8ce admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:18.442762 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e3db7069-1c28-4f38-9386-eb1f748bb8ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:18.456024 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db7069-1c28-4f38-9386-eb1f748bb8ce admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:18.519706 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dab109-7697-4f22-9936-1c170e2de4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:18.520482 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dab109-7697-4f22-9936-1c170e2de4fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:18.520719 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dab109-7697-4f22-9936-1c170e2de4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:18.520994 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dab109-7697-4f22-9936-1c170e2de4fd admin admin] PATH_INFO: `/v3/projects/c3f5effd91074ce086cbc498a532e50d` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:18.522105 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dab109-7697-4f22-9936-1c170e2de4fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3f5effd91074ce086cbc498a532e50d)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:18.523991 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dab109-7697-4f22-9936-1c170e2de4fd admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:18.657711 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d3dab109-7697-4f22-9936-1c170e2de4fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3f5effd91074ce086cbc498a532e50d', 'request_id': 'req-d3dab109-7697-4f22-9936-1c170e2de4fd'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:18.664389 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d3dab109-7697-4f22-9936-1c170e2de4fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3f5effd91074ce086cbc498a532e50d', 'request_id': 'req-d3dab109-7697-4f22-9936-1c170e2de4fd'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:18.669813 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d3dab109-7697-4f22-9936-1c170e2de4fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3f5effd91074ce086cbc498a532e50d', 'request_id': 'req-d3dab109-7697-4f22-9936-1c170e2de4fd'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:18.734467 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d3dab109-7697-4f22-9936-1c170e2de4fd admin admin] The token cache is being invalidate because project c3f5effd91074ce086cbc498a532e50d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:47:18.734755 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d3dab109-7697-4f22-9936-1c170e2de4fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:18.735366 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d3dab109-7697-4f22-9936-1c170e2de4fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:18.737444 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1006/2016] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:47:18 2022] DELETE /identity/v3/projects/c3f5effd91074ce086cbc498a532e50d => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:18.742925 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7821b-37e8-4412-92a5-8664534b0e3f None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:18.743509 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7821b-37e8-4412-92a5-8664534b0e3f None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:18.743509 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7821b-37e8-4412-92a5-8664534b0e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:18.763893 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-46a7821b-37e8-4412-92a5-8664534b0e3f None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:18.765125 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-46a7821b-37e8-4412-92a5-8664534b0e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:18.826816 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1011/2017] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:47:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:18.835304 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54914301-c4c9-4599-8190-d871bd8f2392 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:18.835586 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54914301-c4c9-4599-8190-d871bd8f2392 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:18.835853 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54914301-c4c9-4599-8190-d871bd8f2392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:18.850661 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:18.856164 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-54914301-c4c9-4599-8190-d871bd8f2392 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:18.857395 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-54914301-c4c9-4599-8190-d871bd8f2392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:18.865359 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1007/2018] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:47:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:18.869482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7821b-37e8-4412-92a5-8664534b0e3f None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:18.879065 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7821b-37e8-4412-92a5-8664534b0e3f None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:18.884002 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb528d9-44bf-421a-893f-e99906f08586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:18.884269 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb528d9-44bf-421a-893f-e99906f08586 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:18.884544 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb528d9-44bf-421a-893f-e99906f08586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:18.884828 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb528d9-44bf-421a-893f-e99906f08586 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:18.885450 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb528d9-44bf-421a-893f-e99906f08586 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:47:18.885798 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb528d9-44bf-421a-893f-e99906f08586 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:18.887325 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb528d9-44bf-421a-893f-e99906f08586 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:18.899354 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1012/2019] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:47:18.903499 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54914301-c4c9-4599-8190-d871bd8f2392 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:18.913426 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54914301-c4c9-4599-8190-d871bd8f2392 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:18.918342 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd3580-8361-443d-bd4d-3d57a6d898b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:18.918931 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd3580-8361-443d-bd4d-3d57a6d898b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:18.919208 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd3580-8361-443d-bd4d-3d57a6d898b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:18.919475 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd3580-8361-443d-bd4d-3d57a6d898b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:18.920140 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd3580-8361-443d-bd4d-3d57a6d898b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:18.922048 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd3580-8361-443d-bd4d-3d57a6d898b3 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:18.987481 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1008/2020] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:47:18 2022] POST /identity/v3/projects => generated 367 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:47:18.991705 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb528d9-44bf-421a-893f-e99906f08586 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:18.997954 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:19.001706 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb528d9-44bf-421a-893f-e99906f08586 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:19.058730 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510afb0f-9b45-4942-b7cc-2a87bd1dc38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:19.059329 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510afb0f-9b45-4942-b7cc-2a87bd1dc38e admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:19.059618 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510afb0f-9b45-4942-b7cc-2a87bd1dc38e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:19.059900 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510afb0f-9b45-4942-b7cc-2a87bd1dc38e admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:19.060537 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510afb0f-9b45-4942-b7cc-2a87bd1dc38e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:19.062447 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510afb0f-9b45-4942-b7cc-2a87bd1dc38e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:19.117701 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1013/2021] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:47:18 2022] POST /identity/v3/users => generated 284 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:47:19.121966 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd3580-8361-443d-bd4d-3d57a6d898b3 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:19.132735 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd3580-8361-443d-bd4d-3d57a6d898b3 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:19.137439 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e872696-8f68-49bf-8874-d11810330fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:19.137977 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e872696-8f68-49bf-8874-d11810330fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:19.138263 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e872696-8f68-49bf-8874-d11810330fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:19.138536 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e872696-8f68-49bf-8874-d11810330fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:19.139164 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e872696-8f68-49bf-8874-d11810330fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:19.140827 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e872696-8f68-49bf-8874-d11810330fe9 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:19.151377 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1009/2022] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:47:19.155414 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510afb0f-9b45-4942-b7cc-2a87bd1dc38e admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:19.165713 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510afb0f-9b45-4942-b7cc-2a87bd1dc38e admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:19.171138 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f6dd9-7f01-42f4-9db4-02819a6832fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:19.171138 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f6dd9-7f01-42f4-9db4-02819a6832fe admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:19.171918 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f6dd9-7f01-42f4-9db4-02819a6832fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:19.171918 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f6dd9-7f01-42f4-9db4-02819a6832fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:19.172242 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f6dd9-7f01-42f4-9db4-02819a6832fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:19.173897 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f6dd9-7f01-42f4-9db4-02819a6832fe admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:19.185423 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1014/2023] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:47:19.189692 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e872696-8f68-49bf-8874-d11810330fe9 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:19.200509 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e872696-8f68-49bf-8874-d11810330fe9 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:19.205579 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6647ec8-76f2-40ef-81b5-6636d303583f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:19.208855 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6647ec8-76f2-40ef-81b5-6636d303583f admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:19.208855 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6647ec8-76f2-40ef-81b5-6636d303583f admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:19.208855 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6647ec8-76f2-40ef-81b5-6636d303583f admin admin] PATH_INFO: `/v3/projects/818861d2c93f413da5f9baf7c4f9fe62/users/6f25395bb3364ac08b32e25a5190c74e/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:19.223280 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6647ec8-76f2-40ef-81b5-6636d303583f admin admin] RBAC: Authorizing `identity:create_grant(project_id=818861d2c93f413da5f9baf7c4f9fe62, user_id=6f25395bb3364ac08b32e25a5190c74e, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:19.225962 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6647ec8-76f2-40ef-81b5-6636d303583f admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:19.290319 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1010/2024] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:47:19 2022] PUT /identity/v3/projects/818861d2c93f413da5f9baf7c4f9fe62/users/6f25395bb3364ac08b32e25a5190c74e/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:19.301602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65550949-2e86-4f42-9309-aa9423ac977b None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:19.301887 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65550949-2e86-4f42-9309-aa9423ac977b None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:19.302161 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65550949-2e86-4f42-9309-aa9423ac977b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:19.332624 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-65550949-2e86-4f42-9309-aa9423ac977b None None] MFA Rules not processed for user `6f25395bb3364ac08b32e25a5190c74e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:19.333852 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-65550949-2e86-4f42-9309-aa9423ac977b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:19.398116 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1015/2025] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:47:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:19.402474 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6647ec8-76f2-40ef-81b5-6636d303583f admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:19.464845 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6647ec8-76f2-40ef-81b5-6636d303583f admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:19.469571 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13aab9-3fdb-4490-8480-39bbab9ae5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:19.470169 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13aab9-3fdb-4490-8480-39bbab9ae5e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:19.470448 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13aab9-3fdb-4490-8480-39bbab9ae5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:19.470724 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13aab9-3fdb-4490-8480-39bbab9ae5e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:19.471355 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d13aab9-3fdb-4490-8480-39bbab9ae5e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:19.474383 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d13aab9-3fdb-4490-8480-39bbab9ae5e2 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:19.605696 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1011/2026] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:47:19 2022] POST /identity/v3/projects => generated 367 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:47:19.609550 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65550949-2e86-4f42-9309-aa9423ac977b None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:19.620186 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65550949-2e86-4f42-9309-aa9423ac977b None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:19.676455 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f4343-af6a-4818-a95e-27ed6109be60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:19.676978 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f4343-af6a-4818-a95e-27ed6109be60 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:19.677253 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f4343-af6a-4818-a95e-27ed6109be60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:19.677524 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f4343-af6a-4818-a95e-27ed6109be60 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:19.678146 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f4343-af6a-4818-a95e-27ed6109be60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:19.680078 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f4343-af6a-4818-a95e-27ed6109be60 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:19.795295 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1016/2027] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:47:19 2022] POST /identity/v3/users => generated 290 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:47:19.796562 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13aab9-3fdb-4490-8480-39bbab9ae5e2 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:19.807522 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13aab9-3fdb-4490-8480-39bbab9ae5e2 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:19.812142 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7d954-b7f6-493b-a20f-e8890e51cd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:19.812757 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7d954-b7f6-493b-a20f-e8890e51cd24 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:19.813024 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7d954-b7f6-493b-a20f-e8890e51cd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:19.813293 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7d954-b7f6-493b-a20f-e8890e51cd24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:19.813970 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7d954-b7f6-493b-a20f-e8890e51cd24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:19.815573 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7d954-b7f6-493b-a20f-e8890e51cd24 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:19.826391 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1012/2028] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:47:19.830511 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f4343-af6a-4818-a95e-27ed6109be60 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:19.835726 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:19.841071 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f4343-af6a-4818-a95e-27ed6109be60 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:19.845867 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3092e9-749f-4211-b722-e935b66e447b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:19.846515 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3092e9-749f-4211-b722-e935b66e447b admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:19.846797 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3092e9-749f-4211-b722-e935b66e447b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:19.847073 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3092e9-749f-4211-b722-e935b66e447b admin admin] PATH_INFO: `/v3/projects/e59e61ebbad044239b68e5ebe0a53edd/users/ac6a1eacf4c44dc581e4dd466eefb5a3/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:19.862281 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3092e9-749f-4211-b722-e935b66e447b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e59e61ebbad044239b68e5ebe0a53edd, user_id=ac6a1eacf4c44dc581e4dd466eefb5a3, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:19.865947 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3092e9-749f-4211-b722-e935b66e447b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:19.929878 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1017/2029] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:47:19 2022] PUT /identity/v3/projects/e59e61ebbad044239b68e5ebe0a53edd/users/ac6a1eacf4c44dc581e4dd466eefb5a3/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:19.933723 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7d954-b7f6-493b-a20f-e8890e51cd24 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:19.944948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7d954-b7f6-493b-a20f-e8890e51cd24 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:20.001167 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9183c4f-031b-4e67-aa5e-1b0a290d8570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:20.001771 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9183c4f-031b-4e67-aa5e-1b0a290d8570 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:20.002049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9183c4f-031b-4e67-aa5e-1b0a290d8570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:20.002320 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9183c4f-031b-4e67-aa5e-1b0a290d8570 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:20.002946 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9183c4f-031b-4e67-aa5e-1b0a290d8570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:20.004555 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9183c4f-031b-4e67-aa5e-1b0a290d8570 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:20.014820 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1013/2030] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:47:20.018981 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3092e9-749f-4211-b722-e935b66e447b admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:20.029920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3092e9-749f-4211-b722-e935b66e447b admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:20.034689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802a999-0638-4804-be8c-ad15ece896c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:20.035335 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802a999-0638-4804-be8c-ad15ece896c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:20.035614 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802a999-0638-4804-be8c-ad15ece896c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:20.035900 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802a999-0638-4804-be8c-ad15ece896c1 admin admin] PATH_INFO: `/v3/projects/e59e61ebbad044239b68e5ebe0a53edd/users/ac6a1eacf4c44dc581e4dd466eefb5a3/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:20.037997 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802a999-0638-4804-be8c-ad15ece896c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e59e61ebbad044239b68e5ebe0a53edd, user_id=ac6a1eacf4c44dc581e4dd466eefb5a3, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:20.040677 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802a999-0638-4804-be8c-ad15ece896c1 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:20.050805 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1018/2031] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:47:20 2022] PUT /identity/v3/projects/e59e61ebbad044239b68e5ebe0a53edd/users/ac6a1eacf4c44dc581e4dd466eefb5a3/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:20.061085 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdf545-7fbb-4298-96ae-c3037eee4c50 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:20.061367 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdf545-7fbb-4298-96ae-c3037eee4c50 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:20.061640 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdf545-7fbb-4298-96ae-c3037eee4c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:20.089571 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:20.092796 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-70fdf545-7fbb-4298-96ae-c3037eee4c50 None None] MFA Rules not processed for user `ac6a1eacf4c44dc581e4dd466eefb5a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:20.094295 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-70fdf545-7fbb-4298-96ae-c3037eee4c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:20.160310 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1014/2032] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:47:20 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:20.171609 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802a999-0638-4804-be8c-ad15ece896c1 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:20.173315 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b802a999-0638-4804-be8c-ad15ece896c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:20.229800 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802a999-0638-4804-be8c-ad15ece896c1 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:20.233389 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef383c51-f6d5-49d6-8e68-1178e3750b76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:20.233982 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef383c51-f6d5-49d6-8e68-1178e3750b76 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:20.234258 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef383c51-f6d5-49d6-8e68-1178e3750b76 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:20.234527 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef383c51-f6d5-49d6-8e68-1178e3750b76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:20.243872 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef383c51-f6d5-49d6-8e68-1178e3750b76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:20.245334 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef383c51-f6d5-49d6-8e68-1178e3750b76 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:20.254628 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1019/2033] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:47:20 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:47:20.505131 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fdf545-7fbb-4298-96ae-c3037eee4c50 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:20.514776 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fdf545-7fbb-4298-96ae-c3037eee4c50 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:20.518819 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec34396-df9e-4de4-b207-2c066734caa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:20.519492 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec34396-df9e-4de4-b207-2c066734caa2 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:20.519845 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec34396-df9e-4de4-b207-2c066734caa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:20.520216 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec34396-df9e-4de4-b207-2c066734caa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:20.577537 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec34396-df9e-4de4-b207-2c066734caa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:20.578965 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec34396-df9e-4de4-b207-2c066734caa2 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:20.588033 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1015/2034] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:47:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:47:23.860357 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dcc818-3208-4411-a553-bae6fbe5dfaf None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:23.860357 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dcc818-3208-4411-a553-bae6fbe5dfaf None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:23.860357 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dcc818-3208-4411-a553-bae6fbe5dfaf None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:23.861143 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1020/2035] 10.222.0.16 () {54 vars in 921 bytes} [Wed Nov 2 07:47:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:47:23.879609 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a6668-946e-49bb-bcf7-8c9c5edbd421 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:23.880096 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a6668-946e-49bb-bcf7-8c9c5edbd421 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:23.880232 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a6668-946e-49bb-bcf7-8c9c5edbd421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:23.902721 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-003a6668-946e-49bb-bcf7-8c9c5edbd421 None None] MFA Rules not processed for user `232210eabdfd4969a348d7333c50c438`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:23.903992 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-003a6668-946e-49bb-bcf7-8c9c5edbd421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:24.002072 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1016/2036] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Nov 2 07:47:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:24.014833 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dcc818-3208-4411-a553-bae6fbe5dfaf None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:24.016516 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-84dcc818-3208-4411-a553-bae6fbe5dfaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:24.075768 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dcc818-3208-4411-a553-bae6fbe5dfaf None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:24.079523 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f987d5c-3fa1-4625-92e9-d14a629ccdf3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '475f6e94957a4ae2b1248c8035231ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:24.080278 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f987d5c-3fa1-4625-92e9-d14a629ccdf3 service glance] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:24.080442 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f987d5c-3fa1-4625-92e9-d14a629ccdf3 service glance] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:24.080714 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f987d5c-3fa1-4625-92e9-d14a629ccdf3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:24.092222 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f987d5c-3fa1-4625-92e9-d14a629ccdf3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:24.099240 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f987d5c-3fa1-4625-92e9-d14a629ccdf3 service glance] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:24.106166 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1021/2037] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:47:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:47:24.292219 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa4adb-a613-4f0c-8dfd-e3a1eb05c7b0 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:24.292541 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa4adb-a613-4f0c-8dfd-e3a1eb05c7b0 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:24.292843 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa4adb-a613-4f0c-8dfd-e3a1eb05c7b0 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:24.294209 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1017/2038] 10.222.0.16 () {54 vars in 921 bytes} [Wed Nov 2 07:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:47:24.299147 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1666b8b-0f25-41c4-91e0-88ca6c5ad373 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:24.307936 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1666b8b-0f25-41c4-91e0-88ca6c5ad373 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:24.307936 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1666b8b-0f25-41c4-91e0-88ca6c5ad373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:24.322135 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-f1666b8b-0f25-41c4-91e0-88ca6c5ad373 None None] MFA Rules not processed for user `c35fe87fc263440980ce70680748e5af`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:24.323266 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f1666b8b-0f25-41c4-91e0-88ca6c5ad373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:24.375747 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1022/2039] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Nov 2 07:47:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:24.388748 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa4adb-a613-4f0c-8dfd-e3a1eb05c7b0 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:24.390427 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c0aa4adb-a613-4f0c-8dfd-e3a1eb05c7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:24.403497 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa4adb-a613-4f0c-8dfd-e3a1eb05c7b0 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:24.406979 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374df07-27eb-43e5-b1e3-32191ec16168 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:24.407589 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374df07-27eb-43e5-b1e3-32191ec16168 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:24.407867 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374df07-27eb-43e5-b1e3-32191ec16168 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:24.408158 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374df07-27eb-43e5-b1e3-32191ec16168 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:24.415845 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2374df07-27eb-43e5-b1e3-32191ec16168 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:24.417924 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2374df07-27eb-43e5-b1e3-32191ec16168 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:24.424737 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1018/2040] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:47:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:47:27.154748 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1666b8b-0f25-41c4-91e0-88ca6c5ad373 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:27.176632 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:27.222609 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1666b8b-0f25-41c4-91e0-88ca6c5ad373 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:27.229905 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c018e29-6ceb-4faf-b514-648742267a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:27.230469 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c018e29-6ceb-4faf-b514-648742267a2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:27.230744 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c018e29-6ceb-4faf-b514-648742267a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:27.231063 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c018e29-6ceb-4faf-b514-648742267a2f admin admin] PATH_INFO: `/v3/users/6f25395bb3364ac08b32e25a5190c74e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:27.232350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c018e29-6ceb-4faf-b514-648742267a2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f25395bb3364ac08b32e25a5190c74e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:27.234912 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c018e29-6ceb-4faf-b514-648742267a2f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:27.426423 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4c018e29-6ceb-4faf-b514-648742267a2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f25395bb3364ac08b32e25a5190c74e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:27.448970 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4c018e29-6ceb-4faf-b514-648742267a2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f25395bb3364ac08b32e25a5190c74e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:27.450033 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4c018e29-6ceb-4faf-b514-648742267a2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f25395bb3364ac08b32e25a5190c74e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:27.460182 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4c018e29-6ceb-4faf-b514-648742267a2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f25395bb3364ac08b32e25a5190c74e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:27.461391 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4c018e29-6ceb-4faf-b514-648742267a2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f25395bb3364ac08b32e25a5190c74e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:27.546034 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1023/2041] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:47:27 2022] DELETE /identity/v3/users/6f25395bb3364ac08b32e25a5190c74e => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:27.550713 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d2c7a-b786-45d0-8c2c-43064c3d67a6 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:27.551237 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d2c7a-b786-45d0-8c2c-43064c3d67a6 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:27.551931 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d2c7a-b786-45d0-8c2c-43064c3d67a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:27.571343 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-f92d2c7a-b786-45d0-8c2c-43064c3d67a6 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:27.572589 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f92d2c7a-b786-45d0-8c2c-43064c3d67a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:27.581728 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:27.643193 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1019/2042] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:47:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:27.652841 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c018e29-6ceb-4faf-b514-648742267a2f admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:27.654468 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4c018e29-6ceb-4faf-b514-648742267a2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:27.714586 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c018e29-6ceb-4faf-b514-648742267a2f admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:27.719389 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee6709-961e-477b-9ed9-22fdd992c3df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:27.720467 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee6709-961e-477b-9ed9-22fdd992c3df service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:27.721096 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee6709-961e-477b-9ed9-22fdd992c3df service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:27.721096 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee6709-961e-477b-9ed9-22fdd992c3df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:27.731731 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ee6709-961e-477b-9ed9-22fdd992c3df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:27.733279 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ee6709-961e-477b-9ed9-22fdd992c3df service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:27.744301 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1024/2043] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:47:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:47:27.914170 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206b519-93ba-49aa-9006-e479fb91e5c5 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:27.914458 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206b519-93ba-49aa-9006-e479fb91e5c5 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:27.914734 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206b519-93ba-49aa-9006-e479fb91e5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:27.946347 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-f206b519-93ba-49aa-9006-e479fb91e5c5 None None] MFA Rules not processed for user `0c65f5001a224e0b92e94dc6df9f8f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:27.947587 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f206b519-93ba-49aa-9006-e479fb91e5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:28.012988 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1020/2044] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Nov 2 07:47:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:28.029144 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee6709-961e-477b-9ed9-22fdd992c3df service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:28.030730 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-25ee6709-961e-477b-9ed9-22fdd992c3df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:28.085166 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:28.118811 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee6709-961e-477b-9ed9-22fdd992c3df service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:28.125869 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05528552-bff3-4e35-9231-466c47ebd770 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d63a04c2d74c90b95a4f48c49ddb29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:28.126676 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05528552-bff3-4e35-9231-466c47ebd770 service swift] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:28.126961 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05528552-bff3-4e35-9231-466c47ebd770 service swift] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:28.127232 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05528552-bff3-4e35-9231-466c47ebd770 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:28.137555 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05528552-bff3-4e35-9231-466c47ebd770 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:28.139252 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05528552-bff3-4e35-9231-466c47ebd770 service swift] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:28.150202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1025/2045] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Nov 2 07:47:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:47:28.497005 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206b519-93ba-49aa-9006-e479fb91e5c5 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:28.497005 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f206b519-93ba-49aa-9006-e479fb91e5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:28.507382 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206b519-93ba-49aa-9006-e479fb91e5c5 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:28.512558 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79d506-0df7-4767-8a17-fabaa0806e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:28.513416 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79d506-0df7-4767-8a17-fabaa0806e25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:28.513850 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79d506-0df7-4767-8a17-fabaa0806e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:28.514277 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79d506-0df7-4767-8a17-fabaa0806e25 admin admin] PATH_INFO: `/v3/projects/818861d2c93f413da5f9baf7c4f9fe62` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:28.515572 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a79d506-0df7-4767-8a17-fabaa0806e25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=818861d2c93f413da5f9baf7c4f9fe62)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:28.537866 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a79d506-0df7-4767-8a17-fabaa0806e25 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:28.698344 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-8a79d506-0df7-4767-8a17-fabaa0806e25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '818861d2c93f413da5f9baf7c4f9fe62', 'request_id': 'req-8a79d506-0df7-4767-8a17-fabaa0806e25'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:28.706090 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-8a79d506-0df7-4767-8a17-fabaa0806e25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '818861d2c93f413da5f9baf7c4f9fe62', 'request_id': 'req-8a79d506-0df7-4767-8a17-fabaa0806e25'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:28.713925 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-8a79d506-0df7-4767-8a17-fabaa0806e25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '818861d2c93f413da5f9baf7c4f9fe62', 'request_id': 'req-8a79d506-0df7-4767-8a17-fabaa0806e25'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:28.776527 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-8a79d506-0df7-4767-8a17-fabaa0806e25 admin admin] The token cache is being invalidate because project 818861d2c93f413da5f9baf7c4f9fe62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:47:28.776839 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-8a79d506-0df7-4767-8a17-fabaa0806e25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:28.777496 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-8a79d506-0df7-4767-8a17-fabaa0806e25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:28.782297 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1021/2046] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:47:28 2022] DELETE /identity/v3/projects/818861d2c93f413da5f9baf7c4f9fe62 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:28.783497 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05528552-bff3-4e35-9231-466c47ebd770 service swift] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:28.800318 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05528552-bff3-4e35-9231-466c47ebd770 service swift] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:28.886167 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91a5c3-d9f2-4fe0-8fcc-454637feb102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:28.886927 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91a5c3-d9f2-4fe0-8fcc-454637feb102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:28.887375 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91a5c3-d9f2-4fe0-8fcc-454637feb102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:28.887828 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91a5c3-d9f2-4fe0-8fcc-454637feb102 admin admin] PATH_INFO: `/v3/users/ac6a1eacf4c44dc581e4dd466eefb5a3` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:28.889286 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91a5c3-d9f2-4fe0-8fcc-454637feb102 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac6a1eacf4c44dc581e4dd466eefb5a3)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:28.891973 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91a5c3-d9f2-4fe0-8fcc-454637feb102 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:29.119187 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ed91a5c3-d9f2-4fe0-8fcc-454637feb102 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac6a1eacf4c44dc581e4dd466eefb5a3'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:29.135295 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ed91a5c3-d9f2-4fe0-8fcc-454637feb102 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac6a1eacf4c44dc581e4dd466eefb5a3'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:29.136072 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ed91a5c3-d9f2-4fe0-8fcc-454637feb102 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac6a1eacf4c44dc581e4dd466eefb5a3'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:29.145121 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ed91a5c3-d9f2-4fe0-8fcc-454637feb102 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac6a1eacf4c44dc581e4dd466eefb5a3'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:29.146299 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ed91a5c3-d9f2-4fe0-8fcc-454637feb102 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac6a1eacf4c44dc581e4dd466eefb5a3'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:29.240286 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1026/2047] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:47:28 2022] DELETE /identity/v3/users/ac6a1eacf4c44dc581e4dd466eefb5a3 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:29.789095 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79d506-0df7-4767-8a17-fabaa0806e25 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:29.790551 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-8a79d506-0df7-4767-8a17-fabaa0806e25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:29.807458 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79d506-0df7-4767-8a17-fabaa0806e25 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:29.862556 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:29.885075 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b9391-bf56-4a7c-ab8d-0a9799eb3b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:29.889075 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b9391-bf56-4a7c-ab8d-0a9799eb3b79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:29.889439 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b9391-bf56-4a7c-ab8d-0a9799eb3b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:29.889713 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b9391-bf56-4a7c-ab8d-0a9799eb3b79 admin admin] PATH_INFO: `/v3/projects/e59e61ebbad044239b68e5ebe0a53edd` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:29.891036 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b9391-bf56-4a7c-ab8d-0a9799eb3b79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e59e61ebbad044239b68e5ebe0a53edd)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:29.893002 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b9391-bf56-4a7c-ab8d-0a9799eb3b79 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:30.039804 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-789b9391-bf56-4a7c-ab8d-0a9799eb3b79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e59e61ebbad044239b68e5ebe0a53edd', 'request_id': 'req-789b9391-bf56-4a7c-ab8d-0a9799eb3b79'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:30.047064 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-789b9391-bf56-4a7c-ab8d-0a9799eb3b79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e59e61ebbad044239b68e5ebe0a53edd', 'request_id': 'req-789b9391-bf56-4a7c-ab8d-0a9799eb3b79'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:30.054364 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-789b9391-bf56-4a7c-ab8d-0a9799eb3b79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e59e61ebbad044239b68e5ebe0a53edd', 'request_id': 'req-789b9391-bf56-4a7c-ab8d-0a9799eb3b79'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:30.140605 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-789b9391-bf56-4a7c-ab8d-0a9799eb3b79 admin admin] The token cache is being invalidate because project e59e61ebbad044239b68e5ebe0a53edd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:47:30.143962 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-789b9391-bf56-4a7c-ab8d-0a9799eb3b79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:30.143962 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-789b9391-bf56-4a7c-ab8d-0a9799eb3b79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:30.143962 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1022/2048] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:47:29 2022] DELETE /identity/v3/projects/e59e61ebbad044239b68e5ebe0a53edd => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:30.148154 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab2595-9301-48c6-a121-a36552e11e7e None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:30.149035 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab2595-9301-48c6-a121-a36552e11e7e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:30.149494 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab2595-9301-48c6-a121-a36552e11e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:30.172004 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-54ab2595-9301-48c6-a121-a36552e11e7e None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:30.174814 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-54ab2595-9301-48c6-a121-a36552e11e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:30.220114 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:30.240619 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1027/2049] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:47:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:30.244249 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20699d50-d7ca-420d-9a96-470520e91d59 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:30.244529 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20699d50-d7ca-420d-9a96-470520e91d59 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:30.244797 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20699d50-d7ca-420d-9a96-470520e91d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:30.264909 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-20699d50-d7ca-420d-9a96-470520e91d59 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:30.266120 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-20699d50-d7ca-420d-9a96-470520e91d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:30.274385 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1023/2050] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:47:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:30.278620 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab2595-9301-48c6-a121-a36552e11e7e None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:30.289294 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab2595-9301-48c6-a121-a36552e11e7e None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:30.294255 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea074e1-67f6-4b70-9fca-6be20fdd51d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:30.294807 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea074e1-67f6-4b70-9fca-6be20fdd51d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:30.295083 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea074e1-67f6-4b70-9fca-6be20fdd51d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:30.295354 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea074e1-67f6-4b70-9fca-6be20fdd51d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:30.295997 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea074e1-67f6-4b70-9fca-6be20fdd51d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:47:30.296330 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea074e1-67f6-4b70-9fca-6be20fdd51d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:30.298019 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea074e1-67f6-4b70-9fca-6be20fdd51d2 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:30.311597 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1028/2051] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:47:30.315924 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20699d50-d7ca-420d-9a96-470520e91d59 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:30.325549 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20699d50-d7ca-420d-9a96-470520e91d59 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:30.330319 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e0ed8-0536-4f65-9c3c-10c1cdd388ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:30.330912 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e0ed8-0536-4f65-9c3c-10c1cdd388ef admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:30.331187 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e0ed8-0536-4f65-9c3c-10c1cdd388ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:30.331453 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e0ed8-0536-4f65-9c3c-10c1cdd388ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:30.332111 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e0ed8-0536-4f65-9c3c-10c1cdd388ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:30.334118 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e0ed8-0536-4f65-9c3c-10c1cdd388ef admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:30.397359 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1024/2052] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:47:30 2022] POST /identity/v3/projects => generated 379 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:47:30.398560 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea074e1-67f6-4b70-9fca-6be20fdd51d2 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:30.414040 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea074e1-67f6-4b70-9fca-6be20fdd51d2 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:30.488455 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0416d1d-b3c2-483d-af28-f176b7852f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:30.489099 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0416d1d-b3c2-483d-af28-f176b7852f33 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:30.489379 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0416d1d-b3c2-483d-af28-f176b7852f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:30.489833 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0416d1d-b3c2-483d-af28-f176b7852f33 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:30.490611 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0416d1d-b3c2-483d-af28-f176b7852f33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:30.492766 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0416d1d-b3c2-483d-af28-f176b7852f33 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:30.587563 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1029/2053] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:47:30 2022] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:47:30.591780 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e0ed8-0536-4f65-9c3c-10c1cdd388ef admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:30.602466 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e0ed8-0536-4f65-9c3c-10c1cdd388ef admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:30.607768 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128bbdf-cdb6-4a96-886d-e93b3296959d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:30.608404 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128bbdf-cdb6-4a96-886d-e93b3296959d admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:30.608716 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128bbdf-cdb6-4a96-886d-e93b3296959d admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:30.609097 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128bbdf-cdb6-4a96-886d-e93b3296959d admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:30.609771 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128bbdf-cdb6-4a96-886d-e93b3296959d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:30.611421 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128bbdf-cdb6-4a96-886d-e93b3296959d admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:30.622785 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1025/2054] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:47:30.626928 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0416d1d-b3c2-483d-af28-f176b7852f33 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:30.639871 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0416d1d-b3c2-483d-af28-f176b7852f33 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:30.644888 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d0b42-d015-46c1-a1f7-02a928f592dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:30.645583 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d0b42-d015-46c1-a1f7-02a928f592dc admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:30.645943 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d0b42-d015-46c1-a1f7-02a928f592dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:30.646281 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d0b42-d015-46c1-a1f7-02a928f592dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:30.647038 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d0b42-d015-46c1-a1f7-02a928f592dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:30.648753 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d0b42-d015-46c1-a1f7-02a928f592dc admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:30.660242 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1030/2055] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:47:30.664468 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128bbdf-cdb6-4a96-886d-e93b3296959d admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:30.674540 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128bbdf-cdb6-4a96-886d-e93b3296959d admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:30.679922 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f05f0-f036-40a8-a801-3b351da91223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:30.680604 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f05f0-f036-40a8-a801-3b351da91223 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:30.680880 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f05f0-f036-40a8-a801-3b351da91223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:30.681153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f05f0-f036-40a8-a801-3b351da91223 admin admin] PATH_INFO: `/v3/projects/65b1b814cf6b4ed2b2f5cd08abc29e67/users/39bcbbdd589140deaf79550d5f345cd0/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:30.696178 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f05f0-f036-40a8-a801-3b351da91223 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65b1b814cf6b4ed2b2f5cd08abc29e67, user_id=39bcbbdd589140deaf79550d5f345cd0, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:30.698865 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f05f0-f036-40a8-a801-3b351da91223 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:30.804352 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1026/2056] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:47:30 2022] PUT /identity/v3/projects/65b1b814cf6b4ed2b2f5cd08abc29e67/users/39bcbbdd589140deaf79550d5f345cd0/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:30.815410 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1bfa6-5d4d-4177-84ad-5a8f05521755 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:30.815745 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1bfa6-5d4d-4177-84ad-5a8f05521755 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:30.815989 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1bfa6-5d4d-4177-84ad-5a8f05521755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:30.845402 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-cac1bfa6-5d4d-4177-84ad-5a8f05521755 None None] MFA Rules not processed for user `39bcbbdd589140deaf79550d5f345cd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:30.846528 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-cac1bfa6-5d4d-4177-84ad-5a8f05521755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:30.910478 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1031/2057] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:47:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:30.915187 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f05f0-f036-40a8-a801-3b351da91223 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:30.977657 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f05f0-f036-40a8-a801-3b351da91223 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:30.982447 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae58c9b-bbfe-4cf2-8939-1655f38f23fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:30.983038 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae58c9b-bbfe-4cf2-8939-1655f38f23fa admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:30.983313 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae58c9b-bbfe-4cf2-8939-1655f38f23fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:30.983581 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae58c9b-bbfe-4cf2-8939-1655f38f23fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:30.984256 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae58c9b-bbfe-4cf2-8939-1655f38f23fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:30.986140 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae58c9b-bbfe-4cf2-8939-1655f38f23fa admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:31.001388 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:31.107169 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1027/2058] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:47:30 2022] POST /identity/v3/projects => generated 379 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:47:31.108331 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1bfa6-5d4d-4177-84ad-5a8f05521755 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:31.122157 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1bfa6-5d4d-4177-84ad-5a8f05521755 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:31.222719 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:31.236677 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7362c-98d6-4a62-8c7c-b76ba0358a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:31.237902 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7362c-98d6-4a62-8c7c-b76ba0358a62 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:31.238181 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7362c-98d6-4a62-8c7c-b76ba0358a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:31.238446 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7362c-98d6-4a62-8c7c-b76ba0358a62 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:31.239158 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e7362c-98d6-4a62-8c7c-b76ba0358a62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:31.241471 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e7362c-98d6-4a62-8c7c-b76ba0358a62 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:31.315732 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1032/2059] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:47:31 2022] POST /identity/v3/users => generated 296 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:47:31.321304 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae58c9b-bbfe-4cf2-8939-1655f38f23fa admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:31.333662 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae58c9b-bbfe-4cf2-8939-1655f38f23fa admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:31.339375 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163add8f-744d-42d3-9b4a-5b7553e82238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:31.340837 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163add8f-744d-42d3-9b4a-5b7553e82238 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:31.341215 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163add8f-744d-42d3-9b4a-5b7553e82238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:31.341596 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163add8f-744d-42d3-9b4a-5b7553e82238 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:31.342297 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163add8f-744d-42d3-9b4a-5b7553e82238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:31.344042 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163add8f-744d-42d3-9b4a-5b7553e82238 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:31.357322 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1028/2060] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:47:31.361820 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7362c-98d6-4a62-8c7c-b76ba0358a62 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:31.373122 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7362c-98d6-4a62-8c7c-b76ba0358a62 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:31.377987 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bbf134-7f1f-4582-9edb-872b67ca6bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:31.378639 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bbf134-7f1f-4582-9edb-872b67ca6bab admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:31.378917 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bbf134-7f1f-4582-9edb-872b67ca6bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:31.379186 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bbf134-7f1f-4582-9edb-872b67ca6bab admin admin] PATH_INFO: `/v3/projects/88f944f971ca4437b15ebdb5a1be5328/users/75fd1c0b41f34536829b028c82f3265b/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:31.397140 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bbf134-7f1f-4582-9edb-872b67ca6bab admin admin] RBAC: Authorizing `identity:create_grant(project_id=88f944f971ca4437b15ebdb5a1be5328, user_id=75fd1c0b41f34536829b028c82f3265b, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:31.399873 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bbf134-7f1f-4582-9edb-872b67ca6bab admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:31.489435 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1033/2061] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:47:31 2022] PUT /identity/v3/projects/88f944f971ca4437b15ebdb5a1be5328/users/75fd1c0b41f34536829b028c82f3265b/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:47:31.493905 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163add8f-744d-42d3-9b4a-5b7553e82238 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:31.504586 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163add8f-744d-42d3-9b4a-5b7553e82238 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:31.559490 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9352038-bbaa-4ba8-8778-abace62af3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:31.560112 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9352038-bbaa-4ba8-8778-abace62af3cd admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:31.560391 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9352038-bbaa-4ba8-8778-abace62af3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:31.560660 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9352038-bbaa-4ba8-8778-abace62af3cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:31.561286 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9352038-bbaa-4ba8-8778-abace62af3cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:31.562890 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9352038-bbaa-4ba8-8778-abace62af3cd admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:31.572930 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1029/2062] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:47:31.577081 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bbf134-7f1f-4582-9edb-872b67ca6bab admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:31.587341 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bbf134-7f1f-4582-9edb-872b67ca6bab admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:31.591852 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e8320-0802-496b-9842-be7c7f310e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:31.592528 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e8320-0802-496b-9842-be7c7f310e36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:31.592803 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e8320-0802-496b-9842-be7c7f310e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:31.593069 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e8320-0802-496b-9842-be7c7f310e36 admin admin] PATH_INFO: `/v3/projects/88f944f971ca4437b15ebdb5a1be5328/users/75fd1c0b41f34536829b028c82f3265b/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:31.594981 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e8320-0802-496b-9842-be7c7f310e36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88f944f971ca4437b15ebdb5a1be5328, user_id=75fd1c0b41f34536829b028c82f3265b, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:31.597640 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e8320-0802-496b-9842-be7c7f310e36 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:31.607796 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1034/2063] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:47:31 2022] PUT /identity/v3/projects/88f944f971ca4437b15ebdb5a1be5328/users/75fd1c0b41f34536829b028c82f3265b/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:31.618316 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21993202-d08c-4016-bafd-8374bbd2aa29 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:31.618602 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21993202-d08c-4016-bafd-8374bbd2aa29 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:31.618877 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21993202-d08c-4016-bafd-8374bbd2aa29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:31.647847 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-21993202-d08c-4016-bafd-8374bbd2aa29 None None] MFA Rules not processed for user `75fd1c0b41f34536829b028c82f3265b`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:31.650409 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-21993202-d08c-4016-bafd-8374bbd2aa29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:31.740493 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1030/2064] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:47:31 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:31.752031 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e8320-0802-496b-9842-be7c7f310e36 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:31.753958 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d43e8320-0802-496b-9842-be7c7f310e36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:31.831082 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e8320-0802-496b-9842-be7c7f310e36 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:31.836386 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43520816-217a-48e8-8cc0-6614395ad2c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:31.837237 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43520816-217a-48e8-8cc0-6614395ad2c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:31.837804 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43520816-217a-48e8-8cc0-6614395ad2c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:31.838223 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43520816-217a-48e8-8cc0-6614395ad2c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:31.848781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43520816-217a-48e8-8cc0-6614395ad2c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:31.851228 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43520816-217a-48e8-8cc0-6614395ad2c7 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:31.862676 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1035/2065] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:47:31 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:47:32.511438 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21993202-d08c-4016-bafd-8374bbd2aa29 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:32.597201 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21993202-d08c-4016-bafd-8374bbd2aa29 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:32.602456 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f219fe2a-2434-4f0d-9a20-3f4e83b0a64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:32.603115 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219fe2a-2434-4f0d-9a20-3f4e83b0a64a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:32.603394 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219fe2a-2434-4f0d-9a20-3f4e83b0a64a admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:32.603667 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219fe2a-2434-4f0d-9a20-3f4e83b0a64a admin admin] PATH_INFO: `/v3/users/39bcbbdd589140deaf79550d5f345cd0` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:32.604851 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f219fe2a-2434-4f0d-9a20-3f4e83b0a64a admin admin] RBAC: Authorizing `identity:delete_user(user_id=39bcbbdd589140deaf79550d5f345cd0)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:32.606729 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f219fe2a-2434-4f0d-9a20-3f4e83b0a64a admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:32.612448 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:32.791476 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f219fe2a-2434-4f0d-9a20-3f4e83b0a64a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39bcbbdd589140deaf79550d5f345cd0'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:32.812599 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f219fe2a-2434-4f0d-9a20-3f4e83b0a64a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39bcbbdd589140deaf79550d5f345cd0'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:32.823723 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f219fe2a-2434-4f0d-9a20-3f4e83b0a64a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39bcbbdd589140deaf79550d5f345cd0'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:32.824902 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f219fe2a-2434-4f0d-9a20-3f4e83b0a64a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39bcbbdd589140deaf79550d5f345cd0'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:32.825681 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f219fe2a-2434-4f0d-9a20-3f4e83b0a64a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39bcbbdd589140deaf79550d5f345cd0'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:32.895217 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1031/2066] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:47:32 2022] DELETE /identity/v3/users/39bcbbdd589140deaf79550d5f345cd0 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:32.903155 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616cd27-cf08-43e8-a792-e108adcee7d4 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:32.903630 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616cd27-cf08-43e8-a792-e108adcee7d4 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:32.903756 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616cd27-cf08-43e8-a792-e108adcee7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:32.925592 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-7616cd27-cf08-43e8-a792-e108adcee7d4 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:32.927770 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7616cd27-cf08-43e8-a792-e108adcee7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:32.991331 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1036/2067] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:33.001101 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f219fe2a-2434-4f0d-9a20-3f4e83b0a64a admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:33.002475 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f219fe2a-2434-4f0d-9a20-3f4e83b0a64a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:33.079557 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f219fe2a-2434-4f0d-9a20-3f4e83b0a64a admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:33.084236 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70d737-64cd-446c-a9b3-10415b004f6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:33.085086 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70d737-64cd-446c-a9b3-10415b004f6c service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:33.085553 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70d737-64cd-446c-a9b3-10415b004f6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:33.085831 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70d737-64cd-446c-a9b3-10415b004f6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:33.096039 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70d737-64cd-446c-a9b3-10415b004f6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:33.097546 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70d737-64cd-446c-a9b3-10415b004f6c service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:33.109059 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1032/2068] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:47:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:47:33.565430 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616cd27-cf08-43e8-a792-e108adcee7d4 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:33.566965 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7616cd27-cf08-43e8-a792-e108adcee7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:33.580585 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616cd27-cf08-43e8-a792-e108adcee7d4 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:33.585920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a7c15-5e03-4199-a56c-18b2fc3ed26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:33.586582 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a7c15-5e03-4199-a56c-18b2fc3ed26a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:33.586871 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a7c15-5e03-4199-a56c-18b2fc3ed26a admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:33.587142 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a7c15-5e03-4199-a56c-18b2fc3ed26a admin admin] PATH_INFO: `/v3/projects/65b1b814cf6b4ed2b2f5cd08abc29e67` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:33.588583 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a7c15-5e03-4199-a56c-18b2fc3ed26a admin admin] RBAC: Authorizing `identity:delete_project(project_id=65b1b814cf6b4ed2b2f5cd08abc29e67)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:33.590730 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a7c15-5e03-4199-a56c-18b2fc3ed26a admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:33.761580 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:33.770108 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-9f1a7c15-5e03-4199-a56c-18b2fc3ed26a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65b1b814cf6b4ed2b2f5cd08abc29e67', 'request_id': 'req-9f1a7c15-5e03-4199-a56c-18b2fc3ed26a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:33.775566 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-9f1a7c15-5e03-4199-a56c-18b2fc3ed26a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65b1b814cf6b4ed2b2f5cd08abc29e67', 'request_id': 'req-9f1a7c15-5e03-4199-a56c-18b2fc3ed26a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:33.781804 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-9f1a7c15-5e03-4199-a56c-18b2fc3ed26a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65b1b814cf6b4ed2b2f5cd08abc29e67', 'request_id': 'req-9f1a7c15-5e03-4199-a56c-18b2fc3ed26a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:33.866409 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-9f1a7c15-5e03-4199-a56c-18b2fc3ed26a admin admin] The token cache is being invalidate because project 65b1b814cf6b4ed2b2f5cd08abc29e67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:47:33.866609 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-9f1a7c15-5e03-4199-a56c-18b2fc3ed26a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:33.867293 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-9f1a7c15-5e03-4199-a56c-18b2fc3ed26a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:33.869417 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1037/2069] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:47:33 2022] DELETE /identity/v3/projects/65b1b814cf6b4ed2b2f5cd08abc29e67 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:33.873500 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70d737-64cd-446c-a9b3-10415b004f6c service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:33.884458 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70d737-64cd-446c-a9b3-10415b004f6c service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:34.002597 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ef7c4-4a02-4b0b-8055-54589031db78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:34.003506 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ef7c4-4a02-4b0b-8055-54589031db78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:34.003939 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ef7c4-4a02-4b0b-8055-54589031db78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:34.004386 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ef7c4-4a02-4b0b-8055-54589031db78 admin admin] PATH_INFO: `/v3/users/75fd1c0b41f34536829b028c82f3265b` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:34.006263 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ef7c4-4a02-4b0b-8055-54589031db78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75fd1c0b41f34536829b028c82f3265b)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:34.008418 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ef7c4-4a02-4b0b-8055-54589031db78 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:34.164419 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:34.178625 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-078ef7c4-4a02-4b0b-8055-54589031db78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75fd1c0b41f34536829b028c82f3265b'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:34.190183 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-078ef7c4-4a02-4b0b-8055-54589031db78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75fd1c0b41f34536829b028c82f3265b'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:34.197082 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-078ef7c4-4a02-4b0b-8055-54589031db78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75fd1c0b41f34536829b028c82f3265b'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:34.197962 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-078ef7c4-4a02-4b0b-8055-54589031db78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75fd1c0b41f34536829b028c82f3265b'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:34.198618 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-078ef7c4-4a02-4b0b-8055-54589031db78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75fd1c0b41f34536829b028c82f3265b'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:34.266251 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1033/2070] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:47:33 2022] DELETE /identity/v3/users/75fd1c0b41f34536829b028c82f3265b => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:34.674851 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a7c15-5e03-4199-a56c-18b2fc3ed26a admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:34.676396 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9f1a7c15-5e03-4199-a56c-18b2fc3ed26a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:34.707751 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a7c15-5e03-4199-a56c-18b2fc3ed26a admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:34.792740 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b772db-b404-459e-96e8-b73a3c5c5821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:34.793395 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b772db-b404-459e-96e8-b73a3c5c5821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:34.793676 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b772db-b404-459e-96e8-b73a3c5c5821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:34.793947 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b772db-b404-459e-96e8-b73a3c5c5821 admin admin] PATH_INFO: `/v3/projects/88f944f971ca4437b15ebdb5a1be5328` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:34.796903 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b772db-b404-459e-96e8-b73a3c5c5821 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88f944f971ca4437b15ebdb5a1be5328)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:34.799901 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b772db-b404-459e-96e8-b73a3c5c5821 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:34.962180 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-23b772db-b404-459e-96e8-b73a3c5c5821 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88f944f971ca4437b15ebdb5a1be5328', 'request_id': 'req-23b772db-b404-459e-96e8-b73a3c5c5821'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:34.973608 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-23b772db-b404-459e-96e8-b73a3c5c5821 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88f944f971ca4437b15ebdb5a1be5328', 'request_id': 'req-23b772db-b404-459e-96e8-b73a3c5c5821'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:34.981516 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-23b772db-b404-459e-96e8-b73a3c5c5821 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88f944f971ca4437b15ebdb5a1be5328', 'request_id': 'req-23b772db-b404-459e-96e8-b73a3c5c5821'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:35.067094 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-23b772db-b404-459e-96e8-b73a3c5c5821 admin admin] The token cache is being invalidate because project 88f944f971ca4437b15ebdb5a1be5328 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:47:35.068599 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-23b772db-b404-459e-96e8-b73a3c5c5821 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:35.069774 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-23b772db-b404-459e-96e8-b73a3c5c5821 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:35.078174 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1038/2071] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:47:34 2022] DELETE /identity/v3/projects/88f944f971ca4437b15ebdb5a1be5328 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:35.079573 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad5581-43f1-4a9a-9d13-e4cf0d0ac4af None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:35.080224 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad5581-43f1-4a9a-9d13-e4cf0d0ac4af None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:35.080224 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad5581-43f1-4a9a-9d13-e4cf0d0ac4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:35.103544 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-0aad5581-43f1-4a9a-9d13-e4cf0d0ac4af None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:35.105103 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-0aad5581-43f1-4a9a-9d13-e4cf0d0ac4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:35.200591 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1034/2072] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:47:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:35.268480 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26063479-50c3-4fde-8984-634422e9e499 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:35.268758 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26063479-50c3-4fde-8984-634422e9e499 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:35.269027 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26063479-50c3-4fde-8984-634422e9e499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:35.289716 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-26063479-50c3-4fde-8984-634422e9e499 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:35.291135 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-26063479-50c3-4fde-8984-634422e9e499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:35.300250 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1039/2073] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:47:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:35.305971 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad5581-43f1-4a9a-9d13-e4cf0d0ac4af None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:35.318341 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad5581-43f1-4a9a-9d13-e4cf0d0ac4af None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:35.323108 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d816a-0507-47ca-815c-7cbb3cd19bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:35.323709 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d816a-0507-47ca-815c-7cbb3cd19bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:35.323983 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d816a-0507-47ca-815c-7cbb3cd19bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:35.324358 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d816a-0507-47ca-815c-7cbb3cd19bc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:35.324994 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76d816a-0507-47ca-815c-7cbb3cd19bc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:47:35.325293 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76d816a-0507-47ca-815c-7cbb3cd19bc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:35.326904 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76d816a-0507-47ca-815c-7cbb3cd19bc6 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:35.338462 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1035/2074] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:47:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:47:35.342874 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26063479-50c3-4fde-8984-634422e9e499 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:35.352064 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26063479-50c3-4fde-8984-634422e9e499 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:35.356787 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afde2d4-f1d0-4011-8de3-3dec20549e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:35.357378 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afde2d4-f1d0-4011-8de3-3dec20549e6e admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:35.357649 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afde2d4-f1d0-4011-8de3-3dec20549e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:35.357916 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afde2d4-f1d0-4011-8de3-3dec20549e6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:35.358531 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afde2d4-f1d0-4011-8de3-3dec20549e6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:35.360542 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afde2d4-f1d0-4011-8de3-3dec20549e6e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:35.488811 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1040/2075] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:47:35 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:47:35.489242 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d816a-0507-47ca-815c-7cbb3cd19bc6 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:35.489242 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d816a-0507-47ca-815c-7cbb3cd19bc6 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:35.547488 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1683ef-ba66-4966-8f45-3f9ebd938622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:35.548365 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1683ef-ba66-4966-8f45-3f9ebd938622 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:35.548724 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1683ef-ba66-4966-8f45-3f9ebd938622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:35.549092 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1683ef-ba66-4966-8f45-3f9ebd938622 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:35.549836 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1683ef-ba66-4966-8f45-3f9ebd938622 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:35.552684 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1683ef-ba66-4966-8f45-3f9ebd938622 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:35.859552 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afde2d4-f1d0-4011-8de3-3dec20549e6e admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:35.861247 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6afde2d4-f1d0-4011-8de3-3dec20549e6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:35.902274 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:35.929309 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1036/2076] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:47:35 2022] POST /identity/v3/users => generated 286 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:47:35.934600 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1683ef-ba66-4966-8f45-3f9ebd938622 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:35.965029 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1683ef-ba66-4966-8f45-3f9ebd938622 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:35.972823 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f390a-7b89-42b0-b97a-bb9f05194a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:35.974886 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f390a-7b89-42b0-b97a-bb9f05194a1c admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:35.975423 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f390a-7b89-42b0-b97a-bb9f05194a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:35.975941 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f390a-7b89-42b0-b97a-bb9f05194a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:35.976650 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f390a-7b89-42b0-b97a-bb9f05194a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:35.978256 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f390a-7b89-42b0-b97a-bb9f05194a1c admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:35.980018 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afde2d4-f1d0-4011-8de3-3dec20549e6e admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:35.994183 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81099fde-e515-471e-a337-65aeba96c124 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:35.995650 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81099fde-e515-471e-a337-65aeba96c124 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:35.996044 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81099fde-e515-471e-a337-65aeba96c124 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:35.996663 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81099fde-e515-471e-a337-65aeba96c124 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:36.005783 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-81099fde-e515-471e-a337-65aeba96c124 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:36.007726 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1037/2077] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:47:36.011882 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f390a-7b89-42b0-b97a-bb9f05194a1c admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:36.030200 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f390a-7b89-42b0-b97a-bb9f05194a1c admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:36.035425 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d655f5-f145-469a-a131-084281f29191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:36.036082 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d655f5-f145-469a-a131-084281f29191 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:36.036963 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d655f5-f145-469a-a131-084281f29191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:36.037240 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d655f5-f145-469a-a131-084281f29191 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:36.037881 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d655f5-f145-469a-a131-084281f29191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:36.039482 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d655f5-f145-469a-a131-084281f29191 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:36.066347 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1038/2078] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:47:36.067261 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d655f5-f145-469a-a131-084281f29191 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:36.074643 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:36.078996 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d655f5-f145-469a-a131-084281f29191 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:36.084581 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26baaa37-3820-41a0-83ba-ca5abb1cebdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:36.093415 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26baaa37-3820-41a0-83ba-ca5abb1cebdd admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:36.093415 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26baaa37-3820-41a0-83ba-ca5abb1cebdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:36.093415 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26baaa37-3820-41a0-83ba-ca5abb1cebdd admin admin] PATH_INFO: `/v3/projects/801a8babb39d4219a1da0be37d312647/users/99713092d1a5425f97daff99a616f1b2/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:36.106856 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81099fde-e515-471e-a337-65aeba96c124 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:36.110597 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81099fde-e515-471e-a337-65aeba96c124 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:36.113492 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26baaa37-3820-41a0-83ba-ca5abb1cebdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=801a8babb39d4219a1da0be37d312647, user_id=99713092d1a5425f97daff99a616f1b2, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:36.127647 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26baaa37-3820-41a0-83ba-ca5abb1cebdd admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:36.127826 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1041/2079] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:47:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:47:36.217844 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1039/2080] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:47:36 2022] PUT /identity/v3/projects/801a8babb39d4219a1da0be37d312647/users/99713092d1a5425f97daff99a616f1b2/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:36.246561 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa5848-5aa5-40d6-b9e5-968b0aed67da None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:36.246884 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa5848-5aa5-40d6-b9e5-968b0aed67da None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:36.247118 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa5848-5aa5-40d6-b9e5-968b0aed67da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:36.289890 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-52aa5848-5aa5-40d6-b9e5-968b0aed67da None None] MFA Rules not processed for user `99713092d1a5425f97daff99a616f1b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:36.291112 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-52aa5848-5aa5-40d6-b9e5-968b0aed67da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:36.377339 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1042/2081] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:47:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:36.394125 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26baaa37-3820-41a0-83ba-ca5abb1cebdd admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:36.398433 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-26baaa37-3820-41a0-83ba-ca5abb1cebdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:36.491133 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26baaa37-3820-41a0-83ba-ca5abb1cebdd admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:36.497911 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5e8c4-accc-4f29-9f5d-4288f86dc754 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '475f6e94957a4ae2b1248c8035231ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:36.498662 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5e8c4-accc-4f29-9f5d-4288f86dc754 service glance] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:36.499028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5e8c4-accc-4f29-9f5d-4288f86dc754 service glance] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:36.499340 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5e8c4-accc-4f29-9f5d-4288f86dc754 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:36.511188 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada5e8c4-accc-4f29-9f5d-4288f86dc754 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:36.512855 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada5e8c4-accc-4f29-9f5d-4288f86dc754 service glance] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:36.524751 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1040/2082] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:47:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:47:46.217250 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce419693-5d55-452a-9b42-37e0dea2976f None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:46.217739 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce419693-5d55-452a-9b42-37e0dea2976f None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:46.217893 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce419693-5d55-452a-9b42-37e0dea2976f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:46.237303 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-ce419693-5d55-452a-9b42-37e0dea2976f None None] MFA Rules not processed for user `0c65f5001a224e0b92e94dc6df9f8f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:46.238491 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ce419693-5d55-452a-9b42-37e0dea2976f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:46.289650 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:46.299510 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1043/2083] 10.222.0.16 () {58 vars in 967 bytes} [Wed Nov 2 07:47:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:46.322097 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5e8c4-accc-4f29-9f5d-4288f86dc754 service glance] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:46.323554 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-ada5e8c4-accc-4f29-9f5d-4288f86dc754 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:46.391727 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5e8c4-accc-4f29-9f5d-4288f86dc754 service glance] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:46.396934 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88f6f9-ee68-45cc-8eaf-1b3259be79ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d63a04c2d74c90b95a4f48c49ddb29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:46.397531 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88f6f9-ee68-45cc-8eaf-1b3259be79ed service swift] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:46.397807 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88f6f9-ee68-45cc-8eaf-1b3259be79ed service swift] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:46.398077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88f6f9-ee68-45cc-8eaf-1b3259be79ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:46.405942 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed88f6f9-ee68-45cc-8eaf-1b3259be79ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:46.407491 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed88f6f9-ee68-45cc-8eaf-1b3259be79ed service swift] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:46.415641 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1041/2084] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Nov 2 07:47:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:47:52.091741 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce419693-5d55-452a-9b42-37e0dea2976f None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:52.093303 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ce419693-5d55-452a-9b42-37e0dea2976f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:52.149682 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce419693-5d55-452a-9b42-37e0dea2976f None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:52.153231 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc07904-f94c-4e90-81b2-c1e672bd8a60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:52.153829 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc07904-f94c-4e90-81b2-c1e672bd8a60 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:52.154128 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc07904-f94c-4e90-81b2-c1e672bd8a60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:52.154396 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc07904-f94c-4e90-81b2-c1e672bd8a60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:52.156112 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3cc07904-f94c-4e90-81b2-c1e672bd8a60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:52.218320 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc07904-f94c-4e90-81b2-c1e672bd8a60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:52.219655 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc07904-f94c-4e90-81b2-c1e672bd8a60 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:52.229237 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1044/2085] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:47:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:47:56.259583 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88f6f9-ee68-45cc-8eaf-1b3259be79ed service swift] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:56.261073 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-ed88f6f9-ee68-45cc-8eaf-1b3259be79ed service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:56.342823 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88f6f9-ee68-45cc-8eaf-1b3259be79ed service swift] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:56.349729 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b0f292-0e72-4579-93f5-aab2b136b491 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '741c9fc71c80438faa037c85f4997c3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:56.350351 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0f292-0e72-4579-93f5-aab2b136b491 service placement] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:56.350634 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0f292-0e72-4579-93f5-aab2b136b491 service placement] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:56.350904 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0f292-0e72-4579-93f5-aab2b136b491 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:56.352763 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-83b0f292-0e72-4579-93f5-aab2b136b491 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:56.373464 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b0f292-0e72-4579-93f5-aab2b136b491 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:56.373464 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b0f292-0e72-4579-93f5-aab2b136b491 service placement] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:56.376266 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc07904-f94c-4e90-81b2-c1e672bd8a60 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:56.378494 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3cc07904-f94c-4e90-81b2-c1e672bd8a60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:56.378615 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:56.396026 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1042/2086] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:47:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:47:56.402669 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc07904-f94c-4e90-81b2-c1e672bd8a60 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:56.408676 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140ecef-7e4a-4a5c-9ec2-bf40314fc348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:56.409605 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140ecef-7e4a-4a5c-9ec2-bf40314fc348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:56.410435 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140ecef-7e4a-4a5c-9ec2-bf40314fc348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:56.411465 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140ecef-7e4a-4a5c-9ec2-bf40314fc348 admin admin] PATH_INFO: `/v3/users/047b50cfb513438dbda9cdd89b578062` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:56.412670 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2140ecef-7e4a-4a5c-9ec2-bf40314fc348 admin admin] RBAC: Authorizing `identity:delete_user(user_id=047b50cfb513438dbda9cdd89b578062)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:56.414610 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2140ecef-7e4a-4a5c-9ec2-bf40314fc348 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:56.605078 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-2140ecef-7e4a-4a5c-9ec2-bf40314fc348 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '047b50cfb513438dbda9cdd89b578062'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:56.617574 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-2140ecef-7e4a-4a5c-9ec2-bf40314fc348 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '047b50cfb513438dbda9cdd89b578062'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:56.618284 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-2140ecef-7e4a-4a5c-9ec2-bf40314fc348 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '047b50cfb513438dbda9cdd89b578062'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:56.625271 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-2140ecef-7e4a-4a5c-9ec2-bf40314fc348 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '047b50cfb513438dbda9cdd89b578062'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:56.628570 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-2140ecef-7e4a-4a5c-9ec2-bf40314fc348 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '047b50cfb513438dbda9cdd89b578062'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:56.712371 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1045/2087] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:47:56 2022] DELETE /identity/v3/users/047b50cfb513438dbda9cdd89b578062 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:56.958418 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b0f292-0e72-4579-93f5-aab2b136b491 service placement] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:56.969647 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b0f292-0e72-4579-93f5-aab2b136b491 service placement] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:57.031221 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89481cb0-4551-4b3a-94c1-b0dc07ad75b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:57.031850 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89481cb0-4551-4b3a-94c1-b0dc07ad75b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:57.032159 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89481cb0-4551-4b3a-94c1-b0dc07ad75b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:57.032432 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89481cb0-4551-4b3a-94c1-b0dc07ad75b7 admin admin] PATH_INFO: `/v3/projects/bf440de5324c4cba8328e0368e874bb2` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:57.033538 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89481cb0-4551-4b3a-94c1-b0dc07ad75b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf440de5324c4cba8328e0368e874bb2)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:57.035701 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89481cb0-4551-4b3a-94c1-b0dc07ad75b7 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:57.147481 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-89481cb0-4551-4b3a-94c1-b0dc07ad75b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf440de5324c4cba8328e0368e874bb2', 'request_id': 'req-89481cb0-4551-4b3a-94c1-b0dc07ad75b7'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:57.153832 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-89481cb0-4551-4b3a-94c1-b0dc07ad75b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf440de5324c4cba8328e0368e874bb2', 'request_id': 'req-89481cb0-4551-4b3a-94c1-b0dc07ad75b7'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:57.159568 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-89481cb0-4551-4b3a-94c1-b0dc07ad75b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf440de5324c4cba8328e0368e874bb2', 'request_id': 'req-89481cb0-4551-4b3a-94c1-b0dc07ad75b7'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:57.255711 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-89481cb0-4551-4b3a-94c1-b0dc07ad75b7 admin admin] The token cache is being invalidate because project bf440de5324c4cba8328e0368e874bb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:47:57.256005 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-89481cb0-4551-4b3a-94c1-b0dc07ad75b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:57.257539 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-89481cb0-4551-4b3a-94c1-b0dc07ad75b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:57.265958 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1043/2088] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:47:56 2022] DELETE /identity/v3/projects/bf440de5324c4cba8328e0368e874bb2 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:57.269472 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc96e95-9765-4d2e-9c8e-f3711322f0d6 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:57.269762 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc96e95-9765-4d2e-9c8e-f3711322f0d6 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:57.270992 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc96e95-9765-4d2e-9c8e-f3711322f0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:57.291313 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-9fc96e95-9765-4d2e-9c8e-f3711322f0d6 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:57.294548 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9fc96e95-9765-4d2e-9c8e-f3711322f0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:57.306193 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:57.354179 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1046/2089] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:47:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:57.362146 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab32bad-c51d-473b-a1b2-794155a47ff7 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:57.363512 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab32bad-c51d-473b-a1b2-794155a47ff7 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:57.363512 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab32bad-c51d-473b-a1b2-794155a47ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:57.385921 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-6ab32bad-c51d-473b-a1b2-794155a47ff7 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:57.387393 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-6ab32bad-c51d-473b-a1b2-794155a47ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:57.399931 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1044/2090] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:47:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:47:57.406623 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc96e95-9765-4d2e-9c8e-f3711322f0d6 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:57.415574 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc96e95-9765-4d2e-9c8e-f3711322f0d6 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:57.420607 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005535d3-2a63-480f-aa6c-8c2ede19d613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:57.421228 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005535d3-2a63-480f-aa6c-8c2ede19d613 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:57.421661 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005535d3-2a63-480f-aa6c-8c2ede19d613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:57.422111 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005535d3-2a63-480f-aa6c-8c2ede19d613 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:57.422732 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005535d3-2a63-480f-aa6c-8c2ede19d613 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:47:57.423029 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005535d3-2a63-480f-aa6c-8c2ede19d613 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:57.424683 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005535d3-2a63-480f-aa6c-8c2ede19d613 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:57.440209 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1047/2091] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:47:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:47:57.441437 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab32bad-c51d-473b-a1b2-794155a47ff7 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:57.451010 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab32bad-c51d-473b-a1b2-794155a47ff7 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:57.455725 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332fed97-2fb2-4d4b-aae6-3dfb5a3436ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:57.456385 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fed97-2fb2-4d4b-aae6-3dfb5a3436ac admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:57.456662 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fed97-2fb2-4d4b-aae6-3dfb5a3436ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:57.456933 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fed97-2fb2-4d4b-aae6-3dfb5a3436ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:57.457609 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332fed97-2fb2-4d4b-aae6-3dfb5a3436ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:57.459491 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332fed97-2fb2-4d4b-aae6-3dfb5a3436ac admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:57.566328 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1045/2092] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:47:57 2022] POST /identity/v3/projects => generated 367 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:47:57.570150 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005535d3-2a63-480f-aa6c-8c2ede19d613 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:57.583391 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005535d3-2a63-480f-aa6c-8c2ede19d613 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:57.656873 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48ab9d-e1a3-4c3b-a712-bcdd113e0259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:57.657447 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48ab9d-e1a3-4c3b-a712-bcdd113e0259 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:57.657727 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48ab9d-e1a3-4c3b-a712-bcdd113e0259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:57.658003 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48ab9d-e1a3-4c3b-a712-bcdd113e0259 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:57.658641 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa48ab9d-e1a3-4c3b-a712-bcdd113e0259 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:57.661480 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa48ab9d-e1a3-4c3b-a712-bcdd113e0259 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:57.735231 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1048/2093] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:47:57 2022] POST /identity/v3/users => generated 284 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:47:57.739037 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332fed97-2fb2-4d4b-aae6-3dfb5a3436ac admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:57.749845 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332fed97-2fb2-4d4b-aae6-3dfb5a3436ac admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:57.754606 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd288e1-b0e2-4a8f-b96f-8afe9e165003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:57.756361 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd288e1-b0e2-4a8f-b96f-8afe9e165003 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:57.756361 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd288e1-b0e2-4a8f-b96f-8afe9e165003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:57.756361 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd288e1-b0e2-4a8f-b96f-8afe9e165003 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:57.756634 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd288e1-b0e2-4a8f-b96f-8afe9e165003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:57.757982 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd288e1-b0e2-4a8f-b96f-8afe9e165003 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:57.768614 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1046/2094] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:47:57.773206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48ab9d-e1a3-4c3b-a712-bcdd113e0259 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:57.783720 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48ab9d-e1a3-4c3b-a712-bcdd113e0259 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:57.790130 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d454c6-5e43-4053-9e63-164884a84dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:57.790736 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d454c6-5e43-4053-9e63-164884a84dbe admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:57.791114 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d454c6-5e43-4053-9e63-164884a84dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:57.791557 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d454c6-5e43-4053-9e63-164884a84dbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:57.792499 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d454c6-5e43-4053-9e63-164884a84dbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:57.794097 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d454c6-5e43-4053-9e63-164884a84dbe admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:57.809510 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1049/2095] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:47:57.811052 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd288e1-b0e2-4a8f-b96f-8afe9e165003 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:57.822546 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd288e1-b0e2-4a8f-b96f-8afe9e165003 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:57.827437 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803281e-5486-4778-bf2e-722a6c100a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:57.828168 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803281e-5486-4778-bf2e-722a6c100a23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:57.828446 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803281e-5486-4778-bf2e-722a6c100a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:57.828721 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803281e-5486-4778-bf2e-722a6c100a23 admin admin] PATH_INFO: `/v3/projects/83563e78a0804c51bf0f48e582880630/users/08f61c68291041f6a05a97ebbf4dbcaf/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:57.844258 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a803281e-5486-4778-bf2e-722a6c100a23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83563e78a0804c51bf0f48e582880630, user_id=08f61c68291041f6a05a97ebbf4dbcaf, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:57.846928 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a803281e-5486-4778-bf2e-722a6c100a23 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:57.918618 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1047/2096] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:47:57 2022] PUT /identity/v3/projects/83563e78a0804c51bf0f48e582880630/users/08f61c68291041f6a05a97ebbf4dbcaf/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:47:57.931497 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2e2ab-27b5-4ef0-a94e-540349ece537 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:57.931912 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2e2ab-27b5-4ef0-a94e-540349ece537 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:57.932645 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2e2ab-27b5-4ef0-a94e-540349ece537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:57.977922 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-96d2e2ab-27b5-4ef0-a94e-540349ece537 None None] MFA Rules not processed for user `08f61c68291041f6a05a97ebbf4dbcaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:57.979797 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-96d2e2ab-27b5-4ef0-a94e-540349ece537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:58.095133 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1050/2097] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:47:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:58.110080 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803281e-5486-4778-bf2e-722a6c100a23 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:58.110080 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a803281e-5486-4778-bf2e-722a6c100a23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:58.163757 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:58.215675 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803281e-5486-4778-bf2e-722a6c100a23 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:58.224504 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623aa3c8-ec47-4e42-9da1-a11bc33847c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:58.225202 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623aa3c8-ec47-4e42-9da1-a11bc33847c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:58.225480 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623aa3c8-ec47-4e42-9da1-a11bc33847c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:58.225751 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623aa3c8-ec47-4e42-9da1-a11bc33847c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:58.236552 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623aa3c8-ec47-4e42-9da1-a11bc33847c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:58.237932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623aa3c8-ec47-4e42-9da1-a11bc33847c5 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:58.252098 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1048/2098] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:47:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:48:02.691752 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2e2ab-27b5-4ef0-a94e-540349ece537 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:02.693310 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-96d2e2ab-27b5-4ef0-a94e-540349ece537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:02.711258 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:02.758103 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2e2ab-27b5-4ef0-a94e-540349ece537 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:02.763985 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992fd75c-6533-4d73-a99b-a4004f8e1c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:02.764635 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fd75c-6533-4d73-a99b-a4004f8e1c30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:02.764915 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fd75c-6533-4d73-a99b-a4004f8e1c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:02.765191 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fd75c-6533-4d73-a99b-a4004f8e1c30 admin admin] PATH_INFO: `/v3/users/99713092d1a5425f97daff99a616f1b2` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:02.766314 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992fd75c-6533-4d73-a99b-a4004f8e1c30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99713092d1a5425f97daff99a616f1b2)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:02.768267 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992fd75c-6533-4d73-a99b-a4004f8e1c30 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:02.998834 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-992fd75c-6533-4d73-a99b-a4004f8e1c30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99713092d1a5425f97daff99a616f1b2'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:03.010789 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-992fd75c-6533-4d73-a99b-a4004f8e1c30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99713092d1a5425f97daff99a616f1b2'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:03.011432 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-992fd75c-6533-4d73-a99b-a4004f8e1c30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99713092d1a5425f97daff99a616f1b2'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:03.018458 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-992fd75c-6533-4d73-a99b-a4004f8e1c30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99713092d1a5425f97daff99a616f1b2'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:03.019119 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-992fd75c-6533-4d73-a99b-a4004f8e1c30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99713092d1a5425f97daff99a616f1b2'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:03.093681 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1051/2099] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:48:02 2022] DELETE /identity/v3/users/99713092d1a5425f97daff99a616f1b2 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:03.098841 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d93272-ba41-49aa-b8df-0eb995b907df None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:03.099497 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d93272-ba41-49aa-b8df-0eb995b907df None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:03.099497 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d93272-ba41-49aa-b8df-0eb995b907df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:03.118432 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-90d93272-ba41-49aa-b8df-0eb995b907df None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:03.119785 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-90d93272-ba41-49aa-b8df-0eb995b907df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:03.179333 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1049/2100] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:03.189059 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992fd75c-6533-4d73-a99b-a4004f8e1c30 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:03.190501 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-992fd75c-6533-4d73-a99b-a4004f8e1c30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:03.249393 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992fd75c-6533-4d73-a99b-a4004f8e1c30 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:03.252943 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81d1fd-ded3-4866-b44b-7bc5cb855b50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:03.253543 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81d1fd-ded3-4866-b44b-7bc5cb855b50 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:03.253822 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81d1fd-ded3-4866-b44b-7bc5cb855b50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:03.254096 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81d1fd-ded3-4866-b44b-7bc5cb855b50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:03.263870 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81d1fd-ded3-4866-b44b-7bc5cb855b50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:03.265240 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81d1fd-ded3-4866-b44b-7bc5cb855b50 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:03.275956 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1052/2101] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:48:03.708357 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d93272-ba41-49aa-b8df-0eb995b907df None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:03.709772 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-90d93272-ba41-49aa-b8df-0eb995b907df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:03.722382 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d93272-ba41-49aa-b8df-0eb995b907df None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:03.728106 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd5203-01f0-4386-b321-796f5eff6742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:03.728750 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd5203-01f0-4386-b321-796f5eff6742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:03.729035 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd5203-01f0-4386-b321-796f5eff6742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:03.729307 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd5203-01f0-4386-b321-796f5eff6742 admin admin] PATH_INFO: `/v3/projects/801a8babb39d4219a1da0be37d312647` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:03.732912 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd5203-01f0-4386-b321-796f5eff6742 admin admin] RBAC: Authorizing `identity:delete_project(project_id=801a8babb39d4219a1da0be37d312647)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:03.734912 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd5203-01f0-4386-b321-796f5eff6742 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:03.844509 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f1cd5203-01f0-4386-b321-796f5eff6742 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '801a8babb39d4219a1da0be37d312647', 'request_id': 'req-f1cd5203-01f0-4386-b321-796f5eff6742'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:03.851853 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f1cd5203-01f0-4386-b321-796f5eff6742 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '801a8babb39d4219a1da0be37d312647', 'request_id': 'req-f1cd5203-01f0-4386-b321-796f5eff6742'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:03.857528 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f1cd5203-01f0-4386-b321-796f5eff6742 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '801a8babb39d4219a1da0be37d312647', 'request_id': 'req-f1cd5203-01f0-4386-b321-796f5eff6742'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:03.933911 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f1cd5203-01f0-4386-b321-796f5eff6742 admin admin] The token cache is being invalidate because project 801a8babb39d4219a1da0be37d312647 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:48:03.934348 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f1cd5203-01f0-4386-b321-796f5eff6742 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:03.934996 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f1cd5203-01f0-4386-b321-796f5eff6742 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:03.936644 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1050/2102] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:48:03 2022] DELETE /identity/v3/projects/801a8babb39d4219a1da0be37d312647 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:04.719199 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81d1fd-ded3-4866-b44b-7bc5cb855b50 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:04.728712 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81d1fd-ded3-4866-b44b-7bc5cb855b50 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:04.771985 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:04.790160 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c40ff-9a95-47cc-9309-6c57e785391f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:04.790749 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c40ff-9a95-47cc-9309-6c57e785391f service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:04.791027 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c40ff-9a95-47cc-9309-6c57e785391f service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:04.791298 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c40ff-9a95-47cc-9309-6c57e785391f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:04.793040 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-fb5c40ff-9a95-47cc-9309-6c57e785391f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:04.856894 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c40ff-9a95-47cc-9309-6c57e785391f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:04.858340 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c40ff-9a95-47cc-9309-6c57e785391f service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:04.869743 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1053/2103] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:48:08.284510 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd5203-01f0-4386-b321-796f5eff6742 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:08.286264 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f1cd5203-01f0-4386-b321-796f5eff6742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:08.298710 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd5203-01f0-4386-b321-796f5eff6742 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:08.303828 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631183db-3cee-49c7-a808-91c79dd0f315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:08.304486 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631183db-3cee-49c7-a808-91c79dd0f315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:08.304915 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631183db-3cee-49c7-a808-91c79dd0f315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:08.305039 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631183db-3cee-49c7-a808-91c79dd0f315 admin admin] PATH_INFO: `/v3/users/08f61c68291041f6a05a97ebbf4dbcaf` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:08.307905 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631183db-3cee-49c7-a808-91c79dd0f315 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08f61c68291041f6a05a97ebbf4dbcaf)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:08.308317 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631183db-3cee-49c7-a808-91c79dd0f315 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:08.566081 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-631183db-3cee-49c7-a808-91c79dd0f315 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08f61c68291041f6a05a97ebbf4dbcaf'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:08.568437 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:08.580646 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-631183db-3cee-49c7-a808-91c79dd0f315 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08f61c68291041f6a05a97ebbf4dbcaf'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:08.588400 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-631183db-3cee-49c7-a808-91c79dd0f315 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08f61c68291041f6a05a97ebbf4dbcaf'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:08.589065 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-631183db-3cee-49c7-a808-91c79dd0f315 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08f61c68291041f6a05a97ebbf4dbcaf'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:08.589681 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-631183db-3cee-49c7-a808-91c79dd0f315 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08f61c68291041f6a05a97ebbf4dbcaf'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:08.673458 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c40ff-9a95-47cc-9309-6c57e785391f service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:08.675051 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-fb5c40ff-9a95-47cc-9309-6c57e785391f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:08.689966 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c40ff-9a95-47cc-9309-6c57e785391f service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:08.695100 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaedd8d-980b-4523-80b4-ca13fed30e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:08.695728 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaedd8d-980b-4523-80b4-ca13fed30e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:08.696006 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaedd8d-980b-4523-80b4-ca13fed30e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:08.696320 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaedd8d-980b-4523-80b4-ca13fed30e42 admin admin] PATH_INFO: `/v3/users/a483f57a4bab4d499d8fa8585d8622d3` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:08.697426 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaedd8d-980b-4523-80b4-ca13fed30e42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a483f57a4bab4d499d8fa8585d8622d3)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:08.699353 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaedd8d-980b-4523-80b4-ca13fed30e42 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:08.758286 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1051/2104] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:48:08 2022] DELETE /identity/v3/users/08f61c68291041f6a05a97ebbf4dbcaf => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:08.762629 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a0157-b405-4d88-af67-3c286260f896 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:08.762914 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a0157-b405-4d88-af67-3c286260f896 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:08.763186 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a0157-b405-4d88-af67-3c286260f896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:08.782806 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-095a0157-b405-4d88-af67-3c286260f896 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:08.784037 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-095a0157-b405-4d88-af67-3c286260f896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:08.851407 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1052/2105] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:48:08.860926 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a0157-b405-4d88-af67-3c286260f896 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:08.862260 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-095a0157-b405-4d88-af67-3c286260f896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:08.915519 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-dbaedd8d-980b-4523-80b4-ca13fed30e42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a483f57a4bab4d499d8fa8585d8622d3'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:08.920023 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a0157-b405-4d88-af67-3c286260f896 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:08.925324 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc3b59-fb6c-4fbb-b1c6-4f45a78014c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:08.925324 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc3b59-fb6c-4fbb-b1c6-4f45a78014c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:08.925324 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc3b59-fb6c-4fbb-b1c6-4f45a78014c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:08.925324 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc3b59-fb6c-4fbb-b1c6-4f45a78014c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:08.931195 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-dbaedd8d-980b-4523-80b4-ca13fed30e42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a483f57a4bab4d499d8fa8585d8622d3'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:08.931888 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-dbaedd8d-980b-4523-80b4-ca13fed30e42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a483f57a4bab4d499d8fa8585d8622d3'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:08.936822 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc3b59-fb6c-4fbb-b1c6-4f45a78014c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:08.943659 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc3b59-fb6c-4fbb-b1c6-4f45a78014c9 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:08.943834 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-dbaedd8d-980b-4523-80b4-ca13fed30e42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a483f57a4bab4d499d8fa8585d8622d3'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:08.943834 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-dbaedd8d-980b-4523-80b4-ca13fed30e42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a483f57a4bab4d499d8fa8585d8622d3'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:08.949625 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1053/2106] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:48:09.025714 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1054/2107] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:48:08 2022] DELETE /identity/v3/users/a483f57a4bab4d499d8fa8585d8622d3 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:48:09.369947 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc3b59-fb6c-4fbb-b1c6-4f45a78014c9 service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:09.371496 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-afcc3b59-fb6c-4fbb-b1c6-4f45a78014c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:09.385096 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc3b59-fb6c-4fbb-b1c6-4f45a78014c9 service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:09.443695 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bfdf10-0201-4be1-a764-b5db0f85ffd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:09.444273 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfdf10-0201-4be1-a764-b5db0f85ffd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:09.444552 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfdf10-0201-4be1-a764-b5db0f85ffd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:09.444827 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfdf10-0201-4be1-a764-b5db0f85ffd7 admin admin] PATH_INFO: `/v3/projects/c9231f89e3124db5afa272acc5d3c430` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:09.445920 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bfdf10-0201-4be1-a764-b5db0f85ffd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9231f89e3124db5afa272acc5d3c430)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:09.447822 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bfdf10-0201-4be1-a764-b5db0f85ffd7 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:09.458289 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:09.467203 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaedd8d-980b-4523-80b4-ca13fed30e42 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:09.468552 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-dbaedd8d-980b-4523-80b4-ca13fed30e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:09.486322 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaedd8d-980b-4523-80b4-ca13fed30e42 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:09.491431 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7c5e5-fbbd-4ee8-9ff1-d246d48d041a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:09.492129 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7c5e5-fbbd-4ee8-9ff1-d246d48d041a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:09.492424 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7c5e5-fbbd-4ee8-9ff1-d246d48d041a admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:09.492684 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7c5e5-fbbd-4ee8-9ff1-d246d48d041a admin admin] PATH_INFO: `/v3/projects/83563e78a0804c51bf0f48e582880630` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:09.493832 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba7c5e5-fbbd-4ee8-9ff1-d246d48d041a admin admin] RBAC: Authorizing `identity:delete_project(project_id=83563e78a0804c51bf0f48e582880630)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:09.495806 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba7c5e5-fbbd-4ee8-9ff1-d246d48d041a admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:09.712139 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bba7c5e5-fbbd-4ee8-9ff1-d246d48d041a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83563e78a0804c51bf0f48e582880630', 'request_id': 'req-bba7c5e5-fbbd-4ee8-9ff1-d246d48d041a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:09.713376 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e0bfdf10-0201-4be1-a764-b5db0f85ffd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9231f89e3124db5afa272acc5d3c430', 'request_id': 'req-e0bfdf10-0201-4be1-a764-b5db0f85ffd7'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:09.716619 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:09.717974 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bba7c5e5-fbbd-4ee8-9ff1-d246d48d041a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83563e78a0804c51bf0f48e582880630', 'request_id': 'req-bba7c5e5-fbbd-4ee8-9ff1-d246d48d041a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:09.720248 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e0bfdf10-0201-4be1-a764-b5db0f85ffd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9231f89e3124db5afa272acc5d3c430', 'request_id': 'req-e0bfdf10-0201-4be1-a764-b5db0f85ffd7'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:09.725319 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bba7c5e5-fbbd-4ee8-9ff1-d246d48d041a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83563e78a0804c51bf0f48e582880630', 'request_id': 'req-bba7c5e5-fbbd-4ee8-9ff1-d246d48d041a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:09.726856 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e0bfdf10-0201-4be1-a764-b5db0f85ffd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9231f89e3124db5afa272acc5d3c430', 'request_id': 'req-e0bfdf10-0201-4be1-a764-b5db0f85ffd7'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:09.795809 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bba7c5e5-fbbd-4ee8-9ff1-d246d48d041a admin admin] The token cache is being invalidate because project 83563e78a0804c51bf0f48e582880630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:48:09.796124 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bba7c5e5-fbbd-4ee8-9ff1-d246d48d041a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:09.796738 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bba7c5e5-fbbd-4ee8-9ff1-d246d48d041a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:09.798212 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1055/2108] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:48:09 2022] DELETE /identity/v3/projects/83563e78a0804c51bf0f48e582880630 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:09.803308 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688e820-f7ff-4a1e-bce5-19c616cf40e1 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:09.803598 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688e820-f7ff-4a1e-bce5-19c616cf40e1 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:09.803875 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688e820-f7ff-4a1e-bce5-19c616cf40e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:09.824239 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-0688e820-f7ff-4a1e-bce5-19c616cf40e1 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:09.826531 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0688e820-f7ff-4a1e-bce5-19c616cf40e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:09.865342 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e0bfdf10-0201-4be1-a764-b5db0f85ffd7 admin admin] The token cache is being invalidate because project c9231f89e3124db5afa272acc5d3c430 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:48:09.865630 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e0bfdf10-0201-4be1-a764-b5db0f85ffd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:09.866263 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e0bfdf10-0201-4be1-a764-b5db0f85ffd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:09.868017 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1054/2109] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:48:09 2022] DELETE /identity/v3/projects/c9231f89e3124db5afa272acc5d3c430 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:09.872492 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a885b-6cb5-4adb-b9d4-409c0bfb5218 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:09.872817 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a885b-6cb5-4adb-b9d4-409c0bfb5218 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:09.873183 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a885b-6cb5-4adb-b9d4-409c0bfb5218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:09.885076 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1056/2110] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:48:09.892784 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cd428-0c64-4c37-8659-029062294db1 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:09.895603 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cd428-0c64-4c37-8659-029062294db1 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:09.895603 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cd428-0c64-4c37-8659-029062294db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:09.897064 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-878a885b-6cb5-4adb-b9d4-409c0bfb5218 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:09.898268 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-878a885b-6cb5-4adb-b9d4-409c0bfb5218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:09.906196 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1055/2111] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:48:09.914500 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d69615-0faa-497e-ab6b-0f584bb12cf5 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:09.914781 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d69615-0faa-497e-ab6b-0f584bb12cf5 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:09.915050 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d69615-0faa-497e-ab6b-0f584bb12cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:09.917631 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-5f2cd428-0c64-4c37-8659-029062294db1 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:09.918833 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5f2cd428-0c64-4c37-8659-029062294db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:09.927900 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1057/2112] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:09.931807 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2cd428-0c64-4c37-8659-029062294db1 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:09.936789 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-46d69615-0faa-497e-ab6b-0f584bb12cf5 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:09.938150 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-46d69615-0faa-497e-ab6b-0f584bb12cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:09.941364 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2cd428-0c64-4c37-8659-029062294db1 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:09.946456 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c1ccd-320d-4705-b5d2-209df974390f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:09.946857 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1056/2113] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:09.947064 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c1ccd-320d-4705-b5d2-209df974390f admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:09.947361 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c1ccd-320d-4705-b5d2-209df974390f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:09.947636 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c1ccd-320d-4705-b5d2-209df974390f admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:09.948308 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c1ccd-320d-4705-b5d2-209df974390f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:48:09.948611 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c1ccd-320d-4705-b5d2-209df974390f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:09.950210 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c1ccd-320d-4705-b5d2-209df974390f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:09.950652 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d69615-0faa-497e-ab6b-0f584bb12cf5 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:09.961152 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d69615-0faa-497e-ab6b-0f584bb12cf5 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:09.968138 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1058/2114] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:48:09.968283 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a1539-be02-4565-ada3-a236ddd9d8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:09.968283 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a1539-be02-4565-ada3-a236ddd9d8c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:09.968283 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a1539-be02-4565-ada3-a236ddd9d8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:09.968283 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a1539-be02-4565-ada3-a236ddd9d8c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:09.968669 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636a1539-be02-4565-ada3-a236ddd9d8c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:48:09.968669 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636a1539-be02-4565-ada3-a236ddd9d8c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:09.969632 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636a1539-be02-4565-ada3-a236ddd9d8c1 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:09.971182 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c1ccd-320d-4705-b5d2-209df974390f admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:09.981185 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c1ccd-320d-4705-b5d2-209df974390f admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:09.984926 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1057/2115] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:48:09.985871 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a1539-be02-4565-ada3-a236ddd9d8c1 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:09.986833 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0df100-6c4c-4c9d-ae1b-a4b6d6e8a470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:09.987428 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0df100-6c4c-4c9d-ae1b-a4b6d6e8a470 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:09.987704 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0df100-6c4c-4c9d-ae1b-a4b6d6e8a470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:09.987977 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0df100-6c4c-4c9d-ae1b-a4b6d6e8a470 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:09.988636 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0df100-6c4c-4c9d-ae1b-a4b6d6e8a470 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:09.990567 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0df100-6c4c-4c9d-ae1b-a4b6d6e8a470 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:09.996301 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a1539-be02-4565-ada3-a236ddd9d8c1 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:10.001457 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d765ac6-deb9-4926-b137-6f2469b487d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:10.002048 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d765ac6-deb9-4926-b137-6f2469b487d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:10.002333 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d765ac6-deb9-4926-b137-6f2469b487d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:10.002609 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d765ac6-deb9-4926-b137-6f2469b487d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:10.003236 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d765ac6-deb9-4926-b137-6f2469b487d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:10.005707 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d765ac6-deb9-4926-b137-6f2469b487d6 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:10.078006 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1059/2116] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:48:09 2022] POST /identity/v3/projects => generated 403 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:48:10.081855 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0df100-6c4c-4c9d-ae1b-a4b6d6e8a470 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:10.109884 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1058/2117] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:48:09 2022] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:48:10.110995 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d765ac6-deb9-4926-b137-6f2469b487d6 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:10.148061 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0df100-6c4c-4c9d-ae1b-a4b6d6e8a470 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:10.174673 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d765ac6-deb9-4926-b137-6f2469b487d6 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:10.179677 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83bee4e-d057-477a-b66f-33afd3952196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:10.183894 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bee4e-d057-477a-b66f-33afd3952196 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:10.183894 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bee4e-d057-477a-b66f-33afd3952196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:10.183894 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bee4e-d057-477a-b66f-33afd3952196 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:10.183894 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83bee4e-d057-477a-b66f-33afd3952196 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:10.183894 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83bee4e-d057-477a-b66f-33afd3952196 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:10.193612 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:10.205331 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24217c-266f-4b0d-8be3-c509fa4efc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:10.205936 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24217c-266f-4b0d-8be3-c509fa4efc13 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:10.206212 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24217c-266f-4b0d-8be3-c509fa4efc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:10.206511 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24217c-266f-4b0d-8be3-c509fa4efc13 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:10.207142 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24217c-266f-4b0d-8be3-c509fa4efc13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:10.209313 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24217c-266f-4b0d-8be3-c509fa4efc13 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:10.282712 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1059/2118] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:48:10 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:48:10.287720 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83bee4e-d057-477a-b66f-33afd3952196 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:10.297106 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83bee4e-d057-477a-b66f-33afd3952196 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:10.302387 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066efdc-605a-413f-a55d-dc457f7944d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:10.302956 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066efdc-605a-413f-a55d-dc457f7944d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:10.303238 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066efdc-605a-413f-a55d-dc457f7944d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:10.303625 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066efdc-605a-413f-a55d-dc457f7944d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:10.304185 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066efdc-605a-413f-a55d-dc457f7944d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:10.305748 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066efdc-605a-413f-a55d-dc457f7944d5 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:10.315566 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1060/2119] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:48:10.319367 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066efdc-605a-413f-a55d-dc457f7944d5 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:10.328936 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066efdc-605a-413f-a55d-dc457f7944d5 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:10.330083 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1060/2120] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:48:10 2022] POST /identity/v3/users => generated 302 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:48:10.334382 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f3a66-dbc8-4065-a198-24748e2ace9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:10.334556 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24217c-266f-4b0d-8be3-c509fa4efc13 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:10.334971 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f3a66-dbc8-4065-a198-24748e2ace9a admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:10.335253 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f3a66-dbc8-4065-a198-24748e2ace9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:10.335527 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f3a66-dbc8-4065-a198-24748e2ace9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:10.336181 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f3a66-dbc8-4065-a198-24748e2ace9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:10.337747 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f3a66-dbc8-4065-a198-24748e2ace9a admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:10.344435 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24217c-266f-4b0d-8be3-c509fa4efc13 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:10.349755 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665acfa-0a03-41a1-8985-b8ea9100dbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:10.350343 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665acfa-0a03-41a1-8985-b8ea9100dbc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:10.350487 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1061/2121] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:48:10.350626 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665acfa-0a03-41a1-8985-b8ea9100dbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:10.350880 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665acfa-0a03-41a1-8985-b8ea9100dbc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:10.351676 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c665acfa-0a03-41a1-8985-b8ea9100dbc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:10.353143 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c665acfa-0a03-41a1-8985-b8ea9100dbc1 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:10.354624 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f3a66-dbc8-4065-a198-24748e2ace9a admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:10.364567 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f3a66-dbc8-4065-a198-24748e2ace9a admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:10.364908 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1061/2122] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:48:10.368993 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665acfa-0a03-41a1-8985-b8ea9100dbc1 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:10.371569 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19422741-5c16-4c9f-b544-a960f0b43e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:10.372482 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19422741-5c16-4c9f-b544-a960f0b43e20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:10.372761 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19422741-5c16-4c9f-b544-a960f0b43e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:10.373030 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19422741-5c16-4c9f-b544-a960f0b43e20 admin admin] PATH_INFO: `/v3/projects/41be4ce5e0ad4915919bc0c3d5c54131/users/df85806bb5064d809e504f1b1a3df26c/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:10.379193 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665acfa-0a03-41a1-8985-b8ea9100dbc1 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:10.383987 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200c21b-cac4-4fa7-8026-90ef507d5dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:10.384673 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200c21b-cac4-4fa7-8026-90ef507d5dba admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:10.384954 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200c21b-cac4-4fa7-8026-90ef507d5dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:10.385227 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200c21b-cac4-4fa7-8026-90ef507d5dba admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:10.385856 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2200c21b-cac4-4fa7-8026-90ef507d5dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:10.387469 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2200c21b-cac4-4fa7-8026-90ef507d5dba admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:10.388015 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19422741-5c16-4c9f-b544-a960f0b43e20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41be4ce5e0ad4915919bc0c3d5c54131, user_id=df85806bb5064d809e504f1b1a3df26c, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:10.390682 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19422741-5c16-4c9f-b544-a960f0b43e20 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:10.392885 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:10.397983 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1062/2123] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:48:10.402193 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200c21b-cac4-4fa7-8026-90ef507d5dba admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:10.412857 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200c21b-cac4-4fa7-8026-90ef507d5dba admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:10.417474 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18caebeb-bca8-4031-8e79-c83521a7710f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:10.418123 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18caebeb-bca8-4031-8e79-c83521a7710f admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:10.418401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18caebeb-bca8-4031-8e79-c83521a7710f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:10.418673 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18caebeb-bca8-4031-8e79-c83521a7710f admin admin] PATH_INFO: `/v3/projects/813d91edc54f4b6fa9c48d4d08abd227/users/d7511662627248e08b136a4a85ca4ff6/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:10.433734 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18caebeb-bca8-4031-8e79-c83521a7710f admin admin] RBAC: Authorizing `identity:create_grant(project_id=813d91edc54f4b6fa9c48d4d08abd227, user_id=d7511662627248e08b136a4a85ca4ff6, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:10.436476 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18caebeb-bca8-4031-8e79-c83521a7710f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:10.450028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1062/2124] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:48:10 2022] PUT /identity/v3/projects/41be4ce5e0ad4915919bc0c3d5c54131/users/df85806bb5064d809e504f1b1a3df26c/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:10.460389 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9021d92-4adc-406c-9c23-fc5a86e1bd8b None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:10.460678 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9021d92-4adc-406c-9c23-fc5a86e1bd8b None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:10.460953 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9021d92-4adc-406c-9c23-fc5a86e1bd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:10.488153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-a9021d92-4adc-406c-9c23-fc5a86e1bd8b None None] MFA Rules not processed for user `df85806bb5064d809e504f1b1a3df26c`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:10.491530 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a9021d92-4adc-406c-9c23-fc5a86e1bd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:10.523477 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1063/2125] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:48:10 2022] PUT /identity/v3/projects/813d91edc54f4b6fa9c48d4d08abd227/users/d7511662627248e08b136a4a85ca4ff6/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:10.536153 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea64245-c318-436a-83d4-cb77e22db887 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:10.536153 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea64245-c318-436a-83d4-cb77e22db887 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:10.536153 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea64245-c318-436a-83d4-cb77e22db887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:10.554113 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1063/2126] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:48:10.558624 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9021d92-4adc-406c-9c23-fc5a86e1bd8b None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:10.563981 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-8ea64245-c318-436a-83d4-cb77e22db887 None None] MFA Rules not processed for user `d7511662627248e08b136a4a85ca4ff6`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:10.565239 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8ea64245-c318-436a-83d4-cb77e22db887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:10.621476 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9021d92-4adc-406c-9c23-fc5a86e1bd8b None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:10.629971 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1064/2127] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:10 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:10.634557 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea64245-c318-436a-83d4-cb77e22db887 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:10.679234 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae274d9e-134f-4c62-b9fa-119f151fde95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:10.679834 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae274d9e-134f-4c62-b9fa-119f151fde95 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:10.680131 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae274d9e-134f-4c62-b9fa-119f151fde95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:10.680399 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae274d9e-134f-4c62-b9fa-119f151fde95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:10.681017 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae274d9e-134f-4c62-b9fa-119f151fde95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:10.683047 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae274d9e-134f-4c62-b9fa-119f151fde95 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:10.697170 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea64245-c318-436a-83d4-cb77e22db887 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:10.702098 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded78f5c-83bc-4750-91dd-3ca7bdd039d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:10.702725 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded78f5c-83bc-4750-91dd-3ca7bdd039d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:10.703003 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded78f5c-83bc-4750-91dd-3ca7bdd039d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:10.703275 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded78f5c-83bc-4750-91dd-3ca7bdd039d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:10.703921 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded78f5c-83bc-4750-91dd-3ca7bdd039d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:10.705842 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded78f5c-83bc-4750-91dd-3ca7bdd039d1 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:10.763698 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1064/2128] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:48:10 2022] POST /identity/v3/projects => generated 371 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:48:10.767783 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae274d9e-134f-4c62-b9fa-119f151fde95 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:10.785928 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:10.788302 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1065/2129] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:48:10 2022] POST /identity/v3/projects => generated 403 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:48:10.792724 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded78f5c-83bc-4750-91dd-3ca7bdd039d1 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:10.804580 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:10.829797 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae274d9e-134f-4c62-b9fa-119f151fde95 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:10.864074 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded78f5c-83bc-4750-91dd-3ca7bdd039d1 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:10.868780 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537bc53-9939-418f-9ca8-01809a7a7d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:10.871674 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537bc53-9939-418f-9ca8-01809a7a7d60 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:10.871674 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537bc53-9939-418f-9ca8-01809a7a7d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:10.871674 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537bc53-9939-418f-9ca8-01809a7a7d60 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:10.871674 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537bc53-9939-418f-9ca8-01809a7a7d60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:10.872630 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537bc53-9939-418f-9ca8-01809a7a7d60 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:10.886238 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bd8ca-cd99-4f7c-b30c-c9b655deb547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:10.886877 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bd8ca-cd99-4f7c-b30c-c9b655deb547 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:10.887137 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bd8ca-cd99-4f7c-b30c-c9b655deb547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:10.887603 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bd8ca-cd99-4f7c-b30c-c9b655deb547 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:10.888334 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7bd8ca-cd99-4f7c-b30c-c9b655deb547 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:10.891000 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7bd8ca-cd99-4f7c-b30c-c9b655deb547 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:10.980537 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1066/2130] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:48:10 2022] POST /identity/v3/users => generated 308 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:48:10.984394 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537bc53-9939-418f-9ca8-01809a7a7d60 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:10.991494 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1065/2131] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:48:10 2022] POST /identity/v3/users => generated 292 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:48:10.995961 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537bc53-9939-418f-9ca8-01809a7a7d60 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:10.998540 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bd8ca-cd99-4f7c-b30c-c9b655deb547 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:11.001100 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477599c6-7b3b-4b2b-a7b1-8f27386c8ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:11.001696 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477599c6-7b3b-4b2b-a7b1-8f27386c8ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:11.001972 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477599c6-7b3b-4b2b-a7b1-8f27386c8ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:11.002243 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477599c6-7b3b-4b2b-a7b1-8f27386c8ed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:11.002877 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477599c6-7b3b-4b2b-a7b1-8f27386c8ed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:11.004550 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477599c6-7b3b-4b2b-a7b1-8f27386c8ed6 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:11.008418 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bd8ca-cd99-4f7c-b30c-c9b655deb547 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:11.013207 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5a450-7836-4d49-be94-e89bba9995cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:11.013829 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5a450-7836-4d49-be94-e89bba9995cb admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:11.014247 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5a450-7836-4d49-be94-e89bba9995cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:11.014521 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5a450-7836-4d49-be94-e89bba9995cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:11.017665 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1067/2132] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:48:11.017803 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a5a450-7836-4d49-be94-e89bba9995cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:11.017803 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a5a450-7836-4d49-be94-e89bba9995cb admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:11.018591 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477599c6-7b3b-4b2b-a7b1-8f27386c8ed6 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:11.030130 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1066/2133] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:48:11.030308 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477599c6-7b3b-4b2b-a7b1-8f27386c8ed6 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:11.031041 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5a450-7836-4d49-be94-e89bba9995cb admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:11.032824 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b50c9-2ff0-4eed-a2b8-ca65c30cee8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:11.033467 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b50c9-2ff0-4eed-a2b8-ca65c30cee8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:11.033746 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b50c9-2ff0-4eed-a2b8-ca65c30cee8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:11.034018 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b50c9-2ff0-4eed-a2b8-ca65c30cee8e admin admin] PATH_INFO: `/v3/projects/d81873d064e1454b91eafec8fb043d2f/users/3991d2634d0143bc910efcf3f0b120e7/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:11.041198 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5a450-7836-4d49-be94-e89bba9995cb admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:11.045665 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19896acb-e88c-4a42-9721-a49578fa6e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:11.046297 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19896acb-e88c-4a42-9721-a49578fa6e9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:11.046572 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19896acb-e88c-4a42-9721-a49578fa6e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:11.046838 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19896acb-e88c-4a42-9721-a49578fa6e9b admin admin] PATH_INFO: `/v3/projects/cdb52f924b7a42098c46690d30893283/users/a06e24f6ced649ce826c80cbb6deb9d7/roles/9252c356af254127896f3626d925a88a` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:11.049914 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b50c9-2ff0-4eed-a2b8-ca65c30cee8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d81873d064e1454b91eafec8fb043d2f, user_id=3991d2634d0143bc910efcf3f0b120e7, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:11.053467 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b50c9-2ff0-4eed-a2b8-ca65c30cee8e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:11.062148 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19896acb-e88c-4a42-9721-a49578fa6e9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdb52f924b7a42098c46690d30893283, user_id=a06e24f6ced649ce826c80cbb6deb9d7, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:11.064801 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19896acb-e88c-4a42-9721-a49578fa6e9b admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:11.151702 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1068/2134] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:48:11 2022] PUT /identity/v3/projects/d81873d064e1454b91eafec8fb043d2f/users/3991d2634d0143bc910efcf3f0b120e7/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:11.155465 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b50c9-2ff0-4eed-a2b8-ca65c30cee8e admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:11.185297 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1067/2135] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:48:11 2022] PUT /identity/v3/projects/cdb52f924b7a42098c46690d30893283/users/a06e24f6ced649ce826c80cbb6deb9d7/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:11.189235 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19896acb-e88c-4a42-9721-a49578fa6e9b admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:11.221705 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b50c9-2ff0-4eed-a2b8-ca65c30cee8e admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:11.252774 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19896acb-e88c-4a42-9721-a49578fa6e9b admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:11.257672 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94294400-b847-42f8-b799-60e9a4d0009a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:11.258279 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94294400-b847-42f8-b799-60e9a4d0009a admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:11.261224 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94294400-b847-42f8-b799-60e9a4d0009a admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:11.261224 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94294400-b847-42f8-b799-60e9a4d0009a admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:11.261224 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94294400-b847-42f8-b799-60e9a4d0009a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:11.261224 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94294400-b847-42f8-b799-60e9a4d0009a admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:11.271602 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1068/2136] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:48:11.275633 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94294400-b847-42f8-b799-60e9a4d0009a admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:11.280312 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ffc45c-3d3b-4af6-802f-b88738b16406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:11.280928 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffc45c-3d3b-4af6-802f-b88738b16406 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:11.281208 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffc45c-3d3b-4af6-802f-b88738b16406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:11.281477 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffc45c-3d3b-4af6-802f-b88738b16406 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:11.282142 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ffc45c-3d3b-4af6-802f-b88738b16406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:11.283792 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ffc45c-3d3b-4af6-802f-b88738b16406 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:11.286053 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94294400-b847-42f8-b799-60e9a4d0009a admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:11.290746 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cddeff-49c7-4a7c-83b6-56d31f049610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:11.291431 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cddeff-49c7-4a7c-83b6-56d31f049610 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:11.291657 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cddeff-49c7-4a7c-83b6-56d31f049610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:11.291929 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cddeff-49c7-4a7c-83b6-56d31f049610 admin admin] PATH_INFO: `/v3/projects/cdb52f924b7a42098c46690d30893283/users/a06e24f6ced649ce826c80cbb6deb9d7/roles/9252c356af254127896f3626d925a88a` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:11.293859 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cddeff-49c7-4a7c-83b6-56d31f049610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdb52f924b7a42098c46690d30893283, user_id=a06e24f6ced649ce826c80cbb6deb9d7, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:11.295474 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1069/2137] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:48:11.297212 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cddeff-49c7-4a7c-83b6-56d31f049610 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:11.299525 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ffc45c-3d3b-4af6-802f-b88738b16406 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:11.303853 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:11.305883 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:11.308192 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1069/2138] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:48:11 2022] PUT /identity/v3/projects/cdb52f924b7a42098c46690d30893283/users/a06e24f6ced649ce826c80cbb6deb9d7/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:48:11.309976 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ffc45c-3d3b-4af6-802f-b88738b16406 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:11.326239 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94ccf6-eb69-47b2-870f-f7623841a6bf None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:11.326525 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94ccf6-eb69-47b2-870f-f7623841a6bf None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:11.326804 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94ccf6-eb69-47b2-870f-f7623841a6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:11.356124 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-1c94ccf6-eb69-47b2-870f-f7623841a6bf None None] MFA Rules not processed for user `a06e24f6ced649ce826c80cbb6deb9d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:11.357354 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-1c94ccf6-eb69-47b2-870f-f7623841a6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:11.369583 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4ae18-9df4-496f-8e63-c299f0b2069e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:11.370239 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4ae18-9df4-496f-8e63-c299f0b2069e admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:11.370538 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4ae18-9df4-496f-8e63-c299f0b2069e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:11.370788 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4ae18-9df4-496f-8e63-c299f0b2069e admin admin] PATH_INFO: `/v3/projects/d81873d064e1454b91eafec8fb043d2f/users/3991d2634d0143bc910efcf3f0b120e7/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:11.372880 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e4ae18-9df4-496f-8e63-c299f0b2069e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d81873d064e1454b91eafec8fb043d2f, user_id=3991d2634d0143bc910efcf3f0b120e7, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:11.375523 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e4ae18-9df4-496f-8e63-c299f0b2069e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:11.386132 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1070/2139] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:48:11 2022] PUT /identity/v3/projects/d81873d064e1454b91eafec8fb043d2f/users/3991d2634d0143bc910efcf3f0b120e7/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:48:11.398358 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868e8f3-2a89-4789-a957-0165ba592e2f None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:11.398644 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868e8f3-2a89-4789-a957-0165ba592e2f None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:11.398918 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868e8f3-2a89-4789-a957-0165ba592e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:11.428428 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-8868e8f3-2a89-4789-a957-0165ba592e2f None None] MFA Rules not processed for user `3991d2634d0143bc910efcf3f0b120e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:11.429229 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1070/2140] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:48:11.429709 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8868e8f3-2a89-4789-a957-0165ba592e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:11.441010 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94ccf6-eb69-47b2-870f-f7623841a6bf None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:11.442702 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-1c94ccf6-eb69-47b2-870f-f7623841a6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:11.501002 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94ccf6-eb69-47b2-870f-f7623841a6bf None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:11.501765 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1071/2141] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:11 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:48:11.513038 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868e8f3-2a89-4789-a957-0165ba592e2f None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:11.514382 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8868e8f3-2a89-4789-a957-0165ba592e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:11.553038 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792071c7-c14c-4f25-b6c4-e18ea7742c64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:11.553568 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792071c7-c14c-4f25-b6c4-e18ea7742c64 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:11.553846 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792071c7-c14c-4f25-b6c4-e18ea7742c64 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:11.554118 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792071c7-c14c-4f25-b6c4-e18ea7742c64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:11.572348 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868e8f3-2a89-4789-a957-0165ba592e2f None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:11.576003 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cee619-a149-4462-b554-39972d607df5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:11.576636 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cee619-a149-4462-b554-39972d607df5 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:11.576912 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cee619-a149-4462-b554-39972d607df5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:11.577183 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cee619-a149-4462-b554-39972d607df5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:11.587429 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cee619-a149-4462-b554-39972d607df5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:11.588993 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cee619-a149-4462-b554-39972d607df5 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:11.599352 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1072/2142] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:11 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:48:11.606769 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:11.615946 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792071c7-c14c-4f25-b6c4-e18ea7742c64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:11.617451 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792071c7-c14c-4f25-b6c4-e18ea7742c64 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:11.627300 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1071/2143] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:48:11.752908 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cee619-a149-4462-b554-39972d607df5 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:11.782508 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:11.815158 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cee619-a149-4462-b554-39972d607df5 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:11.821335 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bab972-7f7e-4d66-b33b-65e717a87a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:11.821996 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bab972-7f7e-4d66-b33b-65e717a87a56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:11.822269 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bab972-7f7e-4d66-b33b-65e717a87a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:11.822562 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bab972-7f7e-4d66-b33b-65e717a87a56 admin admin] PATH_INFO: `/v3/users/d7511662627248e08b136a4a85ca4ff6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:11.823787 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bab972-7f7e-4d66-b33b-65e717a87a56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7511662627248e08b136a4a85ca4ff6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:11.825734 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bab972-7f7e-4d66-b33b-65e717a87a56 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:11.828715 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792071c7-c14c-4f25-b6c4-e18ea7742c64 service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:11.838349 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792071c7-c14c-4f25-b6c4-e18ea7742c64 service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:11.842031 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc4a589-21fe-4bf9-bdf5-305d2fd678f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:11.842620 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4a589-21fe-4bf9-bdf5-305d2fd678f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:11.842896 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4a589-21fe-4bf9-bdf5-305d2fd678f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:11.843161 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4a589-21fe-4bf9-bdf5-305d2fd678f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:11.898885 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc4a589-21fe-4bf9-bdf5-305d2fd678f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:11.900325 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc4a589-21fe-4bf9-bdf5-305d2fd678f4 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:11.909129 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1072/2144] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:48:12.052362 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d4bab972-7f7e-4d66-b33b-65e717a87a56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7511662627248e08b136a4a85ca4ff6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:12.064609 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d4bab972-7f7e-4d66-b33b-65e717a87a56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7511662627248e08b136a4a85ca4ff6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:12.065217 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d4bab972-7f7e-4d66-b33b-65e717a87a56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7511662627248e08b136a4a85ca4ff6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:12.072673 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d4bab972-7f7e-4d66-b33b-65e717a87a56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7511662627248e08b136a4a85ca4ff6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:12.073433 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d4bab972-7f7e-4d66-b33b-65e717a87a56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7511662627248e08b136a4a85ca4ff6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:12.168490 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1073/2145] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:48:11 2022] DELETE /identity/v3/users/d7511662627248e08b136a4a85ca4ff6 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:12.173026 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63103b4d-866f-466d-8458-b39b53aa3d47 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:12.173308 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63103b4d-866f-466d-8458-b39b53aa3d47 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:12.173576 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63103b4d-866f-466d-8458-b39b53aa3d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:12.192824 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-63103b4d-866f-466d-8458-b39b53aa3d47 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:12.194008 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-63103b4d-866f-466d-8458-b39b53aa3d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:12.252992 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1073/2146] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:48:12.263259 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bab972-7f7e-4d66-b33b-65e717a87a56 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:12.264754 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d4bab972-7f7e-4d66-b33b-65e717a87a56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:12.323496 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bab972-7f7e-4d66-b33b-65e717a87a56 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:12.327075 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d7326-e641-4280-8624-664fb0f7e20e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:12.327676 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d7326-e641-4280-8624-664fb0f7e20e service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:12.327953 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d7326-e641-4280-8624-664fb0f7e20e service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:12.328250 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d7326-e641-4280-8624-664fb0f7e20e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:12.337746 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d7326-e641-4280-8624-664fb0f7e20e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:12.345695 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d7326-e641-4280-8624-664fb0f7e20e service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:12.348812 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1074/2147] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:48:12.746733 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63103b4d-866f-466d-8458-b39b53aa3d47 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:12.748164 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-63103b4d-866f-466d-8458-b39b53aa3d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:12.761384 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63103b4d-866f-466d-8458-b39b53aa3d47 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:12.766125 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293182ca-8643-4eaa-9da1-a81203a099ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:12.766934 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293182ca-8643-4eaa-9da1-a81203a099ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:12.767306 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293182ca-8643-4eaa-9da1-a81203a099ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:12.767676 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293182ca-8643-4eaa-9da1-a81203a099ee admin admin] PATH_INFO: `/v3/projects/813d91edc54f4b6fa9c48d4d08abd227` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:12.768798 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293182ca-8643-4eaa-9da1-a81203a099ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=813d91edc54f4b6fa9c48d4d08abd227)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:12.772370 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293182ca-8643-4eaa-9da1-a81203a099ee admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:12.866141 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-293182ca-8643-4eaa-9da1-a81203a099ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '813d91edc54f4b6fa9c48d4d08abd227', 'request_id': 'req-293182ca-8643-4eaa-9da1-a81203a099ee'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:12.872438 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-293182ca-8643-4eaa-9da1-a81203a099ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '813d91edc54f4b6fa9c48d4d08abd227', 'request_id': 'req-293182ca-8643-4eaa-9da1-a81203a099ee'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:12.878951 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-293182ca-8643-4eaa-9da1-a81203a099ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '813d91edc54f4b6fa9c48d4d08abd227', 'request_id': 'req-293182ca-8643-4eaa-9da1-a81203a099ee'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:12.945936 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-293182ca-8643-4eaa-9da1-a81203a099ee admin admin] The token cache is being invalidate because project 813d91edc54f4b6fa9c48d4d08abd227 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:48:12.946069 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-293182ca-8643-4eaa-9da1-a81203a099ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:12.946658 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-293182ca-8643-4eaa-9da1-a81203a099ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:12.948184 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1074/2148] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:48:12 2022] DELETE /identity/v3/projects/813d91edc54f4b6fa9c48d4d08abd227 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:12.952180 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d7326-e641-4280-8624-664fb0f7e20e service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:12.962578 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d7326-e641-4280-8624-664fb0f7e20e service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:13.007126 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:13.018356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3d2fd-090c-43ba-9948-5bd819a65ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:13.018975 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3d2fd-090c-43ba-9948-5bd819a65ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:13.019250 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3d2fd-090c-43ba-9948-5bd819a65ede admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:13.019589 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3d2fd-090c-43ba-9948-5bd819a65ede admin admin] PATH_INFO: `/v3/users/3991d2634d0143bc910efcf3f0b120e7` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:13.020721 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f3d2fd-090c-43ba-9948-5bd819a65ede admin admin] RBAC: Authorizing `identity:delete_user(user_id=3991d2634d0143bc910efcf3f0b120e7)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:13.022669 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f3d2fd-090c-43ba-9948-5bd819a65ede admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:13.237891 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-19f3d2fd-090c-43ba-9948-5bd819a65ede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3991d2634d0143bc910efcf3f0b120e7'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:13.250229 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-19f3d2fd-090c-43ba-9948-5bd819a65ede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3991d2634d0143bc910efcf3f0b120e7'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:13.250915 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-19f3d2fd-090c-43ba-9948-5bd819a65ede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3991d2634d0143bc910efcf3f0b120e7'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:13.258539 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-19f3d2fd-090c-43ba-9948-5bd819a65ede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3991d2634d0143bc910efcf3f0b120e7'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:13.259181 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-19f3d2fd-090c-43ba-9948-5bd819a65ede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3991d2634d0143bc910efcf3f0b120e7'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:13.356354 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1075/2149] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:48:12 2022] DELETE /identity/v3/users/3991d2634d0143bc910efcf3f0b120e7 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:14.055627 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293182ca-8643-4eaa-9da1-a81203a099ee admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:14.069188 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-293182ca-8643-4eaa-9da1-a81203a099ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:14.071650 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293182ca-8643-4eaa-9da1-a81203a099ee admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:14.081601 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:14.140328 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e23d7-f746-42b7-9e9f-d51625f9410f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:14.140950 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e23d7-f746-42b7-9e9f-d51625f9410f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:14.141225 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e23d7-f746-42b7-9e9f-d51625f9410f admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:14.141495 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e23d7-f746-42b7-9e9f-d51625f9410f admin admin] PATH_INFO: `/v3/projects/d81873d064e1454b91eafec8fb043d2f` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:14.142612 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e23d7-f746-42b7-9e9f-d51625f9410f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d81873d064e1454b91eafec8fb043d2f)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:14.144641 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e23d7-f746-42b7-9e9f-d51625f9410f admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:14.280247 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c30e23d7-f746-42b7-9e9f-d51625f9410f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd81873d064e1454b91eafec8fb043d2f', 'request_id': 'req-c30e23d7-f746-42b7-9e9f-d51625f9410f'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:14.288727 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c30e23d7-f746-42b7-9e9f-d51625f9410f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd81873d064e1454b91eafec8fb043d2f', 'request_id': 'req-c30e23d7-f746-42b7-9e9f-d51625f9410f'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:14.298489 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c30e23d7-f746-42b7-9e9f-d51625f9410f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd81873d064e1454b91eafec8fb043d2f', 'request_id': 'req-c30e23d7-f746-42b7-9e9f-d51625f9410f'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:14.407343 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c30e23d7-f746-42b7-9e9f-d51625f9410f admin admin] The token cache is being invalidate because project d81873d064e1454b91eafec8fb043d2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:48:14.407633 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c30e23d7-f746-42b7-9e9f-d51625f9410f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:14.408309 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c30e23d7-f746-42b7-9e9f-d51625f9410f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:14.410065 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1075/2150] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:48:14 2022] DELETE /identity/v3/projects/d81873d064e1454b91eafec8fb043d2f => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:14.415660 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30638393-43d1-4528-92a4-0a310e578008 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:14.416222 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30638393-43d1-4528-92a4-0a310e578008 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:14.416450 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30638393-43d1-4528-92a4-0a310e578008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:14.438146 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-30638393-43d1-4528-92a4-0a310e578008 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:14.439451 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-30638393-43d1-4528-92a4-0a310e578008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:14.507193 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1076/2151] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:14.516023 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd95cfd-5122-48ab-9235-3f7cd98c68b8 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:14.516630 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd95cfd-5122-48ab-9235-3f7cd98c68b8 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:14.516845 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd95cfd-5122-48ab-9235-3f7cd98c68b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:14.539004 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-fcd95cfd-5122-48ab-9235-3f7cd98c68b8 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:14.540269 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-fcd95cfd-5122-48ab-9235-3f7cd98c68b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:14.548293 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1076/2152] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:14.553607 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30638393-43d1-4528-92a4-0a310e578008 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:14.563177 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30638393-43d1-4528-92a4-0a310e578008 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:14.568804 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f4df7-200a-49f3-a7b8-5b6cdf0e6000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:14.569715 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f4df7-200a-49f3-a7b8-5b6cdf0e6000 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:14.570228 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f4df7-200a-49f3-a7b8-5b6cdf0e6000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:14.570621 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f4df7-200a-49f3-a7b8-5b6cdf0e6000 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:14.571272 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f4df7-200a-49f3-a7b8-5b6cdf0e6000 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:48:14.571572 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f4df7-200a-49f3-a7b8-5b6cdf0e6000 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:14.577547 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f4df7-200a-49f3-a7b8-5b6cdf0e6000 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:14.585407 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1077/2153] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:48:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:48:14.590066 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd95cfd-5122-48ab-9235-3f7cd98c68b8 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:14.600752 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd95cfd-5122-48ab-9235-3f7cd98c68b8 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:14.631133 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fec4ef-568a-4425-88c5-268b3c1cc54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:14.631133 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fec4ef-568a-4425-88c5-268b3c1cc54e admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:14.631133 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fec4ef-568a-4425-88c5-268b3c1cc54e admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:14.631133 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fec4ef-568a-4425-88c5-268b3c1cc54e admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:14.631576 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fec4ef-568a-4425-88c5-268b3c1cc54e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:14.631576 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fec4ef-568a-4425-88c5-268b3c1cc54e admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:14.753049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1077/2154] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:48:14 2022] POST /identity/v3/projects => generated 363 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:48:14.757001 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f4df7-200a-49f3-a7b8-5b6cdf0e6000 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:14.767004 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f4df7-200a-49f3-a7b8-5b6cdf0e6000 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:14.818343 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:14.825075 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb619a4d-0ae1-4b1b-9072-ee7c928a416c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:14.825675 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb619a4d-0ae1-4b1b-9072-ee7c928a416c admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:14.825949 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb619a4d-0ae1-4b1b-9072-ee7c928a416c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:14.826217 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb619a4d-0ae1-4b1b-9072-ee7c928a416c admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:14.826878 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb619a4d-0ae1-4b1b-9072-ee7c928a416c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:14.828830 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb619a4d-0ae1-4b1b-9072-ee7c928a416c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:14.905764 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1078/2155] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:48:14 2022] POST /identity/v3/users => generated 282 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:48:14.911114 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fec4ef-568a-4425-88c5-268b3c1cc54e admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:14.921699 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fec4ef-568a-4425-88c5-268b3c1cc54e admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:14.926477 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2de025-f872-4a87-800e-5dd13deea9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:14.927170 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2de025-f872-4a87-800e-5dd13deea9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:14.927537 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2de025-f872-4a87-800e-5dd13deea9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:14.927812 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2de025-f872-4a87-800e-5dd13deea9e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:14.928502 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2de025-f872-4a87-800e-5dd13deea9e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:14.930178 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2de025-f872-4a87-800e-5dd13deea9e1 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:14.941905 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1078/2156] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:48:14.945662 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb619a4d-0ae1-4b1b-9072-ee7c928a416c admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:14.955827 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb619a4d-0ae1-4b1b-9072-ee7c928a416c admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:14.961051 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b224d-76ee-4b22-9ddc-3671404769a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:14.961666 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b224d-76ee-4b22-9ddc-3671404769a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:14.962049 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b224d-76ee-4b22-9ddc-3671404769a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:14.962320 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b224d-76ee-4b22-9ddc-3671404769a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:14.962944 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b224d-76ee-4b22-9ddc-3671404769a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:14.964594 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b224d-76ee-4b22-9ddc-3671404769a6 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:14.975777 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1079/2157] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:48:14.979982 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2de025-f872-4a87-800e-5dd13deea9e1 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:14.990578 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2de025-f872-4a87-800e-5dd13deea9e1 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:14.995241 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4622f1-e7c0-4acb-b738-219837a6150e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:14.995888 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4622f1-e7c0-4acb-b738-219837a6150e admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:14.996197 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4622f1-e7c0-4acb-b738-219837a6150e admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:14.996473 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4622f1-e7c0-4acb-b738-219837a6150e admin admin] PATH_INFO: `/v3/projects/ab7680b262334dbdb8a7098304d25ee9/users/23b34a8fac394c4f979dfd658c47d211/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:15.011233 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4622f1-e7c0-4acb-b738-219837a6150e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab7680b262334dbdb8a7098304d25ee9, user_id=23b34a8fac394c4f979dfd658c47d211, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:15.014097 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4622f1-e7c0-4acb-b738-219837a6150e admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:15.105808 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1079/2158] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:48:14 2022] PUT /identity/v3/projects/ab7680b262334dbdb8a7098304d25ee9/users/23b34a8fac394c4f979dfd658c47d211/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:15.117796 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce7ffb-daa2-4bd3-9a8d-e5e2d9c42033 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:15.118083 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce7ffb-daa2-4bd3-9a8d-e5e2d9c42033 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:15.118357 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce7ffb-daa2-4bd3-9a8d-e5e2d9c42033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:15.147229 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-11ce7ffb-daa2-4bd3-9a8d-e5e2d9c42033 None None] MFA Rules not processed for user `23b34a8fac394c4f979dfd658c47d211`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:15.151667 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-11ce7ffb-daa2-4bd3-9a8d-e5e2d9c42033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:15.213203 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1080/2159] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:48:15.217847 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4622f1-e7c0-4acb-b738-219837a6150e admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:15.262309 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:15.281624 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4622f1-e7c0-4acb-b738-219837a6150e admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:15.286766 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18a835-006e-4781-b794-d28049d465ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:15.287362 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18a835-006e-4781-b794-d28049d465ef admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:15.287639 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18a835-006e-4781-b794-d28049d465ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:15.287910 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18a835-006e-4781-b794-d28049d465ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:15.288572 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f18a835-006e-4781-b794-d28049d465ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:15.290512 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f18a835-006e-4781-b794-d28049d465ef admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:15.367057 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1080/2160] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:48:15 2022] POST /identity/v3/projects => generated 363 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:48:15.370184 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce7ffb-daa2-4bd3-9a8d-e5e2d9c42033 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:15.380156 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce7ffb-daa2-4bd3-9a8d-e5e2d9c42033 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:15.438530 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ecea12-30fa-410e-936f-33ec0f6c95b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:15.439135 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ecea12-30fa-410e-936f-33ec0f6c95b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:15.439403 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ecea12-30fa-410e-936f-33ec0f6c95b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:15.439675 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ecea12-30fa-410e-936f-33ec0f6c95b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:15.440333 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ecea12-30fa-410e-936f-33ec0f6c95b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:15.442777 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ecea12-30fa-410e-936f-33ec0f6c95b0 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:15.523306 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1081/2161] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:48:15 2022] POST /identity/v3/users => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:48:15.527353 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18a835-006e-4781-b794-d28049d465ef admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:15.538074 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18a835-006e-4781-b794-d28049d465ef admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:15.542509 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c613c2f4-2b9d-4e15-90a6-81ccce05042d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:15.543100 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613c2f4-2b9d-4e15-90a6-81ccce05042d admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:15.543378 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613c2f4-2b9d-4e15-90a6-81ccce05042d admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:15.543649 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613c2f4-2b9d-4e15-90a6-81ccce05042d admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:15.544307 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c613c2f4-2b9d-4e15-90a6-81ccce05042d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:15.545883 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c613c2f4-2b9d-4e15-90a6-81ccce05042d admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:15.556368 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1081/2162] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:48:15.560233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ecea12-30fa-410e-936f-33ec0f6c95b0 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:15.570588 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ecea12-30fa-410e-936f-33ec0f6c95b0 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:15.575362 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab59ce-1640-4198-889b-f6b369efc042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:15.576032 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab59ce-1640-4198-889b-f6b369efc042 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:15.576332 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab59ce-1640-4198-889b-f6b369efc042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:15.576600 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab59ce-1640-4198-889b-f6b369efc042 admin admin] PATH_INFO: `/v3/projects/31e6c7f8e1444807861c5c794494273f/users/eb90710f9d9e42fca41f1cbd1ea40936/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:15.591980 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eab59ce-1640-4198-889b-f6b369efc042 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31e6c7f8e1444807861c5c794494273f, user_id=eb90710f9d9e42fca41f1cbd1ea40936, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:15.594657 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eab59ce-1640-4198-889b-f6b369efc042 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:15.670791 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1082/2163] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:48:15 2022] PUT /identity/v3/projects/31e6c7f8e1444807861c5c794494273f/users/eb90710f9d9e42fca41f1cbd1ea40936/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:15.674730 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c613c2f4-2b9d-4e15-90a6-81ccce05042d admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:15.685287 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c613c2f4-2b9d-4e15-90a6-81ccce05042d admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:15.743116 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f772dc-d063-44cd-b8ca-6596db520a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:15.743747 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f772dc-d063-44cd-b8ca-6596db520a5b admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:15.744023 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f772dc-d063-44cd-b8ca-6596db520a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:15.744321 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f772dc-d063-44cd-b8ca-6596db520a5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:15.744950 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f772dc-d063-44cd-b8ca-6596db520a5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:15.746523 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f772dc-d063-44cd-b8ca-6596db520a5b admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:15.757562 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1082/2164] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:48:15.761835 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab59ce-1640-4198-889b-f6b369efc042 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:15.772147 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab59ce-1640-4198-889b-f6b369efc042 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:15.776795 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ad6fa-032c-4690-b027-094f8b55e316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:15.777439 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ad6fa-032c-4690-b027-094f8b55e316 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:15.777716 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ad6fa-032c-4690-b027-094f8b55e316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:15.777989 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ad6fa-032c-4690-b027-094f8b55e316 admin admin] PATH_INFO: `/v3/projects/31e6c7f8e1444807861c5c794494273f/users/eb90710f9d9e42fca41f1cbd1ea40936/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:15.779893 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ad6fa-032c-4690-b027-094f8b55e316 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31e6c7f8e1444807861c5c794494273f, user_id=eb90710f9d9e42fca41f1cbd1ea40936, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:15.782559 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ad6fa-032c-4690-b027-094f8b55e316 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:15.793252 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1083/2165] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:48:15 2022] PUT /identity/v3/projects/31e6c7f8e1444807861c5c794494273f/users/eb90710f9d9e42fca41f1cbd1ea40936/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:15.803941 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70953381-7332-4513-883d-6176574dff5d None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:15.804256 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70953381-7332-4513-883d-6176574dff5d None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:15.804528 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70953381-7332-4513-883d-6176574dff5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:15.833850 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-70953381-7332-4513-883d-6176574dff5d None None] MFA Rules not processed for user `eb90710f9d9e42fca41f1cbd1ea40936`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:15.835102 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-70953381-7332-4513-883d-6176574dff5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:15.904964 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1083/2166] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:15 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:15.917464 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ad6fa-032c-4690-b027-094f8b55e316 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:15.919163 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-1d2ad6fa-032c-4690-b027-094f8b55e316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:15.938422 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:15.978258 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ad6fa-032c-4690-b027-094f8b55e316 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:15.982482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9a269-24da-43c5-974b-eabfc89d7ec2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:15.983086 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9a269-24da-43c5-974b-eabfc89d7ec2 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:15.983366 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9a269-24da-43c5-974b-eabfc89d7ec2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:15.983634 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9a269-24da-43c5-974b-eabfc89d7ec2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:15.993723 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9a269-24da-43c5-974b-eabfc89d7ec2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:15.995312 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9a269-24da-43c5-974b-eabfc89d7ec2 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:16.005810 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1084/2167] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:15 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:48:16.188584 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70953381-7332-4513-883d-6176574dff5d None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:16.199275 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70953381-7332-4513-883d-6176574dff5d None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:16.203292 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725e0b3-c60f-437b-87b3-192c455cf2db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:16.203535 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725e0b3-c60f-437b-87b3-192c455cf2db service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:16.203812 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725e0b3-c60f-437b-87b3-192c455cf2db service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:16.204115 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725e0b3-c60f-437b-87b3-192c455cf2db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:16.236476 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:16.260863 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7725e0b3-c60f-437b-87b3-192c455cf2db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:16.262284 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7725e0b3-c60f-437b-87b3-192c455cf2db service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:16.272155 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1084/2168] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:48:19.836151 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9a269-24da-43c5-974b-eabfc89d7ec2 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:19.904581 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9a269-24da-43c5-974b-eabfc89d7ec2 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:19.910690 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c224289-0341-484d-a684-bf9ffa542270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:19.911332 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c224289-0341-484d-a684-bf9ffa542270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:19.911606 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c224289-0341-484d-a684-bf9ffa542270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:19.911876 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c224289-0341-484d-a684-bf9ffa542270 admin admin] PATH_INFO: `/v3/users/23b34a8fac394c4f979dfd658c47d211` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:19.913043 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c224289-0341-484d-a684-bf9ffa542270 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23b34a8fac394c4f979dfd658c47d211)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:19.915058 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c224289-0341-484d-a684-bf9ffa542270 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:20.101875 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7c224289-0341-484d-a684-bf9ffa542270 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23b34a8fac394c4f979dfd658c47d211'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:20.113907 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7c224289-0341-484d-a684-bf9ffa542270 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23b34a8fac394c4f979dfd658c47d211'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:20.114601 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7c224289-0341-484d-a684-bf9ffa542270 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23b34a8fac394c4f979dfd658c47d211'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:20.121323 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7c224289-0341-484d-a684-bf9ffa542270 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23b34a8fac394c4f979dfd658c47d211'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:20.121938 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7c224289-0341-484d-a684-bf9ffa542270 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23b34a8fac394c4f979dfd658c47d211'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:20.172711 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1085/2169] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:48:19 2022] DELETE /identity/v3/users/23b34a8fac394c4f979dfd658c47d211 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:20.177838 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894c466-0be4-4cbd-83ac-f744665f53e8 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:20.184705 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894c466-0be4-4cbd-83ac-f744665f53e8 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:20.184705 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894c466-0be4-4cbd-83ac-f744665f53e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:20.197669 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-1894c466-0be4-4cbd-83ac-f744665f53e8 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:20.198939 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-1894c466-0be4-4cbd-83ac-f744665f53e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:20.258306 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1085/2170] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:20.268034 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c224289-0341-484d-a684-bf9ffa542270 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:20.269710 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7c224289-0341-484d-a684-bf9ffa542270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:20.312565 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:20.327880 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c224289-0341-484d-a684-bf9ffa542270 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:20.331751 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d9497-94c4-460b-b1c8-bf2edc6a66d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:20.332659 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d9497-94c4-460b-b1c8-bf2edc6a66d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:20.332952 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d9497-94c4-460b-b1c8-bf2edc6a66d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:20.333302 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d9497-94c4-460b-b1c8-bf2edc6a66d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:20.342354 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d9497-94c4-460b-b1c8-bf2edc6a66d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:20.343897 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d9497-94c4-460b-b1c8-bf2edc6a66d5 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:20.353835 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1086/2171] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:48:20.742443 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1894c466-0be4-4cbd-83ac-f744665f53e8 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:20.743959 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-1894c466-0be4-4cbd-83ac-f744665f53e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:20.756383 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1894c466-0be4-4cbd-83ac-f744665f53e8 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:20.761046 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2429b1b-0b3f-4ab4-ab22-cc4bb1da1200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:20.761678 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2429b1b-0b3f-4ab4-ab22-cc4bb1da1200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:20.761956 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2429b1b-0b3f-4ab4-ab22-cc4bb1da1200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:20.762225 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2429b1b-0b3f-4ab4-ab22-cc4bb1da1200 admin admin] PATH_INFO: `/v3/projects/ab7680b262334dbdb8a7098304d25ee9` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:20.763340 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2429b1b-0b3f-4ab4-ab22-cc4bb1da1200 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab7680b262334dbdb8a7098304d25ee9)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:20.765275 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2429b1b-0b3f-4ab4-ab22-cc4bb1da1200 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:20.885488 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e2429b1b-0b3f-4ab4-ab22-cc4bb1da1200 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab7680b262334dbdb8a7098304d25ee9', 'request_id': 'req-e2429b1b-0b3f-4ab4-ab22-cc4bb1da1200'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:20.896693 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e2429b1b-0b3f-4ab4-ab22-cc4bb1da1200 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab7680b262334dbdb8a7098304d25ee9', 'request_id': 'req-e2429b1b-0b3f-4ab4-ab22-cc4bb1da1200'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:20.902379 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e2429b1b-0b3f-4ab4-ab22-cc4bb1da1200 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab7680b262334dbdb8a7098304d25ee9', 'request_id': 'req-e2429b1b-0b3f-4ab4-ab22-cc4bb1da1200'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:20.956557 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e2429b1b-0b3f-4ab4-ab22-cc4bb1da1200 admin admin] The token cache is being invalidate because project ab7680b262334dbdb8a7098304d25ee9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:48:20.956846 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e2429b1b-0b3f-4ab4-ab22-cc4bb1da1200 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:20.958051 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e2429b1b-0b3f-4ab4-ab22-cc4bb1da1200 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:20.959864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1086/2172] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:48:20 2022] DELETE /identity/v3/projects/ab7680b262334dbdb8a7098304d25ee9 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:20.963864 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d9497-94c4-460b-b1c8-bf2edc6a66d5 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:20.974714 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d9497-94c4-460b-b1c8-bf2edc6a66d5 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:21.041030 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3297e-f169-458f-8b3f-1373af605ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:21.041654 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3297e-f169-458f-8b3f-1373af605ec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:21.041928 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3297e-f169-458f-8b3f-1373af605ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:21.042219 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3297e-f169-458f-8b3f-1373af605ec3 admin admin] PATH_INFO: `/v3/users/eb90710f9d9e42fca41f1cbd1ea40936` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:21.043334 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a3297e-f169-458f-8b3f-1373af605ec3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb90710f9d9e42fca41f1cbd1ea40936)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:21.045296 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a3297e-f169-458f-8b3f-1373af605ec3 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:21.237708 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-40a3297e-f169-458f-8b3f-1373af605ec3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb90710f9d9e42fca41f1cbd1ea40936'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:21.252932 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-40a3297e-f169-458f-8b3f-1373af605ec3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb90710f9d9e42fca41f1cbd1ea40936'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:21.254649 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-40a3297e-f169-458f-8b3f-1373af605ec3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb90710f9d9e42fca41f1cbd1ea40936'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:21.266157 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-40a3297e-f169-458f-8b3f-1373af605ec3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb90710f9d9e42fca41f1cbd1ea40936'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:21.270513 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-40a3297e-f169-458f-8b3f-1373af605ec3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb90710f9d9e42fca41f1cbd1ea40936'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:21.380981 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1087/2173] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:48:20 2022] DELETE /identity/v3/users/eb90710f9d9e42fca41f1cbd1ea40936 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:21.838529 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2429b1b-0b3f-4ab4-ab22-cc4bb1da1200 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:21.840152 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e2429b1b-0b3f-4ab4-ab22-cc4bb1da1200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:21.856112 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2429b1b-0b3f-4ab4-ab22-cc4bb1da1200 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:21.908030 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:21.914670 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89224853-df9a-4a64-b282-3a6acae0cb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:21.915367 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89224853-df9a-4a64-b282-3a6acae0cb0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:21.915639 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89224853-df9a-4a64-b282-3a6acae0cb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:21.915908 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89224853-df9a-4a64-b282-3a6acae0cb0f admin admin] PATH_INFO: `/v3/projects/31e6c7f8e1444807861c5c794494273f` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:21.917045 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89224853-df9a-4a64-b282-3a6acae0cb0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=31e6c7f8e1444807861c5c794494273f)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:21.918923 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89224853-df9a-4a64-b282-3a6acae0cb0f admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:22.042054 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-89224853-df9a-4a64-b282-3a6acae0cb0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31e6c7f8e1444807861c5c794494273f', 'request_id': 'req-89224853-df9a-4a64-b282-3a6acae0cb0f'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:22.048034 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-89224853-df9a-4a64-b282-3a6acae0cb0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31e6c7f8e1444807861c5c794494273f', 'request_id': 'req-89224853-df9a-4a64-b282-3a6acae0cb0f'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:22.053574 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-89224853-df9a-4a64-b282-3a6acae0cb0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31e6c7f8e1444807861c5c794494273f', 'request_id': 'req-89224853-df9a-4a64-b282-3a6acae0cb0f'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:22.138281 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-89224853-df9a-4a64-b282-3a6acae0cb0f admin admin] The token cache is being invalidate because project 31e6c7f8e1444807861c5c794494273f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:48:22.138501 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-89224853-df9a-4a64-b282-3a6acae0cb0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:22.139178 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-89224853-df9a-4a64-b282-3a6acae0cb0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:22.140789 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1087/2174] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:48:21 2022] DELETE /identity/v3/projects/31e6c7f8e1444807861c5c794494273f => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:22.146301 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8402c28-a3e1-469f-aef6-84afa1b6f9d6 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:22.147846 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8402c28-a3e1-469f-aef6-84afa1b6f9d6 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:22.147846 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8402c28-a3e1-469f-aef6-84afa1b6f9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:22.166618 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-c8402c28-a3e1-469f-aef6-84afa1b6f9d6 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:22.167817 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c8402c28-a3e1-469f-aef6-84afa1b6f9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:22.218501 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:22.226960 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1088/2175] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:22.234544 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3929556-6c94-4d08-aecb-335bfe106e86 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:22.234822 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3929556-6c94-4d08-aecb-335bfe106e86 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:22.235090 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3929556-6c94-4d08-aecb-335bfe106e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:22.256365 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-b3929556-6c94-4d08-aecb-335bfe106e86 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:22.257550 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-b3929556-6c94-4d08-aecb-335bfe106e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:22.265901 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1088/2176] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:22.277035 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8402c28-a3e1-469f-aef6-84afa1b6f9d6 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:22.286910 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8402c28-a3e1-469f-aef6-84afa1b6f9d6 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:22.291418 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685eaeb-3024-457d-9088-2d47ba210367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:22.292006 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685eaeb-3024-457d-9088-2d47ba210367 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:22.292326 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685eaeb-3024-457d-9088-2d47ba210367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:22.292808 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685eaeb-3024-457d-9088-2d47ba210367 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:22.293700 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685eaeb-3024-457d-9088-2d47ba210367 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:48:22.294049 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685eaeb-3024-457d-9088-2d47ba210367 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:22.296214 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685eaeb-3024-457d-9088-2d47ba210367 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:22.307890 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1089/2177] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:48:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:48:22.312235 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3929556-6c94-4d08-aecb-335bfe106e86 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:22.321996 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3929556-6c94-4d08-aecb-335bfe106e86 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:22.326733 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521bc879-311a-464b-b36c-124336a52af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:22.327315 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bc879-311a-464b-b36c-124336a52af7 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:22.327588 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bc879-311a-464b-b36c-124336a52af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:22.327855 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bc879-311a-464b-b36c-124336a52af7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:22.328516 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521bc879-311a-464b-b36c-124336a52af7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:22.330364 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521bc879-311a-464b-b36c-124336a52af7 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:22.469715 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1089/2178] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:48:22 2022] POST /identity/v3/projects => generated 381 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:48:22.471036 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685eaeb-3024-457d-9088-2d47ba210367 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:22.481250 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685eaeb-3024-457d-9088-2d47ba210367 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:22.539461 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564d919-99e0-42d2-8c40-3d8cce0d55da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:22.540148 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564d919-99e0-42d2-8c40-3d8cce0d55da admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:22.540432 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564d919-99e0-42d2-8c40-3d8cce0d55da admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:22.540703 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564d919-99e0-42d2-8c40-3d8cce0d55da admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:22.541360 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d564d919-99e0-42d2-8c40-3d8cce0d55da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:22.543333 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d564d919-99e0-42d2-8c40-3d8cce0d55da admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:22.614585 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1090/2179] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:48:22 2022] POST /identity/v3/users => generated 291 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:48:22.618730 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521bc879-311a-464b-b36c-124336a52af7 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:22.629528 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521bc879-311a-464b-b36c-124336a52af7 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:22.634155 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6da89-ab2a-47fc-8a38-8524a7c0d1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:22.636756 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6da89-ab2a-47fc-8a38-8524a7c0d1c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:22.636756 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6da89-ab2a-47fc-8a38-8524a7c0d1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:22.636756 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6da89-ab2a-47fc-8a38-8524a7c0d1c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:22.636756 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6da89-ab2a-47fc-8a38-8524a7c0d1c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:22.637538 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6da89-ab2a-47fc-8a38-8524a7c0d1c5 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:22.647833 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1090/2180] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:48:22.651830 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564d919-99e0-42d2-8c40-3d8cce0d55da admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:22.662110 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564d919-99e0-42d2-8c40-3d8cce0d55da admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:22.666743 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396eef69-9a01-4779-a068-d55e1a7fbc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:22.667336 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396eef69-9a01-4779-a068-d55e1a7fbc13 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:22.667612 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396eef69-9a01-4779-a068-d55e1a7fbc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:22.667887 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396eef69-9a01-4779-a068-d55e1a7fbc13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:22.668550 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396eef69-9a01-4779-a068-d55e1a7fbc13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:22.670157 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396eef69-9a01-4779-a068-d55e1a7fbc13 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:22.681070 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1091/2181] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:48:22.685095 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6da89-ab2a-47fc-8a38-8524a7c0d1c5 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:22.695879 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6da89-ab2a-47fc-8a38-8524a7c0d1c5 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:22.700686 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628dc56e-7fc4-4415-b573-8291ba761ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:22.701355 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628dc56e-7fc4-4415-b573-8291ba761ec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:22.701635 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628dc56e-7fc4-4415-b573-8291ba761ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:22.701909 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628dc56e-7fc4-4415-b573-8291ba761ec4 admin admin] PATH_INFO: `/v3/projects/4a69fd0e45ca41679e5a26b5953c7bde/users/360b2490c7914012927e763be3dcff92/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:22.716308 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628dc56e-7fc4-4415-b573-8291ba761ec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a69fd0e45ca41679e5a26b5953c7bde, user_id=360b2490c7914012927e763be3dcff92, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:22.718952 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628dc56e-7fc4-4415-b573-8291ba761ec4 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:22.815688 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1091/2182] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:48:22 2022] PUT /identity/v3/projects/4a69fd0e45ca41679e5a26b5953c7bde/users/360b2490c7914012927e763be3dcff92/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:22.828083 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55076a-02c7-4bbe-b7d8-8482b4ca451e None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:22.828376 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55076a-02c7-4bbe-b7d8-8482b4ca451e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:22.828838 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55076a-02c7-4bbe-b7d8-8482b4ca451e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:22.870012 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-dc55076a-02c7-4bbe-b7d8-8482b4ca451e None None] MFA Rules not processed for user `360b2490c7914012927e763be3dcff92`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:22.871982 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-dc55076a-02c7-4bbe-b7d8-8482b4ca451e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:22.946636 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1092/2183] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:22.951121 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628dc56e-7fc4-4415-b573-8291ba761ec4 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:23.012573 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628dc56e-7fc4-4415-b573-8291ba761ec4 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:23.017464 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2aaee9-fc99-4ed8-9792-574137041a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:23.018063 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2aaee9-fc99-4ed8-9792-574137041a93 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:23.018343 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2aaee9-fc99-4ed8-9792-574137041a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:23.018609 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2aaee9-fc99-4ed8-9792-574137041a93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:23.019264 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2aaee9-fc99-4ed8-9792-574137041a93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:23.021801 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2aaee9-fc99-4ed8-9792-574137041a93 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:23.143574 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1092/2184] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:48:22 2022] POST /identity/v3/projects => generated 383 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:48:23.144797 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55076a-02c7-4bbe-b7d8-8482b4ca451e None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:23.155965 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55076a-02c7-4bbe-b7d8-8482b4ca451e None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:23.210436 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:23.217364 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b12ebc-254e-4e34-8f87-a1a7d5faa151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:23.217978 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b12ebc-254e-4e34-8f87-a1a7d5faa151 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:23.218259 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b12ebc-254e-4e34-8f87-a1a7d5faa151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:23.218532 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b12ebc-254e-4e34-8f87-a1a7d5faa151 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:23.219330 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b12ebc-254e-4e34-8f87-a1a7d5faa151 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:23.221162 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b12ebc-254e-4e34-8f87-a1a7d5faa151 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:23.303917 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1093/2185] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:48:23 2022] POST /identity/v3/users => generated 298 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:48:23.304995 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2aaee9-fc99-4ed8-9792-574137041a93 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:23.315295 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2aaee9-fc99-4ed8-9792-574137041a93 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:23.320866 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac6b71-78b1-4c3e-afdb-7abc3f08992e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:23.321564 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac6b71-78b1-4c3e-afdb-7abc3f08992e admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:23.321913 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac6b71-78b1-4c3e-afdb-7abc3f08992e admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:23.326694 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac6b71-78b1-4c3e-afdb-7abc3f08992e admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:23.326694 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ac6b71-78b1-4c3e-afdb-7abc3f08992e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:23.326694 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ac6b71-78b1-4c3e-afdb-7abc3f08992e admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:23.326694 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:23.336108 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1093/2186] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:48:23.340348 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b12ebc-254e-4e34-8f87-a1a7d5faa151 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:23.350779 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b12ebc-254e-4e34-8f87-a1a7d5faa151 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:23.355914 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a62a24-e6d8-4d4c-9125-2a0c34fe32ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:23.356605 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a62a24-e6d8-4d4c-9125-2a0c34fe32ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:23.356889 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a62a24-e6d8-4d4c-9125-2a0c34fe32ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:23.357163 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a62a24-e6d8-4d4c-9125-2a0c34fe32ef admin admin] PATH_INFO: `/v3/projects/0df7b05f8847426ca00d35a82a3fd6a9/users/f2cf42a7ef784ff2a9936ddb01812d0b/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:23.373031 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a62a24-e6d8-4d4c-9125-2a0c34fe32ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=0df7b05f8847426ca00d35a82a3fd6a9, user_id=f2cf42a7ef784ff2a9936ddb01812d0b, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:23.375720 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a62a24-e6d8-4d4c-9125-2a0c34fe32ef admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:23.495168 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1094/2187] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:48:23 2022] PUT /identity/v3/projects/0df7b05f8847426ca00d35a82a3fd6a9/users/f2cf42a7ef784ff2a9936ddb01812d0b/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:48:23.499125 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac6b71-78b1-4c3e-afdb-7abc3f08992e admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:23.509474 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac6b71-78b1-4c3e-afdb-7abc3f08992e admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:23.567448 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc968809-a2dc-4640-b7ac-76d245c62cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:23.568101 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc968809-a2dc-4640-b7ac-76d245c62cfb admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:23.568389 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc968809-a2dc-4640-b7ac-76d245c62cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:23.568660 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc968809-a2dc-4640-b7ac-76d245c62cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:23.569291 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc968809-a2dc-4640-b7ac-76d245c62cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:23.570903 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc968809-a2dc-4640-b7ac-76d245c62cfb admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:23.581028 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1094/2188] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:48:23.585295 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a62a24-e6d8-4d4c-9125-2a0c34fe32ef admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:23.595813 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a62a24-e6d8-4d4c-9125-2a0c34fe32ef admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:23.601220 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422b3bd9-1f4a-49e1-ba31-9a44468ee55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:23.601871 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b3bd9-1f4a-49e1-ba31-9a44468ee55f admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:23.602147 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b3bd9-1f4a-49e1-ba31-9a44468ee55f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:23.602416 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b3bd9-1f4a-49e1-ba31-9a44468ee55f admin admin] PATH_INFO: `/v3/projects/0df7b05f8847426ca00d35a82a3fd6a9/users/f2cf42a7ef784ff2a9936ddb01812d0b/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:23.604382 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422b3bd9-1f4a-49e1-ba31-9a44468ee55f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0df7b05f8847426ca00d35a82a3fd6a9, user_id=f2cf42a7ef784ff2a9936ddb01812d0b, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:23.607095 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422b3bd9-1f4a-49e1-ba31-9a44468ee55f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:23.618000 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1095/2189] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:48:23 2022] PUT /identity/v3/projects/0df7b05f8847426ca00d35a82a3fd6a9/users/f2cf42a7ef784ff2a9936ddb01812d0b/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:48:23.628308 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40199824-6d8f-42ec-9836-8c712080ee88 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:23.628598 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40199824-6d8f-42ec-9836-8c712080ee88 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:23.629483 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40199824-6d8f-42ec-9836-8c712080ee88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:23.657783 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-40199824-6d8f-42ec-9836-8c712080ee88 None None] MFA Rules not processed for user `f2cf42a7ef784ff2a9936ddb01812d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:23.658999 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-40199824-6d8f-42ec-9836-8c712080ee88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:23.735999 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1095/2190] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:23 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:23.747447 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422b3bd9-1f4a-49e1-ba31-9a44468ee55f admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:23.749644 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-422b3bd9-1f4a-49e1-ba31-9a44468ee55f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:23.811946 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422b3bd9-1f4a-49e1-ba31-9a44468ee55f admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:23.815592 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea6a5e-1d65-4111-b898-5ebe7b15166c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:23.816780 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea6a5e-1d65-4111-b898-5ebe7b15166c service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:23.817223 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea6a5e-1d65-4111-b898-5ebe7b15166c service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:23.817517 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea6a5e-1d65-4111-b898-5ebe7b15166c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:23.826819 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdea6a5e-1d65-4111-b898-5ebe7b15166c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:23.828346 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdea6a5e-1d65-4111-b898-5ebe7b15166c service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:23.838448 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1096/2191] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:23 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:48:23.967921 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40199824-6d8f-42ec-9836-8c712080ee88 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:23.969411 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-40199824-6d8f-42ec-9836-8c712080ee88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:23.997560 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40199824-6d8f-42ec-9836-8c712080ee88 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:24.009397 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f3262-cf3e-4db7-b5a8-5a8606f75bbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:24.010226 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f3262-cf3e-4db7-b5a8-5a8606f75bbc service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:24.010612 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f3262-cf3e-4db7-b5a8-5a8606f75bbc service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:24.011308 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f3262-cf3e-4db7-b5a8-5a8606f75bbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:24.106276 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f3262-cf3e-4db7-b5a8-5a8606f75bbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:24.107800 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f3262-cf3e-4db7-b5a8-5a8606f75bbc service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:24.118960 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1096/2192] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:23 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:48:27.603106 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea6a5e-1d65-4111-b898-5ebe7b15166c service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:27.677565 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea6a5e-1d65-4111-b898-5ebe7b15166c service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:27.682164 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9d018-7a29-45df-a6fb-7fcebfd9c1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:27.682805 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9d018-7a29-45df-a6fb-7fcebfd9c1f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:27.683081 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9d018-7a29-45df-a6fb-7fcebfd9c1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:27.683350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9d018-7a29-45df-a6fb-7fcebfd9c1f4 admin admin] PATH_INFO: `/v3/users/360b2490c7914012927e763be3dcff92` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:27.684552 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc9d018-7a29-45df-a6fb-7fcebfd9c1f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=360b2490c7914012927e763be3dcff92)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:27.686483 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc9d018-7a29-45df-a6fb-7fcebfd9c1f4 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:27.827606 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bbc9d018-7a29-45df-a6fb-7fcebfd9c1f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '360b2490c7914012927e763be3dcff92'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:27.833469 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:27.841917 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bbc9d018-7a29-45df-a6fb-7fcebfd9c1f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '360b2490c7914012927e763be3dcff92'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:27.842612 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bbc9d018-7a29-45df-a6fb-7fcebfd9c1f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '360b2490c7914012927e763be3dcff92'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:27.850332 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bbc9d018-7a29-45df-a6fb-7fcebfd9c1f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '360b2490c7914012927e763be3dcff92'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:27.851020 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bbc9d018-7a29-45df-a6fb-7fcebfd9c1f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '360b2490c7914012927e763be3dcff92'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:27.927834 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1097/2193] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:48:27 2022] DELETE /identity/v3/users/360b2490c7914012927e763be3dcff92 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:27.932669 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b3407-e779-43cb-8309-e7d2fea1f2a3 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:27.933185 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b3407-e779-43cb-8309-e7d2fea1f2a3 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:27.933284 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b3407-e779-43cb-8309-e7d2fea1f2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:27.952984 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-255b3407-e779-43cb-8309-e7d2fea1f2a3 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:27.954209 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-255b3407-e779-43cb-8309-e7d2fea1f2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:27.966200 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:28.012173 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1097/2194] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:28.022738 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9d018-7a29-45df-a6fb-7fcebfd9c1f4 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:28.024299 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-bbc9d018-7a29-45df-a6fb-7fcebfd9c1f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:28.084402 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9d018-7a29-45df-a6fb-7fcebfd9c1f4 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:28.088394 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2645fea-41b6-4976-87d1-8fa517d3e606 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:28.088999 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2645fea-41b6-4976-87d1-8fa517d3e606 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:28.089276 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2645fea-41b6-4976-87d1-8fa517d3e606 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:28.089545 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2645fea-41b6-4976-87d1-8fa517d3e606 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:28.099715 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2645fea-41b6-4976-87d1-8fa517d3e606 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:28.101199 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2645fea-41b6-4976-87d1-8fa517d3e606 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:28.111949 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1098/2195] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:48:28.553016 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b3407-e779-43cb-8309-e7d2fea1f2a3 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:28.559165 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-255b3407-e779-43cb-8309-e7d2fea1f2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:28.567811 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b3407-e779-43cb-8309-e7d2fea1f2a3 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:28.572680 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da00808-0412-4ea3-9a59-57fb1a212f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:28.573536 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da00808-0412-4ea3-9a59-57fb1a212f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:28.573819 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da00808-0412-4ea3-9a59-57fb1a212f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:28.574089 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da00808-0412-4ea3-9a59-57fb1a212f25 admin admin] PATH_INFO: `/v3/projects/4a69fd0e45ca41679e5a26b5953c7bde` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:28.575207 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da00808-0412-4ea3-9a59-57fb1a212f25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a69fd0e45ca41679e5a26b5953c7bde)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:28.577140 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da00808-0412-4ea3-9a59-57fb1a212f25 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:28.727719 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-5da00808-0412-4ea3-9a59-57fb1a212f25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a69fd0e45ca41679e5a26b5953c7bde', 'request_id': 'req-5da00808-0412-4ea3-9a59-57fb1a212f25'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:28.734418 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-5da00808-0412-4ea3-9a59-57fb1a212f25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a69fd0e45ca41679e5a26b5953c7bde', 'request_id': 'req-5da00808-0412-4ea3-9a59-57fb1a212f25'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:28.744459 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-5da00808-0412-4ea3-9a59-57fb1a212f25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a69fd0e45ca41679e5a26b5953c7bde', 'request_id': 'req-5da00808-0412-4ea3-9a59-57fb1a212f25'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:28.766310 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2645fea-41b6-4976-87d1-8fa517d3e606 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:28.774879 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2645fea-41b6-4976-87d1-8fa517d3e606 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:28.827770 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f2b62-baa0-407c-b2bb-f60bfaca32af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:28.828407 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f2b62-baa0-407c-b2bb-f60bfaca32af service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:28.828685 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f2b62-baa0-407c-b2bb-f60bfaca32af service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:28.828954 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f2b62-baa0-407c-b2bb-f60bfaca32af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:28.830425 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-5da00808-0412-4ea3-9a59-57fb1a212f25 admin admin] The token cache is being invalidate because project 4a69fd0e45ca41679e5a26b5953c7bde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:48:28.830671 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ab1f2b62-baa0-407c-b2bb-f60bfaca32af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:28.830795 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-5da00808-0412-4ea3-9a59-57fb1a212f25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:28.831342 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-5da00808-0412-4ea3-9a59-57fb1a212f25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:28.833448 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1098/2196] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:48:28 2022] DELETE /identity/v3/projects/4a69fd0e45ca41679e5a26b5953c7bde => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:28.837413 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da00808-0412-4ea3-9a59-57fb1a212f25 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:28.838796 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-5da00808-0412-4ea3-9a59-57fb1a212f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:28.899020 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f2b62-baa0-407c-b2bb-f60bfaca32af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:28.900496 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f2b62-baa0-407c-b2bb-f60bfaca32af service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:28.908773 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da00808-0412-4ea3-9a59-57fb1a212f25 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:28.911052 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1099/2197] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:48:28.913890 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6aa24-7758-4d34-abb8-51292ad66a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:28.914529 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6aa24-7758-4d34-abb8-51292ad66a89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:28.915013 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6aa24-7758-4d34-abb8-51292ad66a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:28.915224 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6aa24-7758-4d34-abb8-51292ad66a89 admin admin] PATH_INFO: `/v3/users/f2cf42a7ef784ff2a9936ddb01812d0b` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:28.916382 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e6aa24-7758-4d34-abb8-51292ad66a89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2cf42a7ef784ff2a9936ddb01812d0b)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:28.918311 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e6aa24-7758-4d34-abb8-51292ad66a89 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:29.099921 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:29.102647 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-04e6aa24-7758-4d34-abb8-51292ad66a89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2cf42a7ef784ff2a9936ddb01812d0b'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:29.115177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-04e6aa24-7758-4d34-abb8-51292ad66a89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2cf42a7ef784ff2a9936ddb01812d0b'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:29.122557 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-04e6aa24-7758-4d34-abb8-51292ad66a89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2cf42a7ef784ff2a9936ddb01812d0b'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:29.123515 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-04e6aa24-7758-4d34-abb8-51292ad66a89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2cf42a7ef784ff2a9936ddb01812d0b'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:29.124164 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-04e6aa24-7758-4d34-abb8-51292ad66a89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2cf42a7ef784ff2a9936ddb01812d0b'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:29.214153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1099/2198] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:48:28 2022] DELETE /identity/v3/users/f2cf42a7ef784ff2a9936ddb01812d0b => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:48:29.759032 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f2b62-baa0-407c-b2bb-f60bfaca32af service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:29.767678 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f2b62-baa0-407c-b2bb-f60bfaca32af service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:29.789260 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:29.830256 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b850f-ce97-425a-af8b-59a6c9f813e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:29.830891 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b850f-ce97-425a-af8b-59a6c9f813e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:29.831162 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b850f-ce97-425a-af8b-59a6c9f813e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:29.831431 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b850f-ce97-425a-af8b-59a6c9f813e9 admin admin] PATH_INFO: `/v3/projects/0df7b05f8847426ca00d35a82a3fd6a9` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:29.833134 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b850f-ce97-425a-af8b-59a6c9f813e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0df7b05f8847426ca00d35a82a3fd6a9)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:29.835139 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b850f-ce97-425a-af8b-59a6c9f813e9 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:29.924387 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-183b850f-ce97-425a-af8b-59a6c9f813e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0df7b05f8847426ca00d35a82a3fd6a9', 'request_id': 'req-183b850f-ce97-425a-af8b-59a6c9f813e9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:29.937615 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-183b850f-ce97-425a-af8b-59a6c9f813e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0df7b05f8847426ca00d35a82a3fd6a9', 'request_id': 'req-183b850f-ce97-425a-af8b-59a6c9f813e9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:29.948520 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-183b850f-ce97-425a-af8b-59a6c9f813e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0df7b05f8847426ca00d35a82a3fd6a9', 'request_id': 'req-183b850f-ce97-425a-af8b-59a6c9f813e9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:30.019637 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-183b850f-ce97-425a-af8b-59a6c9f813e9 admin admin] The token cache is being invalidate because project 0df7b05f8847426ca00d35a82a3fd6a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:48:30.020003 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-183b850f-ce97-425a-af8b-59a6c9f813e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:30.022163 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-183b850f-ce97-425a-af8b-59a6c9f813e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:30.025641 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1100/2199] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:48:29 2022] DELETE /identity/v3/projects/0df7b05f8847426ca00d35a82a3fd6a9 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:30.027298 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45e8e4-3282-4687-870b-199fd42048a8 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:30.027587 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45e8e4-3282-4687-870b-199fd42048a8 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:30.027911 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45e8e4-3282-4687-870b-199fd42048a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:30.052145 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-be45e8e4-3282-4687-870b-199fd42048a8 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:30.053383 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-be45e8e4-3282-4687-870b-199fd42048a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:30.123460 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1100/2200] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:48:30.126679 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368e8b0-82aa-4186-bfee-bab9458e8dbe None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:30.126968 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368e8b0-82aa-4186-bfee-bab9458e8dbe None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:30.127235 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368e8b0-82aa-4186-bfee-bab9458e8dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:30.147905 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-7368e8b0-82aa-4186-bfee-bab9458e8dbe None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:30.149143 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7368e8b0-82aa-4186-bfee-bab9458e8dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:30.157624 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1101/2201] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:30.162307 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45e8e4-3282-4687-870b-199fd42048a8 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:30.172925 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45e8e4-3282-4687-870b-199fd42048a8 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:30.178198 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e03cc7-5a54-494e-a64d-b5abad97757b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:30.178831 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e03cc7-5a54-494e-a64d-b5abad97757b admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:30.179110 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e03cc7-5a54-494e-a64d-b5abad97757b admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:30.179384 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e03cc7-5a54-494e-a64d-b5abad97757b admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:30.180073 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e03cc7-5a54-494e-a64d-b5abad97757b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:48:30.180376 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e03cc7-5a54-494e-a64d-b5abad97757b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:30.182041 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e03cc7-5a54-494e-a64d-b5abad97757b admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:30.196526 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1101/2202] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:48:30.200791 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368e8b0-82aa-4186-bfee-bab9458e8dbe None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:30.212074 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368e8b0-82aa-4186-bfee-bab9458e8dbe None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:30.217197 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7ffbd-a2d6-4d1d-808d-1cdbe0415525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:30.219135 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7ffbd-a2d6-4d1d-808d-1cdbe0415525 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:30.219564 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7ffbd-a2d6-4d1d-808d-1cdbe0415525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:30.219845 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7ffbd-a2d6-4d1d-808d-1cdbe0415525 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:30.220712 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e7ffbd-a2d6-4d1d-808d-1cdbe0415525 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:30.222813 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e7ffbd-a2d6-4d1d-808d-1cdbe0415525 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:30.354409 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1102/2203] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:48:30 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:48:30.358358 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e03cc7-5a54-494e-a64d-b5abad97757b admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:30.369277 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e03cc7-5a54-494e-a64d-b5abad97757b admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:30.439397 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c7181-21c5-4ac5-970e-7603fb7753a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:30.440018 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c7181-21c5-4ac5-970e-7603fb7753a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:30.440413 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c7181-21c5-4ac5-970e-7603fb7753a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:30.440760 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c7181-21c5-4ac5-970e-7603fb7753a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:30.442204 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c7181-21c5-4ac5-970e-7603fb7753a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:30.444361 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c7181-21c5-4ac5-970e-7603fb7753a8 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:30.578048 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1102/2204] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:48:30 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:48:30.579281 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7ffbd-a2d6-4d1d-808d-1cdbe0415525 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:30.590530 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7ffbd-a2d6-4d1d-808d-1cdbe0415525 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:30.597442 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835bf8b-efb4-410a-8a1f-49b1eaef957f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:30.598089 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835bf8b-efb4-410a-8a1f-49b1eaef957f admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:30.598403 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835bf8b-efb4-410a-8a1f-49b1eaef957f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:30.598630 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835bf8b-efb4-410a-8a1f-49b1eaef957f admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:30.599277 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3835bf8b-efb4-410a-8a1f-49b1eaef957f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:30.601010 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3835bf8b-efb4-410a-8a1f-49b1eaef957f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:30.620096 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1103/2205] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:48:30.623065 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c7181-21c5-4ac5-970e-7603fb7753a8 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:30.635884 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c7181-21c5-4ac5-970e-7603fb7753a8 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:30.641615 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674b947-b99d-4a71-82dd-1435cbfc1d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:30.642744 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674b947-b99d-4a71-82dd-1435cbfc1d75 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:30.642744 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674b947-b99d-4a71-82dd-1435cbfc1d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:30.642958 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674b947-b99d-4a71-82dd-1435cbfc1d75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:30.643640 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674b947-b99d-4a71-82dd-1435cbfc1d75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:30.646053 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674b947-b99d-4a71-82dd-1435cbfc1d75 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:30.659274 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1103/2206] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:48:30.663508 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835bf8b-efb4-410a-8a1f-49b1eaef957f admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:30.681347 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835bf8b-efb4-410a-8a1f-49b1eaef957f admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:30.687494 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e81b6-0b9f-45ec-86eb-50faf1d7f7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:30.688818 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e81b6-0b9f-45ec-86eb-50faf1d7f7ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:30.689249 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e81b6-0b9f-45ec-86eb-50faf1d7f7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:30.690811 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e81b6-0b9f-45ec-86eb-50faf1d7f7ba admin admin] PATH_INFO: `/v3/projects/7e13f3ad26e74b84b4f7e5c32c9071bd/users/537d2b47eea24292bf9f65e5ccbf251d/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:30.721195 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e81b6-0b9f-45ec-86eb-50faf1d7f7ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e13f3ad26e74b84b4f7e5c32c9071bd, user_id=537d2b47eea24292bf9f65e5ccbf251d, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:30.726130 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e81b6-0b9f-45ec-86eb-50faf1d7f7ba admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:30.821132 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1104/2207] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:48:30 2022] PUT /identity/v3/projects/7e13f3ad26e74b84b4f7e5c32c9071bd/users/537d2b47eea24292bf9f65e5ccbf251d/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:30.834120 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4f3c1-c3fa-40ca-8c44-ebcace0076b9 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:30.834646 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4f3c1-c3fa-40ca-8c44-ebcace0076b9 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:30.834969 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4f3c1-c3fa-40ca-8c44-ebcace0076b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:30.874413 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-48a4f3c1-c3fa-40ca-8c44-ebcace0076b9 None None] MFA Rules not processed for user `537d2b47eea24292bf9f65e5ccbf251d`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:30.875709 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-48a4f3c1-c3fa-40ca-8c44-ebcace0076b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:30.895847 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:30.982833 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1104/2208] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:30.987733 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e81b6-0b9f-45ec-86eb-50faf1d7f7ba admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:31.049923 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:31.064151 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e81b6-0b9f-45ec-86eb-50faf1d7f7ba admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:31.070348 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f923d-3cdd-4a80-9965-610837169a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:31.070900 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f923d-3cdd-4a80-9965-610837169a45 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:31.071182 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f923d-3cdd-4a80-9965-610837169a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:31.071511 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f923d-3cdd-4a80-9965-610837169a45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:31.072112 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f923d-3cdd-4a80-9965-610837169a45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:31.074102 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f923d-3cdd-4a80-9965-610837169a45 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:31.162372 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1105/2209] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:48:30 2022] POST /identity/v3/projects => generated 385 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:48:31.163883 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4f3c1-c3fa-40ca-8c44-ebcace0076b9 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:31.174913 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4f3c1-c3fa-40ca-8c44-ebcace0076b9 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:31.247219 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57586f29-ae43-49c1-8197-951f17cdbd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:31.247946 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57586f29-ae43-49c1-8197-951f17cdbd78 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:31.248324 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57586f29-ae43-49c1-8197-951f17cdbd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:31.248669 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57586f29-ae43-49c1-8197-951f17cdbd78 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:31.249373 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57586f29-ae43-49c1-8197-951f17cdbd78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:31.251426 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57586f29-ae43-49c1-8197-951f17cdbd78 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:31.363009 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1105/2210] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:48:31 2022] POST /identity/v3/users => generated 299 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:48:31.367087 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f923d-3cdd-4a80-9965-610837169a45 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:31.377883 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f923d-3cdd-4a80-9965-610837169a45 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:31.382768 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643ca74-aba4-45fd-ba8b-7ac38c897ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:31.383382 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643ca74-aba4-45fd-ba8b-7ac38c897ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:31.383800 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643ca74-aba4-45fd-ba8b-7ac38c897ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:31.384093 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643ca74-aba4-45fd-ba8b-7ac38c897ba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:31.384782 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6643ca74-aba4-45fd-ba8b-7ac38c897ba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:31.386408 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6643ca74-aba4-45fd-ba8b-7ac38c897ba9 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:31.398323 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1106/2211] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:48:31.402453 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57586f29-ae43-49c1-8197-951f17cdbd78 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:31.413686 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57586f29-ae43-49c1-8197-951f17cdbd78 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:31.418527 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdfef89-b1ae-482c-9b03-c72b1e1e693e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:31.419209 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdfef89-b1ae-482c-9b03-c72b1e1e693e admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:31.419484 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdfef89-b1ae-482c-9b03-c72b1e1e693e admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:31.419752 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdfef89-b1ae-482c-9b03-c72b1e1e693e admin admin] PATH_INFO: `/v3/projects/da18f515b7f945029b82a930a3b2b290/users/729b9bfdcc6c45149863c945a6d86ed3/roles/9252c356af254127896f3626d925a88a` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:31.438727 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdfef89-b1ae-482c-9b03-c72b1e1e693e admin admin] RBAC: Authorizing `identity:create_grant(project_id=da18f515b7f945029b82a930a3b2b290, user_id=729b9bfdcc6c45149863c945a6d86ed3, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:31.441979 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdfef89-b1ae-482c-9b03-c72b1e1e693e admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:31.525632 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1106/2212] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:48:31 2022] PUT /identity/v3/projects/da18f515b7f945029b82a930a3b2b290/users/729b9bfdcc6c45149863c945a6d86ed3/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:31.529174 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643ca74-aba4-45fd-ba8b-7ac38c897ba9 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:31.540008 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643ca74-aba4-45fd-ba8b-7ac38c897ba9 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:31.601912 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964e0d8-c6d7-412e-b122-734a9f723093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:31.602518 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964e0d8-c6d7-412e-b122-734a9f723093 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:31.602793 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964e0d8-c6d7-412e-b122-734a9f723093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:31.603061 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964e0d8-c6d7-412e-b122-734a9f723093 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:31.603694 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964e0d8-c6d7-412e-b122-734a9f723093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:31.605325 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964e0d8-c6d7-412e-b122-734a9f723093 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:31.616118 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1107/2213] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:48:31.620286 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdfef89-b1ae-482c-9b03-c72b1e1e693e admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:31.630840 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdfef89-b1ae-482c-9b03-c72b1e1e693e admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:31.635529 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421a5ed-2ef6-490b-b384-fe0cdd5b45cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:31.636232 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421a5ed-2ef6-490b-b384-fe0cdd5b45cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:31.636509 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421a5ed-2ef6-490b-b384-fe0cdd5b45cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:31.636800 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421a5ed-2ef6-490b-b384-fe0cdd5b45cd admin admin] PATH_INFO: `/v3/projects/da18f515b7f945029b82a930a3b2b290/users/729b9bfdcc6c45149863c945a6d86ed3/roles/9252c356af254127896f3626d925a88a` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:31.638685 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421a5ed-2ef6-490b-b384-fe0cdd5b45cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=da18f515b7f945029b82a930a3b2b290, user_id=729b9bfdcc6c45149863c945a6d86ed3, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:31.641383 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421a5ed-2ef6-490b-b384-fe0cdd5b45cd admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:31.653323 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1107/2214] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:48:31 2022] PUT /identity/v3/projects/da18f515b7f945029b82a930a3b2b290/users/729b9bfdcc6c45149863c945a6d86ed3/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:31.664653 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b62221-1287-422e-b8f9-33212f6a8b85 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:31.664977 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b62221-1287-422e-b8f9-33212f6a8b85 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:31.665296 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b62221-1287-422e-b8f9-33212f6a8b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:31.692833 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-37b62221-1287-422e-b8f9-33212f6a8b85 None None] MFA Rules not processed for user `729b9bfdcc6c45149863c945a6d86ed3`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:31.694043 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-37b62221-1287-422e-b8f9-33212f6a8b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:31.771754 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1108/2215] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:31 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:31.779887 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421a5ed-2ef6-490b-b384-fe0cdd5b45cd admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:31.781615 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-0421a5ed-2ef6-490b-b384-fe0cdd5b45cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:31.845487 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421a5ed-2ef6-490b-b384-fe0cdd5b45cd admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:31.849367 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd83626-a6f6-4a11-b3d8-3f5c02959161 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:31.849967 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd83626-a6f6-4a11-b3d8-3f5c02959161 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:31.850242 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd83626-a6f6-4a11-b3d8-3f5c02959161 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:31.850509 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd83626-a6f6-4a11-b3d8-3f5c02959161 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:31.874604 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:31.931732 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd83626-a6f6-4a11-b3d8-3f5c02959161 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:31.933272 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd83626-a6f6-4a11-b3d8-3f5c02959161 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:31.949335 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1108/2216] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:48:32.912172 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b62221-1287-422e-b8f9-33212f6a8b85 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:32.913709 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-37b62221-1287-422e-b8f9-33212f6a8b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:32.968338 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:32.987670 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b62221-1287-422e-b8f9-33212f6a8b85 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:32.993825 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda10a8a-8e8c-42cf-bba4-e57662d9c222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:32.994456 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda10a8a-8e8c-42cf-bba4-e57662d9c222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:32.994731 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda10a8a-8e8c-42cf-bba4-e57662d9c222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:32.995002 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda10a8a-8e8c-42cf-bba4-e57662d9c222 admin admin] PATH_INFO: `/v3/users/6fc9296c011d4712949ec015ea157762` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:32.996149 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda10a8a-8e8c-42cf-bba4-e57662d9c222 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fc9296c011d4712949ec015ea157762)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:32.998071 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda10a8a-8e8c-42cf-bba4-e57662d9c222 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:33.135919 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-dda10a8a-8e8c-42cf-bba4-e57662d9c222 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fc9296c011d4712949ec015ea157762'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:33.149162 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-dda10a8a-8e8c-42cf-bba4-e57662d9c222 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fc9296c011d4712949ec015ea157762'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:33.149796 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-dda10a8a-8e8c-42cf-bba4-e57662d9c222 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fc9296c011d4712949ec015ea157762'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:33.156974 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-dda10a8a-8e8c-42cf-bba4-e57662d9c222 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fc9296c011d4712949ec015ea157762'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:33.157605 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-dda10a8a-8e8c-42cf-bba4-e57662d9c222 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fc9296c011d4712949ec015ea157762'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:33.219514 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1109/2217] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:48:32 2022] DELETE /identity/v3/users/6fc9296c011d4712949ec015ea157762 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:33.438706 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd83626-a6f6-4a11-b3d8-3f5c02959161 service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:33.450754 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd83626-a6f6-4a11-b3d8-3f5c02959161 service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:33.510283 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6afa43b-b2fd-43eb-809d-52ff37e7d5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:33.510907 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6afa43b-b2fd-43eb-809d-52ff37e7d5a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:33.511183 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6afa43b-b2fd-43eb-809d-52ff37e7d5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:33.511453 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6afa43b-b2fd-43eb-809d-52ff37e7d5a5 admin admin] PATH_INFO: `/v3/projects/cdb70b80b9ca4a0591db934554861702` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:33.512587 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6afa43b-b2fd-43eb-809d-52ff37e7d5a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdb70b80b9ca4a0591db934554861702)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:33.514533 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6afa43b-b2fd-43eb-809d-52ff37e7d5a5 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:33.624470 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f6afa43b-b2fd-43eb-809d-52ff37e7d5a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdb70b80b9ca4a0591db934554861702', 'request_id': 'req-f6afa43b-b2fd-43eb-809d-52ff37e7d5a5'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:33.631161 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f6afa43b-b2fd-43eb-809d-52ff37e7d5a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdb70b80b9ca4a0591db934554861702', 'request_id': 'req-f6afa43b-b2fd-43eb-809d-52ff37e7d5a5'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:33.636702 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f6afa43b-b2fd-43eb-809d-52ff37e7d5a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdb70b80b9ca4a0591db934554861702', 'request_id': 'req-f6afa43b-b2fd-43eb-809d-52ff37e7d5a5'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:33.715727 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f6afa43b-b2fd-43eb-809d-52ff37e7d5a5 admin admin] The token cache is being invalidate because project cdb70b80b9ca4a0591db934554861702 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:48:33.716030 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f6afa43b-b2fd-43eb-809d-52ff37e7d5a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:33.716797 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f6afa43b-b2fd-43eb-809d-52ff37e7d5a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:33.718293 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1109/2218] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:48:33 2022] DELETE /identity/v3/projects/cdb70b80b9ca4a0591db934554861702 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:33.723181 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7b913-548f-4d9a-b551-3c935735bf5d None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:33.723469 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7b913-548f-4d9a-b551-3c935735bf5d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:33.723744 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7b913-548f-4d9a-b551-3c935735bf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:33.749904 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-3ec7b913-548f-4d9a-b551-3c935735bf5d None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:33.751096 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3ec7b913-548f-4d9a-b551-3c935735bf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:33.810767 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1110/2219] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:33.819127 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990cccb-f7ae-4c13-a248-185866a1af0d None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:33.819409 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990cccb-f7ae-4c13-a248-185866a1af0d None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:33.819674 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990cccb-f7ae-4c13-a248-185866a1af0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:33.839287 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-5990cccb-f7ae-4c13-a248-185866a1af0d None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:33.840517 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-5990cccb-f7ae-4c13-a248-185866a1af0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:33.848449 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1110/2220] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:33.852761 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7b913-548f-4d9a-b551-3c935735bf5d None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:33.862130 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7b913-548f-4d9a-b551-3c935735bf5d None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:33.867495 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a410e-c45b-4dfc-b555-d6b9184288db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:33.868113 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a410e-c45b-4dfc-b555-d6b9184288db admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:33.868391 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a410e-c45b-4dfc-b555-d6b9184288db admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:33.868655 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a410e-c45b-4dfc-b555-d6b9184288db admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:33.869287 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a410e-c45b-4dfc-b555-d6b9184288db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:48:33.869583 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a410e-c45b-4dfc-b555-d6b9184288db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:33.871438 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a410e-c45b-4dfc-b555-d6b9184288db admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:33.883431 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1111/2221] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:48:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:48:33.887871 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990cccb-f7ae-4c13-a248-185866a1af0d None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:33.897876 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990cccb-f7ae-4c13-a248-185866a1af0d None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:33.902880 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa5f7b-d56a-46ba-aae2-bf876d727564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:33.904146 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa5f7b-d56a-46ba-aae2-bf876d727564 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:33.904146 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa5f7b-d56a-46ba-aae2-bf876d727564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:33.904146 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa5f7b-d56a-46ba-aae2-bf876d727564 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:33.904697 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa5f7b-d56a-46ba-aae2-bf876d727564 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:33.906565 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa5f7b-d56a-46ba-aae2-bf876d727564 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:34.014911 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1111/2222] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:48:33 2022] POST /identity/v3/projects => generated 355 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:48:34.019150 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a410e-c45b-4dfc-b555-d6b9184288db admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:34.029205 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a410e-c45b-4dfc-b555-d6b9184288db admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:34.077721 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:34.087553 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919d14b-6f1b-4936-8d3a-d9bda7a767d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:34.088195 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919d14b-6f1b-4936-8d3a-d9bda7a767d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:34.088474 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919d14b-6f1b-4936-8d3a-d9bda7a767d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:34.088744 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919d14b-6f1b-4936-8d3a-d9bda7a767d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:34.089371 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919d14b-6f1b-4936-8d3a-d9bda7a767d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:34.091336 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919d14b-6f1b-4936-8d3a-d9bda7a767d7 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:34.188653 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1112/2223] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:48:34 2022] POST /identity/v3/users => generated 278 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:48:34.189820 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa5f7b-d56a-46ba-aae2-bf876d727564 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:34.208114 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa5f7b-d56a-46ba-aae2-bf876d727564 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:34.212942 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9324d-8aa6-48d3-9bf7-60ef6184244c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:34.213543 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9324d-8aa6-48d3-9bf7-60ef6184244c admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:34.214940 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9324d-8aa6-48d3-9bf7-60ef6184244c admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:34.214940 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9324d-8aa6-48d3-9bf7-60ef6184244c admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:34.214940 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb9324d-8aa6-48d3-9bf7-60ef6184244c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:34.216354 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb9324d-8aa6-48d3-9bf7-60ef6184244c admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:34.230659 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1112/2224] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:48:34.232396 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919d14b-6f1b-4936-8d3a-d9bda7a767d7 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:34.243081 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919d14b-6f1b-4936-8d3a-d9bda7a767d7 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:34.248243 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3060c89-e7ad-4548-93dd-62a07ad71357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:34.254077 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3060c89-e7ad-4548-93dd-62a07ad71357 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:34.254077 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3060c89-e7ad-4548-93dd-62a07ad71357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:34.254077 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3060c89-e7ad-4548-93dd-62a07ad71357 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:34.254077 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3060c89-e7ad-4548-93dd-62a07ad71357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:34.254077 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3060c89-e7ad-4548-93dd-62a07ad71357 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:34.263015 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1113/2225] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:48:34.277339 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9324d-8aa6-48d3-9bf7-60ef6184244c admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:34.291611 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9324d-8aa6-48d3-9bf7-60ef6184244c admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:34.291611 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472759f0-b468-4a08-95e6-679d263d1a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:34.291611 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472759f0-b468-4a08-95e6-679d263d1a7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:34.291611 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472759f0-b468-4a08-95e6-679d263d1a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:34.292090 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472759f0-b468-4a08-95e6-679d263d1a7a admin admin] PATH_INFO: `/v3/projects/bd39937c048a43e692dabcdb16588955/users/86a1d56f59e14c999421b7199c9877d4/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:34.309464 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:34.315948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472759f0-b468-4a08-95e6-679d263d1a7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd39937c048a43e692dabcdb16588955, user_id=86a1d56f59e14c999421b7199c9877d4, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:34.318844 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472759f0-b468-4a08-95e6-679d263d1a7a admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:34.427763 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1113/2226] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:48:34 2022] PUT /identity/v3/projects/bd39937c048a43e692dabcdb16588955/users/86a1d56f59e14c999421b7199c9877d4/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:34.439613 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04d80c-5430-4f01-b6d7-c5148712383e None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:34.439971 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04d80c-5430-4f01-b6d7-c5148712383e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:34.440274 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04d80c-5430-4f01-b6d7-c5148712383e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:34.473401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-9b04d80c-5430-4f01-b6d7-c5148712383e None None] MFA Rules not processed for user `86a1d56f59e14c999421b7199c9877d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:34.474358 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9b04d80c-5430-4f01-b6d7-c5148712383e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:34.540893 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1114/2227] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:34 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:34.550480 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472759f0-b468-4a08-95e6-679d263d1a7a admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:34.611485 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472759f0-b468-4a08-95e6-679d263d1a7a admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:34.617011 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897651af-a5f2-4c92-a25a-d1e3229c146d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:34.617610 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897651af-a5f2-4c92-a25a-d1e3229c146d admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:34.617890 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897651af-a5f2-4c92-a25a-d1e3229c146d admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:34.618163 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897651af-a5f2-4c92-a25a-d1e3229c146d admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:34.618791 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897651af-a5f2-4c92-a25a-d1e3229c146d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:34.620721 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897651af-a5f2-4c92-a25a-d1e3229c146d admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:34.717432 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1114/2228] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:48:34 2022] POST /identity/v3/projects => generated 357 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:48:34.721600 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04d80c-5430-4f01-b6d7-c5148712383e None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:34.733336 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04d80c-5430-4f01-b6d7-c5148712383e None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:34.791271 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6972e5d-fac9-469d-9b3e-d5402307b45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:34.791863 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6972e5d-fac9-469d-9b3e-d5402307b45a admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:34.792246 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6972e5d-fac9-469d-9b3e-d5402307b45a admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:34.792517 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6972e5d-fac9-469d-9b3e-d5402307b45a admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:34.793144 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6972e5d-fac9-469d-9b3e-d5402307b45a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:34.795473 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6972e5d-fac9-469d-9b3e-d5402307b45a admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:34.861781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1115/2229] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:48:34 2022] POST /identity/v3/users => generated 285 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:48:34.866657 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897651af-a5f2-4c92-a25a-d1e3229c146d admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:34.876984 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897651af-a5f2-4c92-a25a-d1e3229c146d admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:34.881846 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab3e35-b16e-45f9-b785-81274fb33eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:34.882441 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab3e35-b16e-45f9-b785-81274fb33eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:34.882726 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab3e35-b16e-45f9-b785-81274fb33eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:34.882997 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab3e35-b16e-45f9-b785-81274fb33eb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:34.883628 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab3e35-b16e-45f9-b785-81274fb33eb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:34.885241 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab3e35-b16e-45f9-b785-81274fb33eb9 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:34.895601 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1115/2230] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:48:34.900202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6972e5d-fac9-469d-9b3e-d5402307b45a admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:34.911823 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6972e5d-fac9-469d-9b3e-d5402307b45a admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:34.916651 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266750f3-97d0-4134-a5be-d7a1b795cabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:34.917412 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266750f3-97d0-4134-a5be-d7a1b795cabf admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:34.917696 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266750f3-97d0-4134-a5be-d7a1b795cabf admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:34.917971 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266750f3-97d0-4134-a5be-d7a1b795cabf admin admin] PATH_INFO: `/v3/projects/e2a97cace5804a74b04ffeda0319b732/users/f064fdcf4692460499771d6b6068d82a/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:34.934780 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266750f3-97d0-4134-a5be-d7a1b795cabf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2a97cace5804a74b04ffeda0319b732, user_id=f064fdcf4692460499771d6b6068d82a, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:34.941845 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266750f3-97d0-4134-a5be-d7a1b795cabf admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:34.984894 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1116/2231] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:48:34 2022] PUT /identity/v3/projects/e2a97cace5804a74b04ffeda0319b732/users/f064fdcf4692460499771d6b6068d82a/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:34.989331 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab3e35-b16e-45f9-b785-81274fb33eb9 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:35.000350 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab3e35-b16e-45f9-b785-81274fb33eb9 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:35.060963 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b6132-78b8-4e14-872e-68e002021af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:35.061601 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b6132-78b8-4e14-872e-68e002021af7 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:35.061879 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b6132-78b8-4e14-872e-68e002021af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:35.062151 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b6132-78b8-4e14-872e-68e002021af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:35.062784 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b6132-78b8-4e14-872e-68e002021af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:35.064435 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b6132-78b8-4e14-872e-68e002021af7 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:35.074692 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1116/2232] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:48:35.078935 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266750f3-97d0-4134-a5be-d7a1b795cabf admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:35.091699 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266750f3-97d0-4134-a5be-d7a1b795cabf admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:35.096577 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307d82d-169c-4f70-8a94-32d3128a1953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:35.098007 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307d82d-169c-4f70-8a94-32d3128a1953 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:35.098386 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307d82d-169c-4f70-8a94-32d3128a1953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:35.098777 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307d82d-169c-4f70-8a94-32d3128a1953 admin admin] PATH_INFO: `/v3/projects/e2a97cace5804a74b04ffeda0319b732/users/f064fdcf4692460499771d6b6068d82a/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:35.100730 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a307d82d-169c-4f70-8a94-32d3128a1953 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2a97cace5804a74b04ffeda0319b732, user_id=f064fdcf4692460499771d6b6068d82a, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:35.103519 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a307d82d-169c-4f70-8a94-32d3128a1953 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:35.113848 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1117/2233] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:48:35 2022] PUT /identity/v3/projects/e2a97cace5804a74b04ffeda0319b732/users/f064fdcf4692460499771d6b6068d82a/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:35.124275 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb136bc-d873-407c-bce7-5a98f89af15e None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:35.124580 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb136bc-d873-407c-bce7-5a98f89af15e None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:35.124850 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb136bc-d873-407c-bce7-5a98f89af15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:35.153102 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-7bb136bc-d873-407c-bce7-5a98f89af15e None None] MFA Rules not processed for user `f064fdcf4692460499771d6b6068d82a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:35.155154 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-7bb136bc-d873-407c-bce7-5a98f89af15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:35.201239 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:35.223744 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1117/2234] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:35 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:35.235854 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307d82d-169c-4f70-8a94-32d3128a1953 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:35.237491 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a307d82d-169c-4f70-8a94-32d3128a1953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:35.251770 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:35.296471 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307d82d-169c-4f70-8a94-32d3128a1953 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:35.300160 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce354bb-023b-4d7b-876b-f3b80d1f3dc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:35.300769 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce354bb-023b-4d7b-876b-f3b80d1f3dc6 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:35.301044 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce354bb-023b-4d7b-876b-f3b80d1f3dc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:35.301334 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce354bb-023b-4d7b-876b-f3b80d1f3dc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:35.310416 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce354bb-023b-4d7b-876b-f3b80d1f3dc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:35.311852 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce354bb-023b-4d7b-876b-f3b80d1f3dc6 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:35.321482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1118/2235] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:35 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:48:35.610676 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb136bc-d873-407c-bce7-5a98f89af15e None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:35.621141 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb136bc-d873-407c-bce7-5a98f89af15e None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:35.625360 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573b790-c353-41ff-ba30-c2af9858a2ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:35.626050 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573b790-c353-41ff-ba30-c2af9858a2ba service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:35.631738 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573b790-c353-41ff-ba30-c2af9858a2ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:35.631738 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573b790-c353-41ff-ba30-c2af9858a2ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:35.683646 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3573b790-c353-41ff-ba30-c2af9858a2ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:35.685088 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3573b790-c353-41ff-ba30-c2af9858a2ba service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:35.694807 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1118/2236] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:35 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:48:37.179349 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce354bb-023b-4d7b-876b-f3b80d1f3dc6 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:37.180782 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7ce354bb-023b-4d7b-876b-f3b80d1f3dc6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:37.192319 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce354bb-023b-4d7b-876b-f3b80d1f3dc6 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:37.197200 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1df723-e613-4638-a067-420722b6d964 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:37.197200 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1df723-e613-4638-a067-420722b6d964 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:37.197200 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1df723-e613-4638-a067-420722b6d964 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:37.197200 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1df723-e613-4638-a067-420722b6d964 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:37.198764 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-bf1df723-e613-4638-a067-420722b6d964 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:37.268819 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1df723-e613-4638-a067-420722b6d964 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:37.271964 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1df723-e613-4638-a067-420722b6d964 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:37.280350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1119/2237] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:37 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:48:43.439184 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573b790-c353-41ff-ba30-c2af9858a2ba service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:43.440648 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-3573b790-c353-41ff-ba30-c2af9858a2ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:43.506308 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573b790-c353-41ff-ba30-c2af9858a2ba service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:43.510820 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdea2e9-d804-4a10-a23e-63da34136bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:43.511433 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdea2e9-d804-4a10-a23e-63da34136bfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:43.511706 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdea2e9-d804-4a10-a23e-63da34136bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:43.511971 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdea2e9-d804-4a10-a23e-63da34136bfc admin admin] PATH_INFO: `/v3/users/537d2b47eea24292bf9f65e5ccbf251d` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:43.513096 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdea2e9-d804-4a10-a23e-63da34136bfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=537d2b47eea24292bf9f65e5ccbf251d)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:43.514971 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdea2e9-d804-4a10-a23e-63da34136bfc admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:43.793931 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2fdea2e9-d804-4a10-a23e-63da34136bfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '537d2b47eea24292bf9f65e5ccbf251d'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:43.806527 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2fdea2e9-d804-4a10-a23e-63da34136bfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '537d2b47eea24292bf9f65e5ccbf251d'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:43.818669 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2fdea2e9-d804-4a10-a23e-63da34136bfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '537d2b47eea24292bf9f65e5ccbf251d'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:43.819386 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2fdea2e9-d804-4a10-a23e-63da34136bfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '537d2b47eea24292bf9f65e5ccbf251d'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:43.827648 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2fdea2e9-d804-4a10-a23e-63da34136bfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '537d2b47eea24292bf9f65e5ccbf251d'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:43.931812 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1119/2238] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:48:43 2022] DELETE /identity/v3/users/537d2b47eea24292bf9f65e5ccbf251d => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:43.936335 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a025920-d26b-46cb-9a6f-bcbc7d83ae0e None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:43.944362 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a025920-d26b-46cb-9a6f-bcbc7d83ae0e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:43.944362 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a025920-d26b-46cb-9a6f-bcbc7d83ae0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:43.959133 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-3a025920-d26b-46cb-9a6f-bcbc7d83ae0e None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:43.960360 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3a025920-d26b-46cb-9a6f-bcbc7d83ae0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:44.030289 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1120/2239] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:44.038920 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdea2e9-d804-4a10-a23e-63da34136bfc admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:44.040461 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-2fdea2e9-d804-4a10-a23e-63da34136bfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:44.045831 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:44.102798 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdea2e9-d804-4a10-a23e-63da34136bfc admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:44.106794 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a623e5b-4503-45e2-a539-4ecee4951b91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:44.107404 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a623e5b-4503-45e2-a539-4ecee4951b91 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:44.107801 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a623e5b-4503-45e2-a539-4ecee4951b91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:44.108124 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a623e5b-4503-45e2-a539-4ecee4951b91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:44.118108 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a623e5b-4503-45e2-a539-4ecee4951b91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:44.119492 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a623e5b-4503-45e2-a539-4ecee4951b91 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:44.129398 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1120/2240] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:48:44.575901 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a025920-d26b-46cb-9a6f-bcbc7d83ae0e None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:44.577421 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3a025920-d26b-46cb-9a6f-bcbc7d83ae0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:44.597952 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a025920-d26b-46cb-9a6f-bcbc7d83ae0e None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:44.603154 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726239e7-ba38-4fa6-acfe-e090bff90552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:44.604200 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726239e7-ba38-4fa6-acfe-e090bff90552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:44.604497 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726239e7-ba38-4fa6-acfe-e090bff90552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:44.604931 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726239e7-ba38-4fa6-acfe-e090bff90552 admin admin] PATH_INFO: `/v3/projects/7e13f3ad26e74b84b4f7e5c32c9071bd` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:44.606497 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726239e7-ba38-4fa6-acfe-e090bff90552 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e13f3ad26e74b84b4f7e5c32c9071bd)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:44.609070 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726239e7-ba38-4fa6-acfe-e090bff90552 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:44.764809 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:44.768375 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-726239e7-ba38-4fa6-acfe-e090bff90552 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e13f3ad26e74b84b4f7e5c32c9071bd', 'request_id': 'req-726239e7-ba38-4fa6-acfe-e090bff90552'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:44.774504 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-726239e7-ba38-4fa6-acfe-e090bff90552 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e13f3ad26e74b84b4f7e5c32c9071bd', 'request_id': 'req-726239e7-ba38-4fa6-acfe-e090bff90552'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:44.780714 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-726239e7-ba38-4fa6-acfe-e090bff90552 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e13f3ad26e74b84b4f7e5c32c9071bd', 'request_id': 'req-726239e7-ba38-4fa6-acfe-e090bff90552'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:44.847302 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-726239e7-ba38-4fa6-acfe-e090bff90552 admin admin] The token cache is being invalidate because project 7e13f3ad26e74b84b4f7e5c32c9071bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:48:44.847590 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-726239e7-ba38-4fa6-acfe-e090bff90552 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:44.848606 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-726239e7-ba38-4fa6-acfe-e090bff90552 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:44.850145 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1121/2241] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:48:44 2022] DELETE /identity/v3/projects/7e13f3ad26e74b84b4f7e5c32c9071bd => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:44.854084 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a623e5b-4503-45e2-a539-4ecee4951b91 service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:44.864568 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a623e5b-4503-45e2-a539-4ecee4951b91 service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:44.921152 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a28295-b7a8-4518-8b8f-ed84055a417a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:44.921783 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a28295-b7a8-4518-8b8f-ed84055a417a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:44.922058 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a28295-b7a8-4518-8b8f-ed84055a417a admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:44.922325 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a28295-b7a8-4518-8b8f-ed84055a417a admin admin] PATH_INFO: `/v3/users/729b9bfdcc6c45149863c945a6d86ed3` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:44.923433 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a28295-b7a8-4518-8b8f-ed84055a417a admin admin] RBAC: Authorizing `identity:delete_user(user_id=729b9bfdcc6c45149863c945a6d86ed3)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:44.925346 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a28295-b7a8-4518-8b8f-ed84055a417a admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:45.176782 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-94a28295-b7a8-4518-8b8f-ed84055a417a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '729b9bfdcc6c45149863c945a6d86ed3'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:45.188741 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-94a28295-b7a8-4518-8b8f-ed84055a417a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '729b9bfdcc6c45149863c945a6d86ed3'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:45.196209 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-94a28295-b7a8-4518-8b8f-ed84055a417a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '729b9bfdcc6c45149863c945a6d86ed3'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:45.196890 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-94a28295-b7a8-4518-8b8f-ed84055a417a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '729b9bfdcc6c45149863c945a6d86ed3'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:45.197485 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-94a28295-b7a8-4518-8b8f-ed84055a417a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '729b9bfdcc6c45149863c945a6d86ed3'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:45.448070 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1121/2242] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:48:44 2022] DELETE /identity/v3/users/729b9bfdcc6c45149863c945a6d86ed3 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:45.958215 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726239e7-ba38-4fa6-acfe-e090bff90552 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:45.961133 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-726239e7-ba38-4fa6-acfe-e090bff90552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:45.978688 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726239e7-ba38-4fa6-acfe-e090bff90552 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:46.040799 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc03f7-c094-45c7-8c29-37841ee31fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:46.041428 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc03f7-c094-45c7-8c29-37841ee31fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:46.041704 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc03f7-c094-45c7-8c29-37841ee31fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:46.041971 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc03f7-c094-45c7-8c29-37841ee31fb6 admin admin] PATH_INFO: `/v3/projects/da18f515b7f945029b82a930a3b2b290` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:46.043063 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc03f7-c094-45c7-8c29-37841ee31fb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da18f515b7f945029b82a930a3b2b290)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:46.045005 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc03f7-c094-45c7-8c29-37841ee31fb6 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:46.156444 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-79bc03f7-c094-45c7-8c29-37841ee31fb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da18f515b7f945029b82a930a3b2b290', 'request_id': 'req-79bc03f7-c094-45c7-8c29-37841ee31fb6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:46.163110 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-79bc03f7-c094-45c7-8c29-37841ee31fb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da18f515b7f945029b82a930a3b2b290', 'request_id': 'req-79bc03f7-c094-45c7-8c29-37841ee31fb6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:46.169448 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-79bc03f7-c094-45c7-8c29-37841ee31fb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da18f515b7f945029b82a930a3b2b290', 'request_id': 'req-79bc03f7-c094-45c7-8c29-37841ee31fb6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:46.281178 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-79bc03f7-c094-45c7-8c29-37841ee31fb6 admin admin] The token cache is being invalidate because project da18f515b7f945029b82a930a3b2b290 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:48:46.281466 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-79bc03f7-c094-45c7-8c29-37841ee31fb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:46.282095 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-79bc03f7-c094-45c7-8c29-37841ee31fb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:46.284257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1122/2243] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:48:45 2022] DELETE /identity/v3/projects/da18f515b7f945029b82a930a3b2b290 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:46.290940 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f34c79-9457-4882-aa8b-066a5e011731 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:46.291405 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f34c79-9457-4882-aa8b-066a5e011731 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:46.291640 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f34c79-9457-4882-aa8b-066a5e011731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:46.312652 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-f7f34c79-9457-4882-aa8b-066a5e011731 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:46.315887 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f7f34c79-9457-4882-aa8b-066a5e011731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:46.332995 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:46.372469 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1122/2244] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:46.439668 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a795a02-d7c4-466b-8865-083860f10cef None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:46.439903 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a795a02-d7c4-466b-8865-083860f10cef None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:46.446762 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a795a02-d7c4-466b-8865-083860f10cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:46.466148 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-7a795a02-d7c4-466b-8865-083860f10cef None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:46.467352 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7a795a02-d7c4-466b-8865-083860f10cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:46.478338 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1123/2245] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:46.482981 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f34c79-9457-4882-aa8b-066a5e011731 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:46.492750 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f34c79-9457-4882-aa8b-066a5e011731 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:46.497462 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23585d1f-e5c6-4538-a8b3-dfe049d578d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:46.498054 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23585d1f-e5c6-4538-a8b3-dfe049d578d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:46.498326 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23585d1f-e5c6-4538-a8b3-dfe049d578d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:46.498597 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23585d1f-e5c6-4538-a8b3-dfe049d578d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:46.499318 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23585d1f-e5c6-4538-a8b3-dfe049d578d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:48:46.499616 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23585d1f-e5c6-4538-a8b3-dfe049d578d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:46.504150 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23585d1f-e5c6-4538-a8b3-dfe049d578d9 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:46.513209 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1123/2246] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:48:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:48:46.517539 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a795a02-d7c4-466b-8865-083860f10cef None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:46.528848 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a795a02-d7c4-466b-8865-083860f10cef None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:46.533800 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36eba43-dc63-47b3-8a15-d0142c137d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:46.534421 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36eba43-dc63-47b3-8a15-d0142c137d0c admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:46.534958 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36eba43-dc63-47b3-8a15-d0142c137d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:46.535398 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36eba43-dc63-47b3-8a15-d0142c137d0c admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:46.537033 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36eba43-dc63-47b3-8a15-d0142c137d0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:46.539579 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36eba43-dc63-47b3-8a15-d0142c137d0c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:46.661060 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1124/2247] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:48:46 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:48:46.665300 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23585d1f-e5c6-4538-a8b3-dfe049d578d9 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:46.675194 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23585d1f-e5c6-4538-a8b3-dfe049d578d9 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:46.731791 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d94b7b-2594-49d4-90e3-689a4d49103e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:46.732432 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d94b7b-2594-49d4-90e3-689a4d49103e admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:46.732712 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d94b7b-2594-49d4-90e3-689a4d49103e admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:46.732981 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d94b7b-2594-49d4-90e3-689a4d49103e admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:46.733650 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d94b7b-2594-49d4-90e3-689a4d49103e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:46.735552 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d94b7b-2594-49d4-90e3-689a4d49103e admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:46.848277 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1124/2248] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:48:46 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:48:46.852387 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36eba43-dc63-47b3-8a15-d0142c137d0c admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:46.862497 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36eba43-dc63-47b3-8a15-d0142c137d0c admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:46.867328 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf43d6-ebb4-485f-9c62-c177591e70a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:46.867959 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf43d6-ebb4-485f-9c62-c177591e70a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:46.870348 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf43d6-ebb4-485f-9c62-c177591e70a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:46.870348 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf43d6-ebb4-485f-9c62-c177591e70a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:46.870348 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf43d6-ebb4-485f-9c62-c177591e70a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:46.870729 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf43d6-ebb4-485f-9c62-c177591e70a0 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:46.881037 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1125/2249] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:48:46.885009 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d94b7b-2594-49d4-90e3-689a4d49103e admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:46.895557 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d94b7b-2594-49d4-90e3-689a4d49103e admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:46.900372 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aff9a4-b9e5-4f27-affc-783b53fbe045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:46.900964 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aff9a4-b9e5-4f27-affc-783b53fbe045 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:46.901239 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aff9a4-b9e5-4f27-affc-783b53fbe045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:46.901506 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aff9a4-b9e5-4f27-affc-783b53fbe045 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:46.902184 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aff9a4-b9e5-4f27-affc-783b53fbe045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:46.903746 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aff9a4-b9e5-4f27-affc-783b53fbe045 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:46.914576 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1125/2250] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:48:46.918768 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf43d6-ebb4-485f-9c62-c177591e70a0 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:46.928820 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf43d6-ebb4-485f-9c62-c177591e70a0 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:46.933413 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288b131-6c84-42b4-b2ec-58a5d8babe83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:46.934053 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288b131-6c84-42b4-b2ec-58a5d8babe83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:46.934329 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288b131-6c84-42b4-b2ec-58a5d8babe83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:46.934602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288b131-6c84-42b4-b2ec-58a5d8babe83 admin admin] PATH_INFO: `/v3/projects/6ef923e635ea49e5b9bdc71f67728353/users/a3026edee3c34da388d2f2f521600d24/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:46.950726 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288b131-6c84-42b4-b2ec-58a5d8babe83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ef923e635ea49e5b9bdc71f67728353, user_id=a3026edee3c34da388d2f2f521600d24, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:46.953396 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288b131-6c84-42b4-b2ec-58a5d8babe83 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:47.030859 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:47.037060 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1126/2251] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:48:46 2022] PUT /identity/v3/projects/6ef923e635ea49e5b9bdc71f67728353/users/a3026edee3c34da388d2f2f521600d24/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:47.047788 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a05ba-38ae-47f1-8912-ca6d98743e02 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:47.048101 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a05ba-38ae-47f1-8912-ca6d98743e02 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:47.048409 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a05ba-38ae-47f1-8912-ca6d98743e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:47.077720 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-f50a05ba-38ae-47f1-8912-ca6d98743e02 None None] MFA Rules not processed for user `a3026edee3c34da388d2f2f521600d24`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:47.078971 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f50a05ba-38ae-47f1-8912-ca6d98743e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:47.149033 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1126/2252] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:47.153904 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288b131-6c84-42b4-b2ec-58a5d8babe83 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:47.219784 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288b131-6c84-42b4-b2ec-58a5d8babe83 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:47.224510 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e206c70-27ae-4750-9587-e87812934db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:47.225113 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e206c70-27ae-4750-9587-e87812934db0 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:47.225389 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e206c70-27ae-4750-9587-e87812934db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:47.225661 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e206c70-27ae-4750-9587-e87812934db0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:47.226281 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e206c70-27ae-4750-9587-e87812934db0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:47.228206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e206c70-27ae-4750-9587-e87812934db0 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:47.329121 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1127/2253] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:48:47 2022] POST /identity/v3/projects => generated 383 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:48:47.333264 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a05ba-38ae-47f1-8912-ca6d98743e02 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:47.343897 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a05ba-38ae-47f1-8912-ca6d98743e02 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:47.361062 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:47.403161 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b9657-07ec-4416-bd9f-79a0734a58f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:47.403798 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b9657-07ec-4416-bd9f-79a0734a58f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:47.404102 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b9657-07ec-4416-bd9f-79a0734a58f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:47.404398 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b9657-07ec-4416-bd9f-79a0734a58f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:47.405013 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b9657-07ec-4416-bd9f-79a0734a58f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:47.407538 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b9657-07ec-4416-bd9f-79a0734a58f6 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:47.495698 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1127/2254] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:48:47 2022] POST /identity/v3/users => generated 292 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:48:47.501177 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e206c70-27ae-4750-9587-e87812934db0 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:47.511986 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e206c70-27ae-4750-9587-e87812934db0 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:47.517181 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6c844-f4ae-4571-b8b5-45e97e988c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:47.517777 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6c844-f4ae-4571-b8b5-45e97e988c82 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:47.518052 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6c844-f4ae-4571-b8b5-45e97e988c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:47.518316 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6c844-f4ae-4571-b8b5-45e97e988c82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:47.518939 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae6c844-f4ae-4571-b8b5-45e97e988c82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:47.520592 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae6c844-f4ae-4571-b8b5-45e97e988c82 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:47.531610 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1128/2255] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:48:47.536416 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b9657-07ec-4416-bd9f-79a0734a58f6 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:47.546529 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b9657-07ec-4416-bd9f-79a0734a58f6 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:47.551774 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132ef7d-f2a0-4b1f-a1f0-287e5bd044cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:47.552342 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132ef7d-f2a0-4b1f-a1f0-287e5bd044cb admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:47.552618 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132ef7d-f2a0-4b1f-a1f0-287e5bd044cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:47.552884 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132ef7d-f2a0-4b1f-a1f0-287e5bd044cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:47.553507 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1132ef7d-f2a0-4b1f-a1f0-287e5bd044cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:47.555322 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1132ef7d-f2a0-4b1f-a1f0-287e5bd044cb admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:47.568523 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1128/2256] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:48:47.569856 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6c844-f4ae-4571-b8b5-45e97e988c82 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:47.580737 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6c844-f4ae-4571-b8b5-45e97e988c82 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:47.585839 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0480a8-91cf-438c-b322-d96e33c2f43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:47.586520 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0480a8-91cf-438c-b322-d96e33c2f43f admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:47.586776 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0480a8-91cf-438c-b322-d96e33c2f43f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:47.587052 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0480a8-91cf-438c-b322-d96e33c2f43f admin admin] PATH_INFO: `/v3/projects/2306f13ebde74718b8991c28a320e5a8/users/00a70eb73c074edc8e7a395389ae81e9/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:47.604286 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0480a8-91cf-438c-b322-d96e33c2f43f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2306f13ebde74718b8991c28a320e5a8, user_id=00a70eb73c074edc8e7a395389ae81e9, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:47.608860 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0480a8-91cf-438c-b322-d96e33c2f43f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:47.688020 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1129/2257] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:48:47 2022] PUT /identity/v3/projects/2306f13ebde74718b8991c28a320e5a8/users/00a70eb73c074edc8e7a395389ae81e9/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:47.698587 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b0604-7634-43c6-a7a5-e48c0d94f356 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:47.698893 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b0604-7634-43c6-a7a5-e48c0d94f356 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:47.699171 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b0604-7634-43c6-a7a5-e48c0d94f356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:47.728960 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-8f3b0604-7634-43c6-a7a5-e48c0d94f356 None None] MFA Rules not processed for user `00a70eb73c074edc8e7a395389ae81e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:47.730170 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-8f3b0604-7634-43c6-a7a5-e48c0d94f356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:47.794451 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1129/2258] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:48:47.799067 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0480a8-91cf-438c-b322-d96e33c2f43f admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:47.861651 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0480a8-91cf-438c-b322-d96e33c2f43f admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:47.866423 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734bae8-e7bd-4a2a-bb5b-2969e36c8790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:47.867020 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734bae8-e7bd-4a2a-bb5b-2969e36c8790 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:47.867297 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734bae8-e7bd-4a2a-bb5b-2969e36c8790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:47.867565 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734bae8-e7bd-4a2a-bb5b-2969e36c8790 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:47.868219 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9734bae8-e7bd-4a2a-bb5b-2969e36c8790 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:47.870203 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9734bae8-e7bd-4a2a-bb5b-2969e36c8790 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:48.021371 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1130/2259] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:48:47 2022] POST /identity/v3/projects => generated 385 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:48:48.025681 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b0604-7634-43c6-a7a5-e48c0d94f356 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:48.037327 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b0604-7634-43c6-a7a5-e48c0d94f356 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:48.092368 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812da5c-b906-4545-a84c-327fce43ef8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:48.092967 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812da5c-b906-4545-a84c-327fce43ef8b admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:48.093254 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812da5c-b906-4545-a84c-327fce43ef8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:48.093525 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812da5c-b906-4545-a84c-327fce43ef8b admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:48.094149 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812da5c-b906-4545-a84c-327fce43ef8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:48.096065 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812da5c-b906-4545-a84c-327fce43ef8b admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:48.190007 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1130/2260] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:48:48 2022] POST /identity/v3/users => generated 299 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:48:48.194680 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734bae8-e7bd-4a2a-bb5b-2969e36c8790 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:48.204933 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734bae8-e7bd-4a2a-bb5b-2969e36c8790 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:48.210035 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7bdb8-f09e-4f8e-891f-b876e1e5171c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:48.210647 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7bdb8-f09e-4f8e-891f-b876e1e5171c admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:48.210921 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7bdb8-f09e-4f8e-891f-b876e1e5171c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:48.211188 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7bdb8-f09e-4f8e-891f-b876e1e5171c admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:48.211850 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7bdb8-f09e-4f8e-891f-b876e1e5171c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:48.213472 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7bdb8-f09e-4f8e-891f-b876e1e5171c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:48.224693 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1131/2261] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:48:48.228879 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812da5c-b906-4545-a84c-327fce43ef8b admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:48.239208 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812da5c-b906-4545-a84c-327fce43ef8b admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:48.244434 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460bf04-6e6e-4a06-92ca-c63e5c827b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:48.245147 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460bf04-6e6e-4a06-92ca-c63e5c827b1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:48.245349 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460bf04-6e6e-4a06-92ca-c63e5c827b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:48.245825 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460bf04-6e6e-4a06-92ca-c63e5c827b1a admin admin] PATH_INFO: `/v3/projects/09d22cfb63e04827bfc2991762b83199/users/d715fb2bc25349e7a528c914e08b67c2/roles/9252c356af254127896f3626d925a88a` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:48.262637 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3460bf04-6e6e-4a06-92ca-c63e5c827b1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=09d22cfb63e04827bfc2991762b83199, user_id=d715fb2bc25349e7a528c914e08b67c2, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:48.265384 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3460bf04-6e6e-4a06-92ca-c63e5c827b1a admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:48.267717 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:48.356714 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1131/2262] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:48:48 2022] PUT /identity/v3/projects/09d22cfb63e04827bfc2991762b83199/users/d715fb2bc25349e7a528c914e08b67c2/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:48:48.365882 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7bdb8-f09e-4f8e-891f-b876e1e5171c admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:48.375913 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7bdb8-f09e-4f8e-891f-b876e1e5171c admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:48.396331 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:48.434255 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dfa821-2853-47f8-a604-3fcae90f9747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:48.434857 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfa821-2853-47f8-a604-3fcae90f9747 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:48.435131 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfa821-2853-47f8-a604-3fcae90f9747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:48.435400 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfa821-2853-47f8-a604-3fcae90f9747 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:48.436026 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dfa821-2853-47f8-a604-3fcae90f9747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:48.437640 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dfa821-2853-47f8-a604-3fcae90f9747 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:48.447534 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1132/2263] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:48:48.451905 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460bf04-6e6e-4a06-92ca-c63e5c827b1a admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:48.462722 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460bf04-6e6e-4a06-92ca-c63e5c827b1a admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:48.468195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac4b19-d6b5-4975-8dc2-2219bfa05fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:48.468826 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac4b19-d6b5-4975-8dc2-2219bfa05fd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:48.469104 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac4b19-d6b5-4975-8dc2-2219bfa05fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:48.469374 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac4b19-d6b5-4975-8dc2-2219bfa05fd7 admin admin] PATH_INFO: `/v3/projects/09d22cfb63e04827bfc2991762b83199/users/d715fb2bc25349e7a528c914e08b67c2/roles/9252c356af254127896f3626d925a88a` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:48.471272 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac4b19-d6b5-4975-8dc2-2219bfa05fd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09d22cfb63e04827bfc2991762b83199, user_id=d715fb2bc25349e7a528c914e08b67c2, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:48.474600 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac4b19-d6b5-4975-8dc2-2219bfa05fd7 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:48.485301 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1132/2264] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:48:48 2022] PUT /identity/v3/projects/09d22cfb63e04827bfc2991762b83199/users/d715fb2bc25349e7a528c914e08b67c2/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:48.496524 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22ae14-ec1f-4f10-b303-e5b6ec40b2e7 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:48.496806 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22ae14-ec1f-4f10-b303-e5b6ec40b2e7 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:48.497141 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22ae14-ec1f-4f10-b303-e5b6ec40b2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:48.525030 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-3b22ae14-ec1f-4f10-b303-e5b6ec40b2e7 None None] MFA Rules not processed for user `d715fb2bc25349e7a528c914e08b67c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:48.526216 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3b22ae14-ec1f-4f10-b303-e5b6ec40b2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:48.598044 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1133/2265] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:48 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:48.610066 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac4b19-d6b5-4975-8dc2-2219bfa05fd7 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:48.611814 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-75ac4b19-d6b5-4975-8dc2-2219bfa05fd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:48.671698 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac4b19-d6b5-4975-8dc2-2219bfa05fd7 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:48.675440 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2051b1-fef2-4943-8fa6-cc171bbe1d39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:48.676655 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2051b1-fef2-4943-8fa6-cc171bbe1d39 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:48.676937 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2051b1-fef2-4943-8fa6-cc171bbe1d39 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:48.677202 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2051b1-fef2-4943-8fa6-cc171bbe1d39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:48.735552 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2051b1-fef2-4943-8fa6-cc171bbe1d39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:48.737059 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2051b1-fef2-4943-8fa6-cc171bbe1d39 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:48.746859 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1133/2266] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:48:50.715112 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22ae14-ec1f-4f10-b303-e5b6ec40b2e7 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:50.716789 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3b22ae14-ec1f-4f10-b303-e5b6ec40b2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:50.793978 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22ae14-ec1f-4f10-b303-e5b6ec40b2e7 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:50.799347 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a7732a-7445-41c0-9949-0a7ce79298e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:50.800171 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7732a-7445-41c0-9949-0a7ce79298e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:50.800651 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7732a-7445-41c0-9949-0a7ce79298e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:50.800955 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7732a-7445-41c0-9949-0a7ce79298e2 admin admin] PATH_INFO: `/v3/users/df85806bb5064d809e504f1b1a3df26c` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:50.802116 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a7732a-7445-41c0-9949-0a7ce79298e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df85806bb5064d809e504f1b1a3df26c)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:50.804091 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a7732a-7445-41c0-9949-0a7ce79298e2 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:50.910960 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2051b1-fef2-4943-8fa6-cc171bbe1d39 service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:50.920715 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2051b1-fef2-4943-8fa6-cc171bbe1d39 service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:50.924445 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa7ad7-3e51-4c06-a799-1d7a8bbcd704 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:50.925045 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa7ad7-3e51-4c06-a799-1d7a8bbcd704 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:50.925315 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa7ad7-3e51-4c06-a799-1d7a8bbcd704 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:50.925582 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa7ad7-3e51-4c06-a799-1d7a8bbcd704 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:50.986306 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaa7ad7-3e51-4c06-a799-1d7a8bbcd704 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:50.992412 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaa7ad7-3e51-4c06-a799-1d7a8bbcd704 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:51.006404 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1134/2267] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:48:51.032912 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:51.034882 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-f0a7732a-7445-41c0-9949-0a7ce79298e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df85806bb5064d809e504f1b1a3df26c'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:51.057430 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-f0a7732a-7445-41c0-9949-0a7ce79298e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df85806bb5064d809e504f1b1a3df26c'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:51.058451 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-f0a7732a-7445-41c0-9949-0a7ce79298e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df85806bb5064d809e504f1b1a3df26c'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:51.073233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-f0a7732a-7445-41c0-9949-0a7ce79298e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df85806bb5064d809e504f1b1a3df26c'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:51.074673 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-f0a7732a-7445-41c0-9949-0a7ce79298e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df85806bb5064d809e504f1b1a3df26c'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:51.143670 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1134/2268] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:48:50 2022] DELETE /identity/v3/users/df85806bb5064d809e504f1b1a3df26c => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:51.149687 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af826e-e8fe-4943-a14d-3077c8d5b54a None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:51.150005 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af826e-e8fe-4943-a14d-3077c8d5b54a None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:51.150284 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af826e-e8fe-4943-a14d-3077c8d5b54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:51.170459 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-a9af826e-e8fe-4943-a14d-3077c8d5b54a None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:51.171670 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a9af826e-e8fe-4943-a14d-3077c8d5b54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:51.209302 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:51.239412 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1135/2269] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:51.249552 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a7732a-7445-41c0-9949-0a7ce79298e2 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:51.250942 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f0a7732a-7445-41c0-9949-0a7ce79298e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:51.311079 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a7732a-7445-41c0-9949-0a7ce79298e2 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:51.314583 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29d0a3-e278-458c-ad12-364eb226932f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:51.319711 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29d0a3-e278-458c-ad12-364eb226932f service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:51.319711 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29d0a3-e278-458c-ad12-364eb226932f service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:51.319711 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29d0a3-e278-458c-ad12-364eb226932f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:51.326510 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f29d0a3-e278-458c-ad12-364eb226932f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:51.328594 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f29d0a3-e278-458c-ad12-364eb226932f service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:51.345557 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1135/2270] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:48:51.745931 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af826e-e8fe-4943-a14d-3077c8d5b54a None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:51.748107 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a9af826e-e8fe-4943-a14d-3077c8d5b54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:51.761712 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af826e-e8fe-4943-a14d-3077c8d5b54a None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:51.767210 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd0cc8-53a1-4adc-9d7c-6914cb443a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:51.767851 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd0cc8-53a1-4adc-9d7c-6914cb443a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:51.768161 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd0cc8-53a1-4adc-9d7c-6914cb443a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:51.768992 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd0cc8-53a1-4adc-9d7c-6914cb443a59 admin admin] PATH_INFO: `/v3/projects/41be4ce5e0ad4915919bc0c3d5c54131` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:51.770315 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd0cc8-53a1-4adc-9d7c-6914cb443a59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41be4ce5e0ad4915919bc0c3d5c54131)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:51.772725 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd0cc8-53a1-4adc-9d7c-6914cb443a59 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:51.882188 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-70dd0cc8-53a1-4adc-9d7c-6914cb443a59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41be4ce5e0ad4915919bc0c3d5c54131', 'request_id': 'req-70dd0cc8-53a1-4adc-9d7c-6914cb443a59'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:51.888590 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-70dd0cc8-53a1-4adc-9d7c-6914cb443a59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41be4ce5e0ad4915919bc0c3d5c54131', 'request_id': 'req-70dd0cc8-53a1-4adc-9d7c-6914cb443a59'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:51.894416 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-70dd0cc8-53a1-4adc-9d7c-6914cb443a59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41be4ce5e0ad4915919bc0c3d5c54131', 'request_id': 'req-70dd0cc8-53a1-4adc-9d7c-6914cb443a59'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:51.977940 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-70dd0cc8-53a1-4adc-9d7c-6914cb443a59 admin admin] The token cache is being invalidate because project 41be4ce5e0ad4915919bc0c3d5c54131 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:48:51.978544 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-70dd0cc8-53a1-4adc-9d7c-6914cb443a59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:51.978864 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-70dd0cc8-53a1-4adc-9d7c-6914cb443a59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:51.980715 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1136/2271] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:48:51 2022] DELETE /identity/v3/projects/41be4ce5e0ad4915919bc0c3d5c54131 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:51.984774 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29d0a3-e278-458c-ad12-364eb226932f service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:51.994497 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29d0a3-e278-458c-ad12-364eb226932f service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:52.052910 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8fe22a-dcff-4670-b1be-3f94d5623234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:52.053539 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fe22a-dcff-4670-b1be-3f94d5623234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:52.053824 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fe22a-dcff-4670-b1be-3f94d5623234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:52.054145 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fe22a-dcff-4670-b1be-3f94d5623234 admin admin] PATH_INFO: `/v3/users/a06e24f6ced649ce826c80cbb6deb9d7` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:52.055266 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8fe22a-dcff-4670-b1be-3f94d5623234 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a06e24f6ced649ce826c80cbb6deb9d7)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:52.057242 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8fe22a-dcff-4670-b1be-3f94d5623234 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:52.221917 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bb8fe22a-dcff-4670-b1be-3f94d5623234 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a06e24f6ced649ce826c80cbb6deb9d7'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:52.239375 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bb8fe22a-dcff-4670-b1be-3f94d5623234 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a06e24f6ced649ce826c80cbb6deb9d7'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:52.240508 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bb8fe22a-dcff-4670-b1be-3f94d5623234 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a06e24f6ced649ce826c80cbb6deb9d7'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:52.242499 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:52.248327 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bb8fe22a-dcff-4670-b1be-3f94d5623234 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a06e24f6ced649ce826c80cbb6deb9d7'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:52.253257 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bb8fe22a-dcff-4670-b1be-3f94d5623234 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a06e24f6ced649ce826c80cbb6deb9d7'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:52.336074 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1136/2272] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:48:51 2022] DELETE /identity/v3/users/a06e24f6ced649ce826c80cbb6deb9d7 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:52.345038 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd0cc8-53a1-4adc-9d7c-6914cb443a59 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:52.346445 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-70dd0cc8-53a1-4adc-9d7c-6914cb443a59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:52.428640 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd0cc8-53a1-4adc-9d7c-6914cb443a59 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:52.483604 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747dc23-1464-44ac-99c3-e33649629cb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:52.484915 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747dc23-1464-44ac-99c3-e33649629cb1 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:52.484915 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747dc23-1464-44ac-99c3-e33649629cb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:52.485141 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747dc23-1464-44ac-99c3-e33649629cb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:52.487032 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-8747dc23-1464-44ac-99c3-e33649629cb1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:52.519144 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:52.561441 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8747dc23-1464-44ac-99c3-e33649629cb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:52.562855 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8747dc23-1464-44ac-99c3-e33649629cb1 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:52.573059 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1137/2273] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:52 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:48:52.723397 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8fe22a-dcff-4670-b1be-3f94d5623234 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:52.725166 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-bb8fe22a-dcff-4670-b1be-3f94d5623234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:52.797366 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8fe22a-dcff-4670-b1be-3f94d5623234 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:52.803190 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318185c-a260-448e-9c6f-a6859cf72709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:52.803890 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318185c-a260-448e-9c6f-a6859cf72709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:52.804182 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318185c-a260-448e-9c6f-a6859cf72709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:52.804465 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318185c-a260-448e-9c6f-a6859cf72709 admin admin] PATH_INFO: `/v3/projects/cdb52f924b7a42098c46690d30893283` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:52.805610 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318185c-a260-448e-9c6f-a6859cf72709 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdb52f924b7a42098c46690d30893283)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:52.807598 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318185c-a260-448e-9c6f-a6859cf72709 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:52.905127 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0318185c-a260-448e-9c6f-a6859cf72709 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdb52f924b7a42098c46690d30893283', 'request_id': 'req-0318185c-a260-448e-9c6f-a6859cf72709'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:52.911925 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0318185c-a260-448e-9c6f-a6859cf72709 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdb52f924b7a42098c46690d30893283', 'request_id': 'req-0318185c-a260-448e-9c6f-a6859cf72709'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:52.918794 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0318185c-a260-448e-9c6f-a6859cf72709 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdb52f924b7a42098c46690d30893283', 'request_id': 'req-0318185c-a260-448e-9c6f-a6859cf72709'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:52.990722 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0318185c-a260-448e-9c6f-a6859cf72709 admin admin] The token cache is being invalidate because project cdb52f924b7a42098c46690d30893283 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:48:52.991340 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0318185c-a260-448e-9c6f-a6859cf72709 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:52.991626 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0318185c-a260-448e-9c6f-a6859cf72709 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:52.993226 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1137/2274] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:48:52 2022] DELETE /identity/v3/projects/cdb52f924b7a42098c46690d30893283 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:52.998254 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124b528-638a-4fa6-a0a7-5c173942155e None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:52.998701 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124b528-638a-4fa6-a0a7-5c173942155e None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:52.998800 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124b528-638a-4fa6-a0a7-5c173942155e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:53.017839 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-3124b528-638a-4fa6-a0a7-5c173942155e None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:53.019018 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-3124b528-638a-4fa6-a0a7-5c173942155e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:53.081292 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1138/2275] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:53.090143 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23eb3a0-0473-4a6e-b140-4b8c461f14a8 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:53.090421 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23eb3a0-0473-4a6e-b140-4b8c461f14a8 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:53.090694 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23eb3a0-0473-4a6e-b140-4b8c461f14a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:53.110528 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-c23eb3a0-0473-4a6e-b140-4b8c461f14a8 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:53.111711 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c23eb3a0-0473-4a6e-b140-4b8c461f14a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:53.119671 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1138/2276] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:48:53.123960 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3124b528-638a-4fa6-a0a7-5c173942155e None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:53.133650 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3124b528-638a-4fa6-a0a7-5c173942155e None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:53.138200 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135967c6-21af-46db-ba12-155a6b71d3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:53.138790 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135967c6-21af-46db-ba12-155a6b71d3ca admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:53.139071 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135967c6-21af-46db-ba12-155a6b71d3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:53.139339 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135967c6-21af-46db-ba12-155a6b71d3ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:53.139967 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135967c6-21af-46db-ba12-155a6b71d3ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:48:53.140307 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135967c6-21af-46db-ba12-155a6b71d3ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:53.141880 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135967c6-21af-46db-ba12-155a6b71d3ca admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:53.153786 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1139/2277] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:48:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:48:53.164477 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23eb3a0-0473-4a6e-b140-4b8c461f14a8 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:53.173724 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23eb3a0-0473-4a6e-b140-4b8c461f14a8 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:53.178645 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39b1f8-f554-46f2-a707-2cec3957362a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:53.179240 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39b1f8-f554-46f2-a707-2cec3957362a admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:53.179522 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39b1f8-f554-46f2-a707-2cec3957362a admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:53.179792 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39b1f8-f554-46f2-a707-2cec3957362a admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:53.180450 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39b1f8-f554-46f2-a707-2cec3957362a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:53.182394 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39b1f8-f554-46f2-a707-2cec3957362a admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:53.301342 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1139/2278] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:48:53 2022] POST /identity/v3/projects => generated 375 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:48:53.305459 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135967c6-21af-46db-ba12-155a6b71d3ca admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:53.315215 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135967c6-21af-46db-ba12-155a6b71d3ca admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:53.372280 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087b298-916f-490d-9ae8-2c1f6dfcff4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:53.372882 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087b298-916f-490d-9ae8-2c1f6dfcff4a admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:53.373158 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087b298-916f-490d-9ae8-2c1f6dfcff4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:53.373428 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087b298-916f-490d-9ae8-2c1f6dfcff4a admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:53.374070 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4087b298-916f-490d-9ae8-2c1f6dfcff4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:53.375964 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4087b298-916f-490d-9ae8-2c1f6dfcff4a admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:53.430852 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1140/2279] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:48:53 2022] POST /identity/v3/users => generated 288 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:48:53.435253 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39b1f8-f554-46f2-a707-2cec3957362a admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:53.446500 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39b1f8-f554-46f2-a707-2cec3957362a admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:53.451382 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bf527-9ffa-4fac-bd67-03268193f9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:53.451975 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bf527-9ffa-4fac-bd67-03268193f9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:53.452295 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bf527-9ffa-4fac-bd67-03268193f9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:53.452563 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bf527-9ffa-4fac-bd67-03268193f9f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:53.453185 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bf527-9ffa-4fac-bd67-03268193f9f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:53.454781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bf527-9ffa-4fac-bd67-03268193f9f0 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:53.465659 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1140/2280] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:48:53.469795 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087b298-916f-490d-9ae8-2c1f6dfcff4a admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:53.479896 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087b298-916f-490d-9ae8-2c1f6dfcff4a admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:53.484757 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68265379-8041-40b2-b112-b5843ea4bd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:53.485346 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68265379-8041-40b2-b112-b5843ea4bd45 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:53.485627 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68265379-8041-40b2-b112-b5843ea4bd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:53.485962 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68265379-8041-40b2-b112-b5843ea4bd45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:53.486592 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68265379-8041-40b2-b112-b5843ea4bd45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:53.488228 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68265379-8041-40b2-b112-b5843ea4bd45 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:53.499389 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1141/2281] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:48:53.503538 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bf527-9ffa-4fac-bd67-03268193f9f0 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:53.514087 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bf527-9ffa-4fac-bd67-03268193f9f0 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:53.518642 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1225a-b66d-4876-9ff9-dac0a840043b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:53.519345 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1225a-b66d-4876-9ff9-dac0a840043b admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:53.519560 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1225a-b66d-4876-9ff9-dac0a840043b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:53.519833 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1225a-b66d-4876-9ff9-dac0a840043b admin admin] PATH_INFO: `/v3/projects/427e4360c3c04843b6b13b980e826797/users/f47ce9abc7634dbc95e398af05ae74e0/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:53.535425 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1225a-b66d-4876-9ff9-dac0a840043b admin admin] RBAC: Authorizing `identity:create_grant(project_id=427e4360c3c04843b6b13b980e826797, user_id=f47ce9abc7634dbc95e398af05ae74e0, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:53.539982 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1225a-b66d-4876-9ff9-dac0a840043b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:53.601824 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1141/2282] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:48:53 2022] PUT /identity/v3/projects/427e4360c3c04843b6b13b980e826797/users/f47ce9abc7634dbc95e398af05ae74e0/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:53.613297 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63043b-132c-487a-a500-dbb9931e145f None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:53.613581 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63043b-132c-487a-a500-dbb9931e145f None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:53.613853 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63043b-132c-487a-a500-dbb9931e145f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:53.641640 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-7f63043b-132c-487a-a500-dbb9931e145f None None] MFA Rules not processed for user `f47ce9abc7634dbc95e398af05ae74e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:53.642845 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-7f63043b-132c-487a-a500-dbb9931e145f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:53.660321 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:53.707876 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1142/2283] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:53.713043 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1225a-b66d-4876-9ff9-dac0a840043b admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:53.728183 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:53.784329 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1225a-b66d-4876-9ff9-dac0a840043b admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:53.796369 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651eee8-d4d1-4da1-96dc-23d39b7b3eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:53.797077 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651eee8-d4d1-4da1-96dc-23d39b7b3eb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:53.797415 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651eee8-d4d1-4da1-96dc-23d39b7b3eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:53.797767 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651eee8-d4d1-4da1-96dc-23d39b7b3eb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:53.798647 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d651eee8-d4d1-4da1-96dc-23d39b7b3eb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:53.801241 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d651eee8-d4d1-4da1-96dc-23d39b7b3eb8 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:53.937316 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1142/2284] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:48:53 2022] POST /identity/v3/projects => generated 381 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:48:53.946924 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63043b-132c-487a-a500-dbb9931e145f None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:53.960245 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63043b-132c-487a-a500-dbb9931e145f None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:54.022441 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fddb3-457c-40ab-a033-60dac1b77863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:54.023142 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fddb3-457c-40ab-a033-60dac1b77863 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:54.023379 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fddb3-457c-40ab-a033-60dac1b77863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:54.023634 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fddb3-457c-40ab-a033-60dac1b77863 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:54.024328 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93fddb3-457c-40ab-a033-60dac1b77863 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:54.026230 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93fddb3-457c-40ab-a033-60dac1b77863 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:54.158217 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1143/2285] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:48:53 2022] POST /identity/v3/users => generated 297 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:48:54.162389 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651eee8-d4d1-4da1-96dc-23d39b7b3eb8 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:54.176778 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651eee8-d4d1-4da1-96dc-23d39b7b3eb8 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:54.182312 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184767e-319d-4341-9050-ed0cbe51e454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:54.186600 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184767e-319d-4341-9050-ed0cbe51e454 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:54.186600 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184767e-319d-4341-9050-ed0cbe51e454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:54.186600 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184767e-319d-4341-9050-ed0cbe51e454 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:54.186600 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e184767e-319d-4341-9050-ed0cbe51e454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:54.186600 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e184767e-319d-4341-9050-ed0cbe51e454 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:54.197804 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1143/2286] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:48:54.202078 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fddb3-457c-40ab-a033-60dac1b77863 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:54.213163 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fddb3-457c-40ab-a033-60dac1b77863 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:54.218154 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c698395-23c0-4bb0-98e4-59c0c0b84a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:54.218863 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c698395-23c0-4bb0-98e4-59c0c0b84a82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:54.219115 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c698395-23c0-4bb0-98e4-59c0c0b84a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:54.219388 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c698395-23c0-4bb0-98e4-59c0c0b84a82 admin admin] PATH_INFO: `/v3/projects/c41dc4ed7daa447fb085f534573a8b82/users/835a9b5c1d174c29a19ed1bab9f298d9/roles/9252c356af254127896f3626d925a88a` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:54.234747 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c698395-23c0-4bb0-98e4-59c0c0b84a82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c41dc4ed7daa447fb085f534573a8b82, user_id=835a9b5c1d174c29a19ed1bab9f298d9, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:54.237453 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c698395-23c0-4bb0-98e4-59c0c0b84a82 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:54.313825 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1144/2287] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:48:54 2022] PUT /identity/v3/projects/c41dc4ed7daa447fb085f534573a8b82/users/835a9b5c1d174c29a19ed1bab9f298d9/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:54.316494 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184767e-319d-4341-9050-ed0cbe51e454 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:54.326200 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c698395-23c0-4bb0-98e4-59c0c0b84a82 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:54.327376 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184767e-319d-4341-9050-ed0cbe51e454 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:54.328192 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-9c698395-23c0-4bb0-98e4-59c0c0b84a82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:54.392383 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada981aa-d0f3-4154-aeaa-f4fe22243c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:54.393070 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada981aa-d0f3-4154-aeaa-f4fe22243c23 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:54.393339 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada981aa-d0f3-4154-aeaa-f4fe22243c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:54.393614 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada981aa-d0f3-4154-aeaa-f4fe22243c23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:54.394385 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada981aa-d0f3-4154-aeaa-f4fe22243c23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:54.396307 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada981aa-d0f3-4154-aeaa-f4fe22243c23 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:54.401403 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c698395-23c0-4bb0-98e4-59c0c0b84a82 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:54.406718 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2abf52-aa39-4d5d-ad0b-fe95767b3467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:54.411317 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2abf52-aa39-4d5d-ad0b-fe95767b3467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:54.411317 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2abf52-aa39-4d5d-ad0b-fe95767b3467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:54.411317 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2abf52-aa39-4d5d-ad0b-fe95767b3467 admin admin] PATH_INFO: `/v3/users/86a1d56f59e14c999421b7199c9877d4` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:54.411809 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1144/2288] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:48:54.411893 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2abf52-aa39-4d5d-ad0b-fe95767b3467 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86a1d56f59e14c999421b7199c9877d4)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:54.411893 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2abf52-aa39-4d5d-ad0b-fe95767b3467 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:54.415024 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada981aa-d0f3-4154-aeaa-f4fe22243c23 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:54.426354 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada981aa-d0f3-4154-aeaa-f4fe22243c23 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:54.431555 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474481d8-c3a5-4a08-80de-715db92aaef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:54.432247 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474481d8-c3a5-4a08-80de-715db92aaef2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:54.432521 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474481d8-c3a5-4a08-80de-715db92aaef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:54.432808 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474481d8-c3a5-4a08-80de-715db92aaef2 admin admin] PATH_INFO: `/v3/projects/c41dc4ed7daa447fb085f534573a8b82/users/835a9b5c1d174c29a19ed1bab9f298d9/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:54.434853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474481d8-c3a5-4a08-80de-715db92aaef2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c41dc4ed7daa447fb085f534573a8b82, user_id=835a9b5c1d174c29a19ed1bab9f298d9, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:54.437612 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474481d8-c3a5-4a08-80de-715db92aaef2 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:54.455045 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1145/2289] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:48:54 2022] PUT /identity/v3/projects/c41dc4ed7daa447fb085f534573a8b82/users/835a9b5c1d174c29a19ed1bab9f298d9/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:48:54.471827 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7ea90-3389-44a3-922e-5511b633a23e None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:54.472021 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7ea90-3389-44a3-922e-5511b633a23e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:54.472336 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7ea90-3389-44a3-922e-5511b633a23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:54.501210 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-98b7ea90-3389-44a3-922e-5511b633a23e None None] MFA Rules not processed for user `835a9b5c1d174c29a19ed1bab9f298d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:54.502371 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-98b7ea90-3389-44a3-922e-5511b633a23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:54.524026 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:54.567851 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:54.578341 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1146/2290] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:54 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:48:54.591139 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7ea90-3389-44a3-922e-5511b633a23e None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:54.593079 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-98b7ea90-3389-44a3-922e-5511b633a23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:54.604459 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-7f2abf52-aa39-4d5d-ad0b-fe95767b3467 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86a1d56f59e14c999421b7199c9877d4'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:54.617939 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-7f2abf52-aa39-4d5d-ad0b-fe95767b3467 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86a1d56f59e14c999421b7199c9877d4'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:54.626324 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-7f2abf52-aa39-4d5d-ad0b-fe95767b3467 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86a1d56f59e14c999421b7199c9877d4'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:54.627099 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-7f2abf52-aa39-4d5d-ad0b-fe95767b3467 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86a1d56f59e14c999421b7199c9877d4'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:54.627717 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-7f2abf52-aa39-4d5d-ad0b-fe95767b3467 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86a1d56f59e14c999421b7199c9877d4'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:54.658977 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7ea90-3389-44a3-922e-5511b633a23e None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:54.663188 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232c11b-0ed6-475d-99d4-272950c35d7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:54.666755 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232c11b-0ed6-475d-99d4-272950c35d7a service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:54.666755 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232c11b-0ed6-475d-99d4-272950c35d7a service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:54.666755 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232c11b-0ed6-475d-99d4-272950c35d7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:54.666755 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6232c11b-0ed6-475d-99d4-272950c35d7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:54.678607 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6232c11b-0ed6-475d-99d4-272950c35d7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:54.680106 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6232c11b-0ed6-475d-99d4-272950c35d7a service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:54.689546 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1147/2291] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:54 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:48:54.704820 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1145/2292] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:48:54 2022] DELETE /identity/v3/users/86a1d56f59e14c999421b7199c9877d4 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:48:54.709109 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb3f5c-a1ac-4492-93f2-a5821fd7e319 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:54.712668 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb3f5c-a1ac-4492-93f2-a5821fd7e319 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:54.712668 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb3f5c-a1ac-4492-93f2-a5821fd7e319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:54.729020 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-07eb3f5c-a1ac-4492-93f2-a5821fd7e319 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:54.730195 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-07eb3f5c-a1ac-4492-93f2-a5821fd7e319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:54.790568 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1148/2293] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:54.800371 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2abf52-aa39-4d5d-ad0b-fe95767b3467 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:54.801889 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-7f2abf52-aa39-4d5d-ad0b-fe95767b3467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:54.867902 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2abf52-aa39-4d5d-ad0b-fe95767b3467 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:54.871569 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530091d-4e4f-4843-ac7f-6c030eef5d0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:54.872199 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530091d-4e4f-4843-ac7f-6c030eef5d0c service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:54.872478 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530091d-4e4f-4843-ac7f-6c030eef5d0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:54.872746 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530091d-4e4f-4843-ac7f-6c030eef5d0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:54.882478 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e530091d-4e4f-4843-ac7f-6c030eef5d0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:54.883947 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e530091d-4e4f-4843-ac7f-6c030eef5d0c service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:54.893702 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1146/2294] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:48:54.923511 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb3f5c-a1ac-4492-93f2-a5821fd7e319 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:54.925423 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-07eb3f5c-a1ac-4492-93f2-a5821fd7e319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:54.987056 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb3f5c-a1ac-4492-93f2-a5821fd7e319 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:54.992028 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b3b2e-b68d-480d-be9a-f75a153c3586 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:54.998569 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b3b2e-b68d-480d-be9a-f75a153c3586 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:54.998569 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b3b2e-b68d-480d-be9a-f75a153c3586 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:54.998569 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b3b2e-b68d-480d-be9a-f75a153c3586 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:54.998569 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ec8b3b2e-b68d-480d-be9a-f75a153c3586 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:55.044458 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:55.059411 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b3b2e-b68d-480d-be9a-f75a153c3586 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:55.061633 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b3b2e-b68d-480d-be9a-f75a153c3586 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:55.075593 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1149/2295] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:48:55.323955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530091d-4e4f-4843-ac7f-6c030eef5d0c service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:55.328190 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e530091d-4e4f-4843-ac7f-6c030eef5d0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:55.341201 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530091d-4e4f-4843-ac7f-6c030eef5d0c service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:55.345868 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e45ab3-57cc-450e-9504-9664ba93bcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:55.346523 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e45ab3-57cc-450e-9504-9664ba93bcd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:55.347242 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e45ab3-57cc-450e-9504-9664ba93bcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:55.347541 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e45ab3-57cc-450e-9504-9664ba93bcd0 admin admin] PATH_INFO: `/v3/projects/bd39937c048a43e692dabcdb16588955` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:55.348990 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e45ab3-57cc-450e-9504-9664ba93bcd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd39937c048a43e692dabcdb16588955)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:55.351484 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e45ab3-57cc-450e-9504-9664ba93bcd0 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:55.478691 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f0e45ab3-57cc-450e-9504-9664ba93bcd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd39937c048a43e692dabcdb16588955', 'request_id': 'req-f0e45ab3-57cc-450e-9504-9664ba93bcd0'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:55.485400 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f0e45ab3-57cc-450e-9504-9664ba93bcd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd39937c048a43e692dabcdb16588955', 'request_id': 'req-f0e45ab3-57cc-450e-9504-9664ba93bcd0'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:55.491097 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f0e45ab3-57cc-450e-9504-9664ba93bcd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd39937c048a43e692dabcdb16588955', 'request_id': 'req-f0e45ab3-57cc-450e-9504-9664ba93bcd0'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:55.556888 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f0e45ab3-57cc-450e-9504-9664ba93bcd0 admin admin] The token cache is being invalidate because project bd39937c048a43e692dabcdb16588955 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:48:55.557656 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f0e45ab3-57cc-450e-9504-9664ba93bcd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:55.557879 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f0e45ab3-57cc-450e-9504-9664ba93bcd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:55.559405 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1147/2296] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:48:55 2022] DELETE /identity/v3/projects/bd39937c048a43e692dabcdb16588955 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:55.563949 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b3b2e-b68d-480d-be9a-f75a153c3586 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:55.580301 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b3b2e-b68d-480d-be9a-f75a153c3586 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:55.647409 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6facc-75c8-46f1-8ffd-3ab9df3a1376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:55.648043 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6facc-75c8-46f1-8ffd-3ab9df3a1376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:55.648358 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6facc-75c8-46f1-8ffd-3ab9df3a1376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:55.648629 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6facc-75c8-46f1-8ffd-3ab9df3a1376 admin admin] PATH_INFO: `/v3/users/f064fdcf4692460499771d6b6068d82a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:55.649743 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a6facc-75c8-46f1-8ffd-3ab9df3a1376 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f064fdcf4692460499771d6b6068d82a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:55.651750 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a6facc-75c8-46f1-8ffd-3ab9df3a1376 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:55.846895 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-03a6facc-75c8-46f1-8ffd-3ab9df3a1376 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f064fdcf4692460499771d6b6068d82a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:55.860078 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-03a6facc-75c8-46f1-8ffd-3ab9df3a1376 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f064fdcf4692460499771d6b6068d82a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:55.861561 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-03a6facc-75c8-46f1-8ffd-3ab9df3a1376 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f064fdcf4692460499771d6b6068d82a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:55.868250 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-03a6facc-75c8-46f1-8ffd-3ab9df3a1376 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f064fdcf4692460499771d6b6068d82a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:55.869207 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-03a6facc-75c8-46f1-8ffd-3ab9df3a1376 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f064fdcf4692460499771d6b6068d82a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:55.951098 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1150/2297] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:48:55 2022] DELETE /identity/v3/users/f064fdcf4692460499771d6b6068d82a => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:56.374800 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e45ab3-57cc-450e-9504-9664ba93bcd0 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:56.376312 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f0e45ab3-57cc-450e-9504-9664ba93bcd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:56.391540 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e45ab3-57cc-450e-9504-9664ba93bcd0 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:56.425079 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:56.454859 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499634ee-6f68-471e-af1d-ceb2022732de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:56.455482 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499634ee-6f68-471e-af1d-ceb2022732de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:56.455759 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499634ee-6f68-471e-af1d-ceb2022732de admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:56.456031 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499634ee-6f68-471e-af1d-ceb2022732de admin admin] PATH_INFO: `/v3/projects/e2a97cace5804a74b04ffeda0319b732` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:56.457163 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499634ee-6f68-471e-af1d-ceb2022732de admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2a97cace5804a74b04ffeda0319b732)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:56.459619 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499634ee-6f68-471e-af1d-ceb2022732de admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:56.601832 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-499634ee-6f68-471e-af1d-ceb2022732de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2a97cace5804a74b04ffeda0319b732', 'request_id': 'req-499634ee-6f68-471e-af1d-ceb2022732de'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:56.608140 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-499634ee-6f68-471e-af1d-ceb2022732de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2a97cace5804a74b04ffeda0319b732', 'request_id': 'req-499634ee-6f68-471e-af1d-ceb2022732de'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:56.614182 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-499634ee-6f68-471e-af1d-ceb2022732de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2a97cace5804a74b04ffeda0319b732', 'request_id': 'req-499634ee-6f68-471e-af1d-ceb2022732de'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:56.681583 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-499634ee-6f68-471e-af1d-ceb2022732de admin admin] The token cache is being invalidate because project e2a97cace5804a74b04ffeda0319b732 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:48:56.681875 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-499634ee-6f68-471e-af1d-ceb2022732de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:56.682498 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-499634ee-6f68-471e-af1d-ceb2022732de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:56.684131 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1148/2298] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:48:56 2022] DELETE /identity/v3/projects/e2a97cace5804a74b04ffeda0319b732 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:56.689062 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078435b-b03d-49f2-b96f-d314e0cb4288 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:56.689526 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078435b-b03d-49f2-b96f-d314e0cb4288 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:56.689730 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078435b-b03d-49f2-b96f-d314e0cb4288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:56.711971 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-1078435b-b03d-49f2-b96f-d314e0cb4288 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:56.713213 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-1078435b-b03d-49f2-b96f-d314e0cb4288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:56.773865 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1151/2299] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:56.781545 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9771525-ae01-42e1-ab3b-0a14f302f923 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:56.786604 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9771525-ae01-42e1-ab3b-0a14f302f923 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:56.786604 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9771525-ae01-42e1-ab3b-0a14f302f923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:56.801828 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-f9771525-ae01-42e1-ab3b-0a14f302f923 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:56.803683 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f9771525-ae01-42e1-ab3b-0a14f302f923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:56.811716 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1149/2300] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:56.815918 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078435b-b03d-49f2-b96f-d314e0cb4288 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:56.826114 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078435b-b03d-49f2-b96f-d314e0cb4288 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:56.830738 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545f555-41c9-4ebc-888b-af374dae8305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:56.831335 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545f555-41c9-4ebc-888b-af374dae8305 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:56.831613 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545f555-41c9-4ebc-888b-af374dae8305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:56.831888 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545f555-41c9-4ebc-888b-af374dae8305 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:56.832560 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c545f555-41c9-4ebc-888b-af374dae8305 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:48:56.832967 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c545f555-41c9-4ebc-888b-af374dae8305 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:56.835250 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c545f555-41c9-4ebc-888b-af374dae8305 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:56.842016 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:56.847501 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1152/2301] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:48:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:48:56.852584 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9771525-ae01-42e1-ab3b-0a14f302f923 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:56.861787 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9771525-ae01-42e1-ab3b-0a14f302f923 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:56.866708 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9d3ea-3b2f-4fd3-9465-15f2c270decc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:56.867305 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9d3ea-3b2f-4fd3-9465-15f2c270decc admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:56.867581 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9d3ea-3b2f-4fd3-9465-15f2c270decc admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:56.867916 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9d3ea-3b2f-4fd3-9465-15f2c270decc admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:56.868526 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9d3ea-3b2f-4fd3-9465-15f2c270decc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:56.870544 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9d3ea-3b2f-4fd3-9465-15f2c270decc admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:56.992103 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1150/2302] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:48:56 2022] POST /identity/v3/projects => generated 387 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:48:56.996288 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545f555-41c9-4ebc-888b-af374dae8305 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:57.006009 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545f555-41c9-4ebc-888b-af374dae8305 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:57.063298 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b97d5b-8139-4572-9d42-974c5ee36b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:57.063903 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b97d5b-8139-4572-9d42-974c5ee36b93 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:57.064293 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b97d5b-8139-4572-9d42-974c5ee36b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:57.064565 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b97d5b-8139-4572-9d42-974c5ee36b93 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:57.065202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b97d5b-8139-4572-9d42-974c5ee36b93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:57.067162 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b97d5b-8139-4572-9d42-974c5ee36b93 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:57.178515 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1153/2303] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:48:56 2022] POST /identity/v3/users => generated 294 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:48:57.178626 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9d3ea-3b2f-4fd3-9465-15f2c270decc admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:57.184082 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9d3ea-3b2f-4fd3-9465-15f2c270decc admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:57.188916 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22738166-41fc-4985-8db2-57452735ead1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:57.189515 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22738166-41fc-4985-8db2-57452735ead1 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:57.189996 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22738166-41fc-4985-8db2-57452735ead1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:57.190175 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22738166-41fc-4985-8db2-57452735ead1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:57.190661 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22738166-41fc-4985-8db2-57452735ead1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:57.192292 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22738166-41fc-4985-8db2-57452735ead1 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:57.206439 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1151/2304] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:48:57.209002 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b97d5b-8139-4572-9d42-974c5ee36b93 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:57.217482 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22738166-41fc-4985-8db2-57452735ead1 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:57.219341 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-22738166-41fc-4985-8db2-57452735ead1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:57.220632 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b97d5b-8139-4572-9d42-974c5ee36b93 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:57.225321 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8cdd9d-0e3c-4371-a0b0-b13632d462c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:57.230357 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cdd9d-0e3c-4371-a0b0-b13632d462c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:57.230357 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cdd9d-0e3c-4371-a0b0-b13632d462c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:57.230357 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cdd9d-0e3c-4371-a0b0-b13632d462c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:57.230357 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8cdd9d-0e3c-4371-a0b0-b13632d462c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:57.230357 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8cdd9d-0e3c-4371-a0b0-b13632d462c7 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:57.236329 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22738166-41fc-4985-8db2-57452735ead1 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:57.241230 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db02b9-8825-4064-80ea-43687ceaa8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:57.241378 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1154/2305] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:48:57.241999 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db02b9-8825-4064-80ea-43687ceaa8f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:57.242338 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db02b9-8825-4064-80ea-43687ceaa8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:57.242663 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db02b9-8825-4064-80ea-43687ceaa8f1 admin admin] PATH_INFO: `/v3/users/a3026edee3c34da388d2f2f521600d24` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:57.243842 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db02b9-8825-4064-80ea-43687ceaa8f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3026edee3c34da388d2f2f521600d24)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:57.245822 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db02b9-8825-4064-80ea-43687ceaa8f1 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:57.245938 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8cdd9d-0e3c-4371-a0b0-b13632d462c7 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:57.256194 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8cdd9d-0e3c-4371-a0b0-b13632d462c7 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:57.262916 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510c47f-0dd8-4d62-826b-23ab8f84f304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:57.263875 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510c47f-0dd8-4d62-826b-23ab8f84f304 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:57.264414 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510c47f-0dd8-4d62-826b-23ab8f84f304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:57.264839 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510c47f-0dd8-4d62-826b-23ab8f84f304 admin admin] PATH_INFO: `/v3/projects/067d05027ed44cd49e32826322404f81/users/e8564b6dfbf04485bb02e63dd84b76c9/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:57.283210 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5510c47f-0dd8-4d62-826b-23ab8f84f304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=067d05027ed44cd49e32826322404f81, user_id=e8564b6dfbf04485bb02e63dd84b76c9, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:57.286255 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5510c47f-0dd8-4d62-826b-23ab8f84f304 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:57.373948 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1155/2306] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:48:57 2022] PUT /identity/v3/projects/067d05027ed44cd49e32826322404f81/users/e8564b6dfbf04485bb02e63dd84b76c9/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:48:57.386024 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be38cb6-610a-4f55-8bdc-b3167671f386 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:57.386305 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be38cb6-610a-4f55-8bdc-b3167671f386 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:57.386583 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be38cb6-610a-4f55-8bdc-b3167671f386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:57.415667 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-8be38cb6-610a-4f55-8bdc-b3167671f386 None None] MFA Rules not processed for user `e8564b6dfbf04485bb02e63dd84b76c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:57.416836 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8be38cb6-610a-4f55-8bdc-b3167671f386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:57.464853 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e1db02b9-8825-4064-80ea-43687ceaa8f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3026edee3c34da388d2f2f521600d24'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:57.478419 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e1db02b9-8825-4064-80ea-43687ceaa8f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3026edee3c34da388d2f2f521600d24'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:57.486521 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e1db02b9-8825-4064-80ea-43687ceaa8f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3026edee3c34da388d2f2f521600d24'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:57.489035 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e1db02b9-8825-4064-80ea-43687ceaa8f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3026edee3c34da388d2f2f521600d24'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:57.489148 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1156/2307] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:57.489252 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e1db02b9-8825-4064-80ea-43687ceaa8f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3026edee3c34da388d2f2f521600d24'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:57.492605 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:57.493040 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be38cb6-610a-4f55-8bdc-b3167671f386 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:57.537146 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:57.556126 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be38cb6-610a-4f55-8bdc-b3167671f386 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:57.556903 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1152/2308] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:48:57 2022] DELETE /identity/v3/users/a3026edee3c34da388d2f2f521600d24 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:48:57.561290 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f972cb0-c434-4c44-b35d-7afa3d912434 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:57.561577 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f972cb0-c434-4c44-b35d-7afa3d912434 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:57.561849 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f972cb0-c434-4c44-b35d-7afa3d912434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:57.581182 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-9f972cb0-c434-4c44-b35d-7afa3d912434 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:57.582406 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-9f972cb0-c434-4c44-b35d-7afa3d912434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:57.616788 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad999e5-51f2-475d-a3f5-8340d3ba17f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:57.617394 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad999e5-51f2-475d-a3f5-8340d3ba17f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:57.617671 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad999e5-51f2-475d-a3f5-8340d3ba17f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:57.617937 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad999e5-51f2-475d-a3f5-8340d3ba17f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:57.618558 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad999e5-51f2-475d-a3f5-8340d3ba17f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:57.620534 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad999e5-51f2-475d-a3f5-8340d3ba17f5 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:57.641603 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1153/2309] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:48:57.651876 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f972cb0-c434-4c44-b35d-7afa3d912434 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:57.653266 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-9f972cb0-c434-4c44-b35d-7afa3d912434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:57.709304 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f972cb0-c434-4c44-b35d-7afa3d912434 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:57.713565 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9311189-fa4c-42cb-adbc-96cad4564e80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:57.714166 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9311189-fa4c-42cb-adbc-96cad4564e80 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:57.714445 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9311189-fa4c-42cb-adbc-96cad4564e80 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:57.714717 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9311189-fa4c-42cb-adbc-96cad4564e80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:57.723532 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9311189-fa4c-42cb-adbc-96cad4564e80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:57.725089 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9311189-fa4c-42cb-adbc-96cad4564e80 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:57.735060 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1154/2310] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:48:57.746313 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1157/2311] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:48:57 2022] POST /identity/v3/projects => generated 387 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:48:57.750257 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9311189-fa4c-42cb-adbc-96cad4564e80 service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:57.754021 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a9311189-fa4c-42cb-adbc-96cad4564e80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:57.766411 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9311189-fa4c-42cb-adbc-96cad4564e80 service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:57.828642 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6929d-04e7-49a5-971d-f213e71490fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:57.829248 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6929d-04e7-49a5-971d-f213e71490fe admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:57.829525 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6929d-04e7-49a5-971d-f213e71490fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:57.829912 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6929d-04e7-49a5-971d-f213e71490fe admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:57.830555 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb6929d-04e7-49a5-971d-f213e71490fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:57.832484 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb6929d-04e7-49a5-971d-f213e71490fe admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:57.934602 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1155/2312] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:48:57 2022] POST /identity/v3/users => generated 300 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:48:57.938898 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad999e5-51f2-475d-a3f5-8340d3ba17f5 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:57.950686 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad999e5-51f2-475d-a3f5-8340d3ba17f5 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:57.956490 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2244af2-dfb7-49e8-8808-a6c29242c085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:57.962187 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2244af2-dfb7-49e8-8808-a6c29242c085 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:57.962187 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2244af2-dfb7-49e8-8808-a6c29242c085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:57.962187 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2244af2-dfb7-49e8-8808-a6c29242c085 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:57.962187 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2244af2-dfb7-49e8-8808-a6c29242c085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:57.962187 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2244af2-dfb7-49e8-8808-a6c29242c085 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:57.973650 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1158/2313] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:48:57.983837 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6929d-04e7-49a5-971d-f213e71490fe admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:57.994960 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6929d-04e7-49a5-971d-f213e71490fe admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:57.999773 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a98b56-a238-435a-9203-32b89f6cb4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:58.000481 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a98b56-a238-435a-9203-32b89f6cb4f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:58.000759 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a98b56-a238-435a-9203-32b89f6cb4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:58.001046 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a98b56-a238-435a-9203-32b89f6cb4f5 admin admin] PATH_INFO: `/v3/projects/4662f60087884958a20f60364572fdae/users/0b2ca15a9eca45b581337ea5b8c7220c/roles/9252c356af254127896f3626d925a88a` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:58.017928 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a98b56-a238-435a-9203-32b89f6cb4f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4662f60087884958a20f60364572fdae, user_id=0b2ca15a9eca45b581337ea5b8c7220c, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:58.020704 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a98b56-a238-435a-9203-32b89f6cb4f5 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:58.129027 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:58.133931 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1156/2314] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:48:57 2022] PUT /identity/v3/projects/4662f60087884958a20f60364572fdae/users/0b2ca15a9eca45b581337ea5b8c7220c/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:58.137887 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2244af2-dfb7-49e8-8808-a6c29242c085 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:58.148427 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2244af2-dfb7-49e8-8808-a6c29242c085 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:58.153256 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a98b56-a238-435a-9203-32b89f6cb4f5 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:58.155029 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-b4a98b56-a238-435a-9203-32b89f6cb4f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:58.220787 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf20979e-956f-4780-ba7e-e1b044e83332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:58.221465 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20979e-956f-4780-ba7e-e1b044e83332 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:58.221596 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20979e-956f-4780-ba7e-e1b044e83332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:58.221848 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20979e-956f-4780-ba7e-e1b044e83332 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:58.222487 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf20979e-956f-4780-ba7e-e1b044e83332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:58.224467 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf20979e-956f-4780-ba7e-e1b044e83332 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:58.233779 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a98b56-a238-435a-9203-32b89f6cb4f5 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:58.235453 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1159/2315] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:48:58.239538 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf20979e-956f-4780-ba7e-e1b044e83332 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:58.242565 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633a9a5-5265-416d-b78e-667aed44300a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:58.242565 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633a9a5-5265-416d-b78e-667aed44300a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:58.242833 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633a9a5-5265-416d-b78e-667aed44300a admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:58.242927 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633a9a5-5265-416d-b78e-667aed44300a admin admin] PATH_INFO: `/v3/projects/6ef923e635ea49e5b9bdc71f67728353` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:58.243965 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633a9a5-5265-416d-b78e-667aed44300a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ef923e635ea49e5b9bdc71f67728353)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:58.245927 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633a9a5-5265-416d-b78e-667aed44300a admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:58.249806 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf20979e-956f-4780-ba7e-e1b044e83332 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:58.254719 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ffd58-5315-4b6a-aa6f-d6f44c9e1c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:58.255369 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ffd58-5315-4b6a-aa6f-d6f44c9e1c14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:58.255645 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ffd58-5315-4b6a-aa6f-d6f44c9e1c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:58.255916 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ffd58-5315-4b6a-aa6f-d6f44c9e1c14 admin admin] PATH_INFO: `/v3/projects/4662f60087884958a20f60364572fdae/users/0b2ca15a9eca45b581337ea5b8c7220c/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:58.257927 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ffd58-5315-4b6a-aa6f-d6f44c9e1c14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4662f60087884958a20f60364572fdae, user_id=0b2ca15a9eca45b581337ea5b8c7220c, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:58.260767 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ffd58-5315-4b6a-aa6f-d6f44c9e1c14 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:58.271259 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1160/2316] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:48:58 2022] PUT /identity/v3/projects/4662f60087884958a20f60364572fdae/users/0b2ca15a9eca45b581337ea5b8c7220c/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:48:58.281803 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4cbe6-826f-41e1-a4be-ddf02e4b3660 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:58.282088 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4cbe6-826f-41e1-a4be-ddf02e4b3660 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:58.282362 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4cbe6-826f-41e1-a4be-ddf02e4b3660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:58.311356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-c9b4cbe6-826f-41e1-a4be-ddf02e4b3660 None None] MFA Rules not processed for user `0b2ca15a9eca45b581337ea5b8c7220c`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:58.312618 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c9b4cbe6-826f-41e1-a4be-ddf02e4b3660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:58.345794 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:58.380827 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1161/2317] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:58 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:48:58.388976 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f633a9a5-5265-416d-b78e-667aed44300a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ef923e635ea49e5b9bdc71f67728353', 'request_id': 'req-f633a9a5-5265-416d-b78e-667aed44300a'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:58.403261 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f633a9a5-5265-416d-b78e-667aed44300a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ef923e635ea49e5b9bdc71f67728353', 'request_id': 'req-f633a9a5-5265-416d-b78e-667aed44300a'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:58.405637 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4cbe6-826f-41e1-a4be-ddf02e4b3660 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:58.407905 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c9b4cbe6-826f-41e1-a4be-ddf02e4b3660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:58.413291 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f633a9a5-5265-416d-b78e-667aed44300a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ef923e635ea49e5b9bdc71f67728353', 'request_id': 'req-f633a9a5-5265-416d-b78e-667aed44300a'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:58.498634 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4cbe6-826f-41e1-a4be-ddf02e4b3660 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:58.533282 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f633a9a5-5265-416d-b78e-667aed44300a admin admin] The token cache is being invalidate because project 6ef923e635ea49e5b9bdc71f67728353 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:48:58.533840 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f633a9a5-5265-416d-b78e-667aed44300a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:58.535221 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f633a9a5-5265-416d-b78e-667aed44300a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:58.541078 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1157/2318] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:48:58 2022] DELETE /identity/v3/projects/6ef923e635ea49e5b9bdc71f67728353 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:48:58.543227 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633a9a5-5265-416d-b78e-667aed44300a admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:58.545258 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f633a9a5-5265-416d-b78e-667aed44300a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:58.559116 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1853cde-ac15-4e78-a69c-8daaa93e446d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:58.559938 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1853cde-ac15-4e78-a69c-8daaa93e446d service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:58.561224 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1853cde-ac15-4e78-a69c-8daaa93e446d service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:58.561510 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1853cde-ac15-4e78-a69c-8daaa93e446d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:58.564720 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f1853cde-ac15-4e78-a69c-8daaa93e446d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:58.618899 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633a9a5-5265-416d-b78e-667aed44300a admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:58.625620 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd0e34-50ab-4c3d-8046-fd2f335e9ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:58.626250 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd0e34-50ab-4c3d-8046-fd2f335e9ee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:58.626524 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd0e34-50ab-4c3d-8046-fd2f335e9ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:58.626792 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd0e34-50ab-4c3d-8046-fd2f335e9ee2 admin admin] PATH_INFO: `/v3/users/00a70eb73c074edc8e7a395389ae81e9` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:58.627919 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd0e34-50ab-4c3d-8046-fd2f335e9ee2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00a70eb73c074edc8e7a395389ae81e9)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:58.629849 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd0e34-50ab-4c3d-8046-fd2f335e9ee2 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:58.648810 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1853cde-ac15-4e78-a69c-8daaa93e446d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:58.651030 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1853cde-ac15-4e78-a69c-8daaa93e446d service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:58.662460 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1162/2319] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:58 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:48:58.698333 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1853cde-ac15-4e78-a69c-8daaa93e446d service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:58.700356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f1853cde-ac15-4e78-a69c-8daaa93e446d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:58.716636 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1853cde-ac15-4e78-a69c-8daaa93e446d service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:58.722074 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65371451-68ea-449f-bf52-18fe86f08a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:58.722791 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65371451-68ea-449f-bf52-18fe86f08a63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:58.723135 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65371451-68ea-449f-bf52-18fe86f08a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:58.723525 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65371451-68ea-449f-bf52-18fe86f08a63 admin admin] PATH_INFO: `/v3/users/e8564b6dfbf04485bb02e63dd84b76c9` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:58.725133 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65371451-68ea-449f-bf52-18fe86f08a63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8564b6dfbf04485bb02e63dd84b76c9)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:58.727414 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65371451-68ea-449f-bf52-18fe86f08a63 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:58.826336 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:58.838843 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b1bd0e34-50ab-4c3d-8046-fd2f335e9ee2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00a70eb73c074edc8e7a395389ae81e9'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:58.850579 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b1bd0e34-50ab-4c3d-8046-fd2f335e9ee2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00a70eb73c074edc8e7a395389ae81e9'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:58.857979 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b1bd0e34-50ab-4c3d-8046-fd2f335e9ee2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00a70eb73c074edc8e7a395389ae81e9'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:58.858630 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b1bd0e34-50ab-4c3d-8046-fd2f335e9ee2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00a70eb73c074edc8e7a395389ae81e9'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:58.859246 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b1bd0e34-50ab-4c3d-8046-fd2f335e9ee2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00a70eb73c074edc8e7a395389ae81e9'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:58.867341 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:58.880713 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-65371451-68ea-449f-bf52-18fe86f08a63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8564b6dfbf04485bb02e63dd84b76c9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:58.893525 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-65371451-68ea-449f-bf52-18fe86f08a63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8564b6dfbf04485bb02e63dd84b76c9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:58.894227 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-65371451-68ea-449f-bf52-18fe86f08a63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8564b6dfbf04485bb02e63dd84b76c9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:58.901229 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-65371451-68ea-449f-bf52-18fe86f08a63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8564b6dfbf04485bb02e63dd84b76c9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:58.901871 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-65371451-68ea-449f-bf52-18fe86f08a63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8564b6dfbf04485bb02e63dd84b76c9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:58.922156 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1158/2320] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:48:58 2022] DELETE /identity/v3/users/00a70eb73c074edc8e7a395389ae81e9 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:48:59.029840 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1163/2321] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:48:58 2022] DELETE /identity/v3/users/e8564b6dfbf04485bb02e63dd84b76c9 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:48:59.038627 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09b3a0-22b1-4de2-b520-26f7b485ac94 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:59.038627 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09b3a0-22b1-4de2-b520-26f7b485ac94 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:59.038627 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09b3a0-22b1-4de2-b520-26f7b485ac94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:59.055337 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-9b09b3a0-22b1-4de2-b520-26f7b485ac94 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:59.056573 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-9b09b3a0-22b1-4de2-b520-26f7b485ac94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:59.119930 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1159/2322] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:48:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:59.129883 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65371451-68ea-449f-bf52-18fe86f08a63 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:59.131389 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-65371451-68ea-449f-bf52-18fe86f08a63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:59.194805 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65371451-68ea-449f-bf52-18fe86f08a63 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:59.200085 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8df157-9e70-459a-9b54-218b4f560aef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:59.201860 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8df157-9e70-459a-9b54-218b4f560aef service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:59.201860 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8df157-9e70-459a-9b54-218b4f560aef service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:59.201860 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8df157-9e70-459a-9b54-218b4f560aef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:59.211821 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8df157-9e70-459a-9b54-218b4f560aef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:59.213562 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8df157-9e70-459a-9b54-218b4f560aef service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:59.224723 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1164/2323] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:48:59.428223 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09b3a0-22b1-4de2-b520-26f7b485ac94 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:59.429681 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-9b09b3a0-22b1-4de2-b520-26f7b485ac94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:59.442074 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09b3a0-22b1-4de2-b520-26f7b485ac94 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:59.447498 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc7e60-9248-446a-b0b5-0d77d915fd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:59.448208 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc7e60-9248-446a-b0b5-0d77d915fd36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:59.448435 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc7e60-9248-446a-b0b5-0d77d915fd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:59.448706 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc7e60-9248-446a-b0b5-0d77d915fd36 admin admin] PATH_INFO: `/v3/projects/2306f13ebde74718b8991c28a320e5a8` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:59.450149 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffc7e60-9248-446a-b0b5-0d77d915fd36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2306f13ebde74718b8991c28a320e5a8)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:59.451775 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffc7e60-9248-446a-b0b5-0d77d915fd36 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:59.576357 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-8ffc7e60-9248-446a-b0b5-0d77d915fd36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2306f13ebde74718b8991c28a320e5a8', 'request_id': 'req-8ffc7e60-9248-446a-b0b5-0d77d915fd36'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:59.587763 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-8ffc7e60-9248-446a-b0b5-0d77d915fd36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2306f13ebde74718b8991c28a320e5a8', 'request_id': 'req-8ffc7e60-9248-446a-b0b5-0d77d915fd36'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:59.591278 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-8ffc7e60-9248-446a-b0b5-0d77d915fd36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2306f13ebde74718b8991c28a320e5a8', 'request_id': 'req-8ffc7e60-9248-446a-b0b5-0d77d915fd36'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:59.664466 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-8ffc7e60-9248-446a-b0b5-0d77d915fd36 admin admin] The token cache is being invalidate because project 2306f13ebde74718b8991c28a320e5a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:48:59.664803 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-8ffc7e60-9248-446a-b0b5-0d77d915fd36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:59.665467 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-8ffc7e60-9248-446a-b0b5-0d77d915fd36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:59.667140 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1160/2324] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:48:59 2022] DELETE /identity/v3/projects/2306f13ebde74718b8991c28a320e5a8 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:59.675350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8df157-9e70-459a-9b54-218b4f560aef service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:59.681182 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8df157-9e70-459a-9b54-218b4f560aef service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:59.740299 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3fc90b-f2de-42a0-8523-472af71662ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:59.740929 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3fc90b-f2de-42a0-8523-472af71662ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:59.741209 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3fc90b-f2de-42a0-8523-472af71662ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:59.741497 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3fc90b-f2de-42a0-8523-472af71662ff admin admin] PATH_INFO: `/v3/users/d715fb2bc25349e7a528c914e08b67c2` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:59.743653 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3fc90b-f2de-42a0-8523-472af71662ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=d715fb2bc25349e7a528c914e08b67c2)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:59.745697 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3fc90b-f2de-42a0-8523-472af71662ff admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:59.803198 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc7e60-9248-446a-b0b5-0d77d915fd36 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:59.804771 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-8ffc7e60-9248-446a-b0b5-0d77d915fd36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:59.823596 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc7e60-9248-446a-b0b5-0d77d915fd36 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:59.828482 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ba82f-bff2-4622-86ee-56f4e4515c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:59.829124 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ba82f-bff2-4622-86ee-56f4e4515c43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:59.829401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ba82f-bff2-4622-86ee-56f4e4515c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:59.830257 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ba82f-bff2-4622-86ee-56f4e4515c43 admin admin] PATH_INFO: `/v3/projects/067d05027ed44cd49e32826322404f81` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:59.831411 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ba82f-bff2-4622-86ee-56f4e4515c43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=067d05027ed44cd49e32826322404f81)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:59.833432 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ba82f-bff2-4622-86ee-56f4e4515c43 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:59.902160 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:59.941723 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-538ba82f-bff2-4622-86ee-56f4e4515c43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '067d05027ed44cd49e32826322404f81', 'request_id': 'req-538ba82f-bff2-4622-86ee-56f4e4515c43'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:59.942971 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-cc3fc90b-f2de-42a0-8523-472af71662ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd715fb2bc25349e7a528c914e08b67c2'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:59.948903 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-538ba82f-bff2-4622-86ee-56f4e4515c43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '067d05027ed44cd49e32826322404f81', 'request_id': 'req-538ba82f-bff2-4622-86ee-56f4e4515c43'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:59.949055 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:59.954854 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-538ba82f-bff2-4622-86ee-56f4e4515c43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '067d05027ed44cd49e32826322404f81', 'request_id': 'req-538ba82f-bff2-4622-86ee-56f4e4515c43'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:59.956955 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-cc3fc90b-f2de-42a0-8523-472af71662ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd715fb2bc25349e7a528c914e08b67c2'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:59.957749 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-cc3fc90b-f2de-42a0-8523-472af71662ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd715fb2bc25349e7a528c914e08b67c2'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:59.965633 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-cc3fc90b-f2de-42a0-8523-472af71662ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd715fb2bc25349e7a528c914e08b67c2'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:59.967104 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-cc3fc90b-f2de-42a0-8523-472af71662ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd715fb2bc25349e7a528c914e08b67c2'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:00.017851 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-538ba82f-bff2-4622-86ee-56f4e4515c43 admin admin] The token cache is being invalidate because project 067d05027ed44cd49e32826322404f81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:49:00.018166 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-538ba82f-bff2-4622-86ee-56f4e4515c43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:00.018944 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-538ba82f-bff2-4622-86ee-56f4e4515c43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:00.020468 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1161/2325] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:48:59 2022] DELETE /identity/v3/projects/067d05027ed44cd49e32826322404f81 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:49:00.024829 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ba82f-bff2-4622-86ee-56f4e4515c43 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:00.026052 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-538ba82f-bff2-4622-86ee-56f4e4515c43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:00.088609 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1165/2326] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:48:59 2022] DELETE /identity/v3/users/d715fb2bc25349e7a528c914e08b67c2 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:00.090106 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ba82f-bff2-4622-86ee-56f4e4515c43 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:00.155327 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02761584-d08f-4a6d-848c-c1b9e046218c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:00.156185 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02761584-d08f-4a6d-848c-c1b9e046218c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:00.156474 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02761584-d08f-4a6d-848c-c1b9e046218c admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:00.156752 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02761584-d08f-4a6d-848c-c1b9e046218c admin admin] PATH_INFO: `/v3/users/0b2ca15a9eca45b581337ea5b8c7220c` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:00.157925 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02761584-d08f-4a6d-848c-c1b9e046218c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b2ca15a9eca45b581337ea5b8c7220c)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:00.160286 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02761584-d08f-4a6d-848c-c1b9e046218c admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:00.332450 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-02761584-d08f-4a6d-848c-c1b9e046218c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b2ca15a9eca45b581337ea5b8c7220c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:00.345345 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-02761584-d08f-4a6d-848c-c1b9e046218c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b2ca15a9eca45b581337ea5b8c7220c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:00.346495 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:00.353278 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-02761584-d08f-4a6d-848c-c1b9e046218c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b2ca15a9eca45b581337ea5b8c7220c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:00.354204 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-02761584-d08f-4a6d-848c-c1b9e046218c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b2ca15a9eca45b581337ea5b8c7220c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:00.355198 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-02761584-d08f-4a6d-848c-c1b9e046218c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b2ca15a9eca45b581337ea5b8c7220c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:00.454406 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1162/2327] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:49:00 2022] DELETE /identity/v3/users/0b2ca15a9eca45b581337ea5b8c7220c => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:49:00.555245 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3fc90b-f2de-42a0-8523-472af71662ff admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:00.557846 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-cc3fc90b-f2de-42a0-8523-472af71662ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:00.585403 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3fc90b-f2de-42a0-8523-472af71662ff admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:00.645140 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50e386-fa5d-41ae-9176-22312bbf5b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:00.645775 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50e386-fa5d-41ae-9176-22312bbf5b8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:00.646221 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50e386-fa5d-41ae-9176-22312bbf5b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:00.646497 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50e386-fa5d-41ae-9176-22312bbf5b8b admin admin] PATH_INFO: `/v3/projects/09d22cfb63e04827bfc2991762b83199` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:00.647615 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c50e386-fa5d-41ae-9176-22312bbf5b8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=09d22cfb63e04827bfc2991762b83199)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:00.649546 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c50e386-fa5d-41ae-9176-22312bbf5b8b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:00.783047 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4c50e386-fa5d-41ae-9176-22312bbf5b8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09d22cfb63e04827bfc2991762b83199', 'request_id': 'req-4c50e386-fa5d-41ae-9176-22312bbf5b8b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:00.789936 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4c50e386-fa5d-41ae-9176-22312bbf5b8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09d22cfb63e04827bfc2991762b83199', 'request_id': 'req-4c50e386-fa5d-41ae-9176-22312bbf5b8b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:00.796525 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4c50e386-fa5d-41ae-9176-22312bbf5b8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09d22cfb63e04827bfc2991762b83199', 'request_id': 'req-4c50e386-fa5d-41ae-9176-22312bbf5b8b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:00.898002 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4c50e386-fa5d-41ae-9176-22312bbf5b8b admin admin] The token cache is being invalidate because project 09d22cfb63e04827bfc2991762b83199 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:49:00.898287 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4c50e386-fa5d-41ae-9176-22312bbf5b8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:00.898909 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4c50e386-fa5d-41ae-9176-22312bbf5b8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:00.901112 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1166/2328] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:49:00 2022] DELETE /identity/v3/projects/09d22cfb63e04827bfc2991762b83199 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:00.906055 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842bec9-636b-40db-8e2f-061ff012da0c None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:00.906521 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842bec9-636b-40db-8e2f-061ff012da0c None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:00.906616 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842bec9-636b-40db-8e2f-061ff012da0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:00.927648 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-0842bec9-636b-40db-8e2f-061ff012da0c None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:00.928885 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-0842bec9-636b-40db-8e2f-061ff012da0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:00.980892 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50e386-fa5d-41ae-9176-22312bbf5b8b admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:00.982363 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4c50e386-fa5d-41ae-9176-22312bbf5b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:00.989045 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1163/2329] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:00.997354 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410f56f-6156-4a25-8a08-dbece191e841 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:00.997574 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50e386-fa5d-41ae-9176-22312bbf5b8b admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:00.997767 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410f56f-6156-4a25-8a08-dbece191e841 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:00.998034 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410f56f-6156-4a25-8a08-dbece191e841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:01.003913 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a480f7-1e7b-45e0-ba33-787684c5ff19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:01.005314 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a480f7-1e7b-45e0-ba33-787684c5ff19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:01.005598 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a480f7-1e7b-45e0-ba33-787684c5ff19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:01.005901 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a480f7-1e7b-45e0-ba33-787684c5ff19 admin admin] PATH_INFO: `/v3/projects/4662f60087884958a20f60364572fdae` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:01.012821 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a480f7-1e7b-45e0-ba33-787684c5ff19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4662f60087884958a20f60364572fdae)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:01.012821 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a480f7-1e7b-45e0-ba33-787684c5ff19 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:01.027965 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-d410f56f-6156-4a25-8a08-dbece191e841 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:01.030461 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-d410f56f-6156-4a25-8a08-dbece191e841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:01.040371 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1164/2330] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:49:01.044362 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410f56f-6156-4a25-8a08-dbece191e841 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:01.053267 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410f56f-6156-4a25-8a08-dbece191e841 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:01.058265 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc3e6b-1571-43e0-8b72-b5179a5ad739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:01.058859 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc3e6b-1571-43e0-8b72-b5179a5ad739 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:01.059133 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc3e6b-1571-43e0-8b72-b5179a5ad739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:01.059402 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc3e6b-1571-43e0-8b72-b5179a5ad739 admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:01.060034 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc3e6b-1571-43e0-8b72-b5179a5ad739 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:49:01.060367 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc3e6b-1571-43e0-8b72-b5179a5ad739 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:01.061944 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc3e6b-1571-43e0-8b72-b5179a5ad739 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:01.074491 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1165/2331] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:49:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:49:01.078781 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc3e6b-1571-43e0-8b72-b5179a5ad739 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:01.090367 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc3e6b-1571-43e0-8b72-b5179a5ad739 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:01.095825 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd41156-ddf9-468b-a8ec-8ebdaffdb653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:01.096614 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd41156-ddf9-468b-a8ec-8ebdaffdb653 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:01.097034 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd41156-ddf9-468b-a8ec-8ebdaffdb653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:01.097269 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd41156-ddf9-468b-a8ec-8ebdaffdb653 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:01.100533 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd41156-ddf9-468b-a8ec-8ebdaffdb653 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:01.100533 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd41156-ddf9-468b-a8ec-8ebdaffdb653 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:01.119884 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-07a480f7-1e7b-45e0-ba33-787684c5ff19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4662f60087884958a20f60364572fdae', 'request_id': 'req-07a480f7-1e7b-45e0-ba33-787684c5ff19'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:01.124984 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:01.126397 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-07a480f7-1e7b-45e0-ba33-787684c5ff19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4662f60087884958a20f60364572fdae', 'request_id': 'req-07a480f7-1e7b-45e0-ba33-787684c5ff19'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:01.133464 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-07a480f7-1e7b-45e0-ba33-787684c5ff19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4662f60087884958a20f60364572fdae', 'request_id': 'req-07a480f7-1e7b-45e0-ba33-787684c5ff19'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:01.164255 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1166/2332] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:49:01 2022] POST /identity/v3/projects => generated 373 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:49:01.168917 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd41156-ddf9-468b-a8ec-8ebdaffdb653 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:01.182195 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-07a480f7-1e7b-45e0-ba33-787684c5ff19 admin admin] The token cache is being invalidate because project 4662f60087884958a20f60364572fdae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:49:01.182195 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-07a480f7-1e7b-45e0-ba33-787684c5ff19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:01.182195 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-07a480f7-1e7b-45e0-ba33-787684c5ff19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:01.182985 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1167/2333] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:49:00 2022] DELETE /identity/v3/projects/4662f60087884958a20f60364572fdae => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:49:01.188339 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48578cc-5d69-410c-aee3-39f99f6a0cee None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:01.188625 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48578cc-5d69-410c-aee3-39f99f6a0cee None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:01.188943 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48578cc-5d69-410c-aee3-39f99f6a0cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:01.209496 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-d48578cc-5d69-410c-aee3-39f99f6a0cee None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:01.210835 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d48578cc-5d69-410c-aee3-39f99f6a0cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:01.238527 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd41156-ddf9-468b-a8ec-8ebdaffdb653 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:01.243656 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d6865-0bde-4992-93b7-75760b9a9e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:01.250495 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d6865-0bde-4992-93b7-75760b9a9e6e admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:01.250495 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d6865-0bde-4992-93b7-75760b9a9e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:01.250495 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d6865-0bde-4992-93b7-75760b9a9e6e admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:01.250495 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d6865-0bde-4992-93b7-75760b9a9e6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:01.250495 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d6865-0bde-4992-93b7-75760b9a9e6e admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:01.276654 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1168/2334] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:49:01.285909 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbbccb-2bcc-4ed1-a1b3-af2e3385f5df None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:01.286195 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbbccb-2bcc-4ed1-a1b3-af2e3385f5df None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:01.286472 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbbccb-2bcc-4ed1-a1b3-af2e3385f5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:01.306823 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-bcbbbccb-2bcc-4ed1-a1b3-af2e3385f5df None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:01.308082 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-bcbbbccb-2bcc-4ed1-a1b3-af2e3385f5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:01.316474 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1169/2335] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:49:01.316616 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1167/2336] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:49:01 2022] POST /identity/v3/users => generated 287 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:49:01.321245 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbbbccb-2bcc-4ed1-a1b3-af2e3385f5df None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:01.322555 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-bcbbbccb-2bcc-4ed1-a1b3-af2e3385f5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:01.323552 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d6865-0bde-4992-93b7-75760b9a9e6e admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:01.333953 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d6865-0bde-4992-93b7-75760b9a9e6e admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:01.334113 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbbbccb-2bcc-4ed1-a1b3-af2e3385f5df None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:01.339276 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d69bd1-3e95-485c-876d-d8902191e8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:01.341193 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed004e-d410-4325-9654-1dfa7da71c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:01.341339 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d69bd1-3e95-485c-876d-d8902191e8a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:01.341466 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed004e-d410-4325-9654-1dfa7da71c93 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:01.341560 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d69bd1-3e95-485c-876d-d8902191e8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:01.341650 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed004e-d410-4325-9654-1dfa7da71c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:01.341766 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d69bd1-3e95-485c-876d-d8902191e8a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:01.341869 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed004e-d410-4325-9654-1dfa7da71c93 admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:01.341961 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d69bd1-3e95-485c-876d-d8902191e8a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:01.342050 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed004e-d410-4325-9654-1dfa7da71c93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:49:01.342050 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed004e-d410-4325-9654-1dfa7da71c93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:01.342609 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d69bd1-3e95-485c-876d-d8902191e8a8 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:01.343105 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed004e-d410-4325-9654-1dfa7da71c93 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:01.353553 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1170/2337] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:49:01.356297 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1168/2338] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:49:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:49:01.358896 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d69bd1-3e95-485c-876d-d8902191e8a8 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:01.360380 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed004e-d410-4325-9654-1dfa7da71c93 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:01.369233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d69bd1-3e95-485c-876d-d8902191e8a8 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:01.370795 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed004e-d410-4325-9654-1dfa7da71c93 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:01.374279 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cdde83-1716-4e6b-9770-da0c88887ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:01.374872 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cdde83-1716-4e6b-9770-da0c88887ede admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:01.375147 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cdde83-1716-4e6b-9770-da0c88887ede admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:01.375419 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cdde83-1716-4e6b-9770-da0c88887ede admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:01.375655 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184bc8fb-b9bd-430a-996f-615acf9770d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:01.376176 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cdde83-1716-4e6b-9770-da0c88887ede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:01.376403 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bc8fb-b9bd-430a-996f-615acf9770d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:01.376784 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bc8fb-b9bd-430a-996f-615acf9770d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:01.377124 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bc8fb-b9bd-430a-996f-615acf9770d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:01.377762 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cdde83-1716-4e6b-9770-da0c88887ede admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:01.377861 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184bc8fb-b9bd-430a-996f-615acf9770d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:01.379802 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184bc8fb-b9bd-430a-996f-615acf9770d5 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:01.387997 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1171/2339] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:49:01.392265 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cdde83-1716-4e6b-9770-da0c88887ede admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:01.396107 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:01.403147 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cdde83-1716-4e6b-9770-da0c88887ede admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:01.407784 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89063a48-0a12-4758-b6f7-806d6c33320d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:01.408453 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89063a48-0a12-4758-b6f7-806d6c33320d admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:01.408759 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89063a48-0a12-4758-b6f7-806d6c33320d admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:01.409032 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89063a48-0a12-4758-b6f7-806d6c33320d admin admin] PATH_INFO: `/v3/projects/f0c75eae652241458ed9bb0850b5d128/users/f70e5cb58c64432c87c7828de1096394/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:01.424323 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89063a48-0a12-4758-b6f7-806d6c33320d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0c75eae652241458ed9bb0850b5d128, user_id=f70e5cb58c64432c87c7828de1096394, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:01.426993 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89063a48-0a12-4758-b6f7-806d6c33320d admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:01.499308 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1172/2340] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:49:01 2022] PUT /identity/v3/projects/f0c75eae652241458ed9bb0850b5d128/users/f70e5cb58c64432c87c7828de1096394/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:49:01.503287 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1169/2341] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:49:01 2022] POST /identity/v3/projects => generated 387 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:49:01.504746 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89063a48-0a12-4758-b6f7-806d6c33320d admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:01.511344 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d4b0c-30a6-486d-ab1b-9f448186fc19 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:01.511807 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d4b0c-30a6-486d-ab1b-9f448186fc19 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:01.512116 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d4b0c-30a6-486d-ab1b-9f448186fc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:01.541331 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-092d4b0c-30a6-486d-ab1b-9f448186fc19 None None] MFA Rules not processed for user `f70e5cb58c64432c87c7828de1096394`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:01.542555 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-092d4b0c-30a6-486d-ab1b-9f448186fc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:01.569782 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89063a48-0a12-4758-b6f7-806d6c33320d admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:01.608337 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1170/2342] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:49:01.609968 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:01.619538 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d4b0c-30a6-486d-ab1b-9f448186fc19 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:01.620915 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-092d4b0c-30a6-486d-ab1b-9f448186fc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:01.628868 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360b5d4-d0f3-4439-a5f0-4d674e7ce499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:01.629472 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360b5d4-d0f3-4439-a5f0-4d674e7ce499 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:01.629773 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360b5d4-d0f3-4439-a5f0-4d674e7ce499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:01.630041 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360b5d4-d0f3-4439-a5f0-4d674e7ce499 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:01.630658 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360b5d4-d0f3-4439-a5f0-4d674e7ce499 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:01.632651 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360b5d4-d0f3-4439-a5f0-4d674e7ce499 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:01.678631 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d4b0c-30a6-486d-ab1b-9f448186fc19 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:01.682343 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd58f6a-9faa-4bde-9368-b3451d50bdcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:01.682939 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd58f6a-9faa-4bde-9368-b3451d50bdcf service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:01.683211 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd58f6a-9faa-4bde-9368-b3451d50bdcf service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:01.683478 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd58f6a-9faa-4bde-9368-b3451d50bdcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:01.691818 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd58f6a-9faa-4bde-9368-b3451d50bdcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:01.693323 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd58f6a-9faa-4bde-9368-b3451d50bdcf service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:01.702498 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1171/2343] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:49:01.737611 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1173/2344] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:49:01 2022] POST /identity/v3/users => generated 294 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:49:01.738931 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd58f6a-9faa-4bde-9368-b3451d50bdcf service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:01.756726 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd58f6a-9faa-4bde-9368-b3451d50bdcf service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:01.756726 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00817ae5-e228-4425-ae68-dd2991757ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:01.756726 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00817ae5-e228-4425-ae68-dd2991757ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:01.756726 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00817ae5-e228-4425-ae68-dd2991757ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:01.757195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00817ae5-e228-4425-ae68-dd2991757ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:01.757195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00817ae5-e228-4425-ae68-dd2991757ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:01.757888 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00817ae5-e228-4425-ae68-dd2991757ac1 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:01.768499 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1172/2345] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:49:01.772921 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360b5d4-d0f3-4439-a5f0-4d674e7ce499 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:01.783670 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360b5d4-d0f3-4439-a5f0-4d674e7ce499 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:01.788589 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b686c-4b6f-4dd2-8f64-bd130bd2388a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:01.789185 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b686c-4b6f-4dd2-8f64-bd130bd2388a admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:01.789461 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b686c-4b6f-4dd2-8f64-bd130bd2388a admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:01.789735 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b686c-4b6f-4dd2-8f64-bd130bd2388a admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:01.790370 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b686c-4b6f-4dd2-8f64-bd130bd2388a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:01.791983 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b686c-4b6f-4dd2-8f64-bd130bd2388a admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:01.802065 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1174/2346] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:49:01.806537 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00817ae5-e228-4425-ae68-dd2991757ac1 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:01.816470 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00817ae5-e228-4425-ae68-dd2991757ac1 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:01.823218 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ad84f-62bf-4fe2-8a2b-fad656497496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:01.823874 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ad84f-62bf-4fe2-8a2b-fad656497496 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:01.824182 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ad84f-62bf-4fe2-8a2b-fad656497496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:01.824458 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ad84f-62bf-4fe2-8a2b-fad656497496 admin admin] PATH_INFO: `/v3/projects/a45c4e7d95954fe1a86f9bca2904367c/users/f659533fa44b46318e0c68cbb6fff9d0/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:01.841413 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ad84f-62bf-4fe2-8a2b-fad656497496 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a45c4e7d95954fe1a86f9bca2904367c, user_id=f659533fa44b46318e0c68cbb6fff9d0, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:01.844145 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ad84f-62bf-4fe2-8a2b-fad656497496 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:01.921425 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1173/2347] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:49:01 2022] PUT /identity/v3/projects/a45c4e7d95954fe1a86f9bca2904367c/users/f659533fa44b46318e0c68cbb6fff9d0/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:49:01.932719 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0b460-f473-4319-8224-6426bd8d2578 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:01.933001 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0b460-f473-4319-8224-6426bd8d2578 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:01.933273 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0b460-f473-4319-8224-6426bd8d2578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:01.962713 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-f3d0b460-f473-4319-8224-6426bd8d2578 None None] MFA Rules not processed for user `f659533fa44b46318e0c68cbb6fff9d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:01.963926 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f3d0b460-f473-4319-8224-6426bd8d2578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:02.029079 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1175/2348] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:01 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:02.033592 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ad84f-62bf-4fe2-8a2b-fad656497496 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:02.085151 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:02.095126 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ad84f-62bf-4fe2-8a2b-fad656497496 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:02.099930 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8e4c7-e0de-46e6-862e-86e516731537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:02.100561 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8e4c7-e0de-46e6-862e-86e516731537 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:02.100837 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8e4c7-e0de-46e6-862e-86e516731537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:02.101105 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8e4c7-e0de-46e6-862e-86e516731537 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:02.101733 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8e4c7-e0de-46e6-862e-86e516731537 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:02.103673 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8e4c7-e0de-46e6-862e-86e516731537 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:02.211113 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1174/2349] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:49:02 2022] POST /identity/v3/projects => generated 387 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:49:02.214964 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0b460-f473-4319-8224-6426bd8d2578 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:02.229813 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0b460-f473-4319-8224-6426bd8d2578 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:02.288840 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa95ac-1a00-4a84-8a16-23fc9f6e1fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:02.291902 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa95ac-1a00-4a84-8a16-23fc9f6e1fc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:02.291902 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa95ac-1a00-4a84-8a16-23fc9f6e1fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:02.291902 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa95ac-1a00-4a84-8a16-23fc9f6e1fc5 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:02.291902 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa95ac-1a00-4a84-8a16-23fc9f6e1fc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:02.292580 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa95ac-1a00-4a84-8a16-23fc9f6e1fc5 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:02.371763 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1176/2350] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:49:02 2022] POST /identity/v3/users => generated 300 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:49:02.373020 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8e4c7-e0de-46e6-862e-86e516731537 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:02.383556 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8e4c7-e0de-46e6-862e-86e516731537 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:02.388248 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea7947-10b7-4ab8-859c-bbd609951134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:02.388839 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea7947-10b7-4ab8-859c-bbd609951134 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:02.389114 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea7947-10b7-4ab8-859c-bbd609951134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:02.389377 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea7947-10b7-4ab8-859c-bbd609951134 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:02.389998 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea7947-10b7-4ab8-859c-bbd609951134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:02.391617 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea7947-10b7-4ab8-859c-bbd609951134 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:02.402003 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1175/2351] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:49:02.410680 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa95ac-1a00-4a84-8a16-23fc9f6e1fc5 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:02.421875 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa95ac-1a00-4a84-8a16-23fc9f6e1fc5 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:02.426548 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766667de-3f36-49bf-92ab-d7749b3312c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:02.427251 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766667de-3f36-49bf-92ab-d7749b3312c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:02.427546 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766667de-3f36-49bf-92ab-d7749b3312c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:02.427800 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766667de-3f36-49bf-92ab-d7749b3312c0 admin admin] PATH_INFO: `/v3/projects/d835eb381d1e4981b5b96e8e9135937e/users/53f25e236d2f4395b065a7d2d4cbcb97/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:02.444509 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766667de-3f36-49bf-92ab-d7749b3312c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d835eb381d1e4981b5b96e8e9135937e, user_id=53f25e236d2f4395b065a7d2d4cbcb97, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:02.447463 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766667de-3f36-49bf-92ab-d7749b3312c0 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:02.533344 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1177/2352] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:49:02 2022] PUT /identity/v3/projects/d835eb381d1e4981b5b96e8e9135937e/users/53f25e236d2f4395b065a7d2d4cbcb97/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:02.537707 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea7947-10b7-4ab8-859c-bbd609951134 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:02.548774 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea7947-10b7-4ab8-859c-bbd609951134 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:02.627686 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab4d2b-916b-4029-9e75-cfaf9cec0fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:02.628373 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab4d2b-916b-4029-9e75-cfaf9cec0fca admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:02.628652 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab4d2b-916b-4029-9e75-cfaf9cec0fca admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:02.628922 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab4d2b-916b-4029-9e75-cfaf9cec0fca admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:02.629552 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab4d2b-916b-4029-9e75-cfaf9cec0fca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:02.631143 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab4d2b-916b-4029-9e75-cfaf9cec0fca admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:02.644677 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1176/2353] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:49:02.645921 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766667de-3f36-49bf-92ab-d7749b3312c0 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:02.656396 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766667de-3f36-49bf-92ab-d7749b3312c0 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:02.661226 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14e5ac-10df-45aa-933f-4f50e845775f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:02.661876 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14e5ac-10df-45aa-933f-4f50e845775f admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:02.662151 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14e5ac-10df-45aa-933f-4f50e845775f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:02.665971 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14e5ac-10df-45aa-933f-4f50e845775f admin admin] PATH_INFO: `/v3/projects/d835eb381d1e4981b5b96e8e9135937e/users/53f25e236d2f4395b065a7d2d4cbcb97/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:02.665971 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c14e5ac-10df-45aa-933f-4f50e845775f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d835eb381d1e4981b5b96e8e9135937e, user_id=53f25e236d2f4395b065a7d2d4cbcb97, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:02.667767 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c14e5ac-10df-45aa-933f-4f50e845775f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:02.674104 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:02.691989 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1178/2354] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:49:02 2022] PUT /identity/v3/projects/d835eb381d1e4981b5b96e8e9135937e/users/53f25e236d2f4395b065a7d2d4cbcb97/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:02.702330 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883722e-74c0-4232-a94c-dd429a76ef80 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:02.702607 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883722e-74c0-4232-a94c-dd429a76ef80 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:02.702881 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883722e-74c0-4232-a94c-dd429a76ef80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:02.742382 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-7883722e-74c0-4232-a94c-dd429a76ef80 None None] MFA Rules not processed for user `53f25e236d2f4395b065a7d2d4cbcb97`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:02.743788 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-7883722e-74c0-4232-a94c-dd429a76ef80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:02.833218 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1177/2355] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:02 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:02.845034 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14e5ac-10df-45aa-933f-4f50e845775f admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:02.846722 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2c14e5ac-10df-45aa-933f-4f50e845775f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:02.905441 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14e5ac-10df-45aa-933f-4f50e845775f admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:02.909554 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731823ff-5075-4025-b7bc-3ce3ef0f7301 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:02.910527 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731823ff-5075-4025-b7bc-3ce3ef0f7301 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:02.910799 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731823ff-5075-4025-b7bc-3ce3ef0f7301 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:02.911127 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731823ff-5075-4025-b7bc-3ce3ef0f7301 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:02.920797 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731823ff-5075-4025-b7bc-3ce3ef0f7301 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:02.922263 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731823ff-5075-4025-b7bc-3ce3ef0f7301 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:02.932024 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1179/2356] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:02 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:49:03.004433 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883722e-74c0-4232-a94c-dd429a76ef80 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:03.023400 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:03.088424 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883722e-74c0-4232-a94c-dd429a76ef80 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:03.093036 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1b961-d2f7-4d9d-b07e-843c35b5f385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:03.093922 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1b961-d2f7-4d9d-b07e-843c35b5f385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:03.094546 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1b961-d2f7-4d9d-b07e-843c35b5f385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:03.094899 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1b961-d2f7-4d9d-b07e-843c35b5f385 admin admin] PATH_INFO: `/v3/users/f659533fa44b46318e0c68cbb6fff9d0` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:03.096004 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d1b961-d2f7-4d9d-b07e-843c35b5f385 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f659533fa44b46318e0c68cbb6fff9d0)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:03.097934 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d1b961-d2f7-4d9d-b07e-843c35b5f385 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:03.342709 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-65d1b961-d2f7-4d9d-b07e-843c35b5f385 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f659533fa44b46318e0c68cbb6fff9d0'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:03.354988 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-65d1b961-d2f7-4d9d-b07e-843c35b5f385 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f659533fa44b46318e0c68cbb6fff9d0'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:03.361928 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-65d1b961-d2f7-4d9d-b07e-843c35b5f385 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f659533fa44b46318e0c68cbb6fff9d0'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:03.362617 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-65d1b961-d2f7-4d9d-b07e-843c35b5f385 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f659533fa44b46318e0c68cbb6fff9d0'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:03.363221 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-65d1b961-d2f7-4d9d-b07e-843c35b5f385 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f659533fa44b46318e0c68cbb6fff9d0'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:03.458413 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1178/2357] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:49:03 2022] DELETE /identity/v3/users/f659533fa44b46318e0c68cbb6fff9d0 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:03.462937 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac726ae-a5c4-4998-836c-9d7f50d864ef None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:03.463573 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac726ae-a5c4-4998-836c-9d7f50d864ef None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:03.463573 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac726ae-a5c4-4998-836c-9d7f50d864ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:03.491048 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-7ac726ae-a5c4-4998-836c-9d7f50d864ef None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:03.492272 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7ac726ae-a5c4-4998-836c-9d7f50d864ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:03.551874 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1180/2358] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:03.562434 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1b961-d2f7-4d9d-b07e-843c35b5f385 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:03.567663 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-65d1b961-d2f7-4d9d-b07e-843c35b5f385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:03.577697 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c61185-1d6f-422a-9a4a-81e95148bc95 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:03.577984 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c61185-1d6f-422a-9a4a-81e95148bc95 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:03.578259 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c61185-1d6f-422a-9a4a-81e95148bc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:03.598367 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-63c61185-1d6f-422a-9a4a-81e95148bc95 None None] MFA Rules not processed for user `f70e5cb58c64432c87c7828de1096394`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:03.599482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-63c61185-1d6f-422a-9a4a-81e95148bc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:03.643601 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1b961-d2f7-4d9d-b07e-843c35b5f385 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:03.649243 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549d0d6-a3b2-4d7e-aa79-8c108bb2cd80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:03.649835 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549d0d6-a3b2-4d7e-aa79-8c108bb2cd80 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:03.650132 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549d0d6-a3b2-4d7e-aa79-8c108bb2cd80 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:03.650403 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549d0d6-a3b2-4d7e-aa79-8c108bb2cd80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:03.656755 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1181/2359] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:49:03.660545 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a549d0d6-a3b2-4d7e-aa79-8c108bb2cd80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:03.662255 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a549d0d6-a3b2-4d7e-aa79-8c108bb2cd80 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:03.673581 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1179/2360] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:49:03.949648 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c61185-1d6f-422a-9a4a-81e95148bc95 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:03.951057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-63c61185-1d6f-422a-9a4a-81e95148bc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:03.964515 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c61185-1d6f-422a-9a4a-81e95148bc95 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:03.969214 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd26d722-3d77-4ca2-b9f4-4ba8c198cb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:03.969846 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26d722-3d77-4ca2-b9f4-4ba8c198cb9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:03.970125 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26d722-3d77-4ca2-b9f4-4ba8c198cb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:03.970400 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26d722-3d77-4ca2-b9f4-4ba8c198cb9c admin admin] PATH_INFO: `/v3/users/f47ce9abc7634dbc95e398af05ae74e0` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:03.971576 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd26d722-3d77-4ca2-b9f4-4ba8c198cb9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f47ce9abc7634dbc95e398af05ae74e0)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:03.973547 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd26d722-3d77-4ca2-b9f4-4ba8c198cb9c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:04.000297 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:04.169623 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-dd26d722-3d77-4ca2-b9f4-4ba8c198cb9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f47ce9abc7634dbc95e398af05ae74e0'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:04.183081 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-dd26d722-3d77-4ca2-b9f4-4ba8c198cb9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f47ce9abc7634dbc95e398af05ae74e0'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:04.185952 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-dd26d722-3d77-4ca2-b9f4-4ba8c198cb9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f47ce9abc7634dbc95e398af05ae74e0'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:04.187653 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549d0d6-a3b2-4d7e-aa79-8c108bb2cd80 service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:04.189488 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a549d0d6-a3b2-4d7e-aa79-8c108bb2cd80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:04.193020 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-dd26d722-3d77-4ca2-b9f4-4ba8c198cb9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f47ce9abc7634dbc95e398af05ae74e0'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:04.193673 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-dd26d722-3d77-4ca2-b9f4-4ba8c198cb9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f47ce9abc7634dbc95e398af05ae74e0'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:04.214531 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:04.218391 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549d0d6-a3b2-4d7e-aa79-8c108bb2cd80 service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:04.223000 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d14905-c04a-45f1-8e53-be8314b87ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:04.223655 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d14905-c04a-45f1-8e53-be8314b87ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:04.223934 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d14905-c04a-45f1-8e53-be8314b87ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:04.224235 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d14905-c04a-45f1-8e53-be8314b87ecd admin admin] PATH_INFO: `/v3/projects/a45c4e7d95954fe1a86f9bca2904367c` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:04.225353 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d14905-c04a-45f1-8e53-be8314b87ecd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a45c4e7d95954fe1a86f9bca2904367c)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:04.227236 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d14905-c04a-45f1-8e53-be8314b87ecd admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:04.267249 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1182/2361] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:49:03 2022] DELETE /identity/v3/users/f47ce9abc7634dbc95e398af05ae74e0 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:04.272215 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b9867-ff38-4f7c-96eb-ddc3343d6c99 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:04.272691 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b9867-ff38-4f7c-96eb-ddc3343d6c99 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:04.273143 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b9867-ff38-4f7c-96eb-ddc3343d6c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:04.298672 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-3d2b9867-ff38-4f7c-96eb-ddc3343d6c99 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:04.300262 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3d2b9867-ff38-4f7c-96eb-ddc3343d6c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:04.373921 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1183/2362] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:49:04.378321 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f1d14905-c04a-45f1-8e53-be8314b87ecd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a45c4e7d95954fe1a86f9bca2904367c', 'request_id': 'req-f1d14905-c04a-45f1-8e53-be8314b87ecd'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:04.384353 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b9867-ff38-4f7c-96eb-ddc3343d6c99 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:04.386187 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f1d14905-c04a-45f1-8e53-be8314b87ecd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a45c4e7d95954fe1a86f9bca2904367c', 'request_id': 'req-f1d14905-c04a-45f1-8e53-be8314b87ecd'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:04.386320 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3d2b9867-ff38-4f7c-96eb-ddc3343d6c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:04.392694 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f1d14905-c04a-45f1-8e53-be8314b87ecd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a45c4e7d95954fe1a86f9bca2904367c', 'request_id': 'req-f1d14905-c04a-45f1-8e53-be8314b87ecd'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:04.448231 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b9867-ff38-4f7c-96eb-ddc3343d6c99 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:04.458335 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f1d14905-c04a-45f1-8e53-be8314b87ecd admin admin] The token cache is being invalidate because project a45c4e7d95954fe1a86f9bca2904367c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:49:04.458625 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f1d14905-c04a-45f1-8e53-be8314b87ecd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:04.459279 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f1d14905-c04a-45f1-8e53-be8314b87ecd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:04.460777 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1180/2363] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:49:04 2022] DELETE /identity/v3/projects/a45c4e7d95954fe1a86f9bca2904367c => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:04.465564 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d14905-c04a-45f1-8e53-be8314b87ecd admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:04.466911 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f1d14905-c04a-45f1-8e53-be8314b87ecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:04.502571 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c615b-db92-4ccc-90c7-caf9d80ce315 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:04.503216 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c615b-db92-4ccc-90c7-caf9d80ce315 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:04.503435 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c615b-db92-4ccc-90c7-caf9d80ce315 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:04.503780 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c615b-db92-4ccc-90c7-caf9d80ce315 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:04.505547 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b41c615b-db92-4ccc-90c7-caf9d80ce315 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:04.514967 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:04.533083 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d14905-c04a-45f1-8e53-be8314b87ecd admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:04.537940 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34090f-5259-403d-9eaf-35dc4782881b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:04.538562 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34090f-5259-403d-9eaf-35dc4782881b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:04.538836 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34090f-5259-403d-9eaf-35dc4782881b admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:04.539111 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34090f-5259-403d-9eaf-35dc4782881b admin admin] PATH_INFO: `/v3/users/53f25e236d2f4395b065a7d2d4cbcb97` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:04.540909 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34090f-5259-403d-9eaf-35dc4782881b admin admin] RBAC: Authorizing `identity:delete_user(user_id=53f25e236d2f4395b065a7d2d4cbcb97)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:04.542992 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34090f-5259-403d-9eaf-35dc4782881b admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:04.570975 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c615b-db92-4ccc-90c7-caf9d80ce315 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:04.573068 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c615b-db92-4ccc-90c7-caf9d80ce315 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:04.582451 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1184/2364] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:49:04.746649 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-de34090f-5259-403d-9eaf-35dc4782881b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53f25e236d2f4395b065a7d2d4cbcb97'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:04.759955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-de34090f-5259-403d-9eaf-35dc4782881b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53f25e236d2f4395b065a7d2d4cbcb97'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:04.767665 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-de34090f-5259-403d-9eaf-35dc4782881b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53f25e236d2f4395b065a7d2d4cbcb97'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:04.769151 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-de34090f-5259-403d-9eaf-35dc4782881b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53f25e236d2f4395b065a7d2d4cbcb97'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:04.770075 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-de34090f-5259-403d-9eaf-35dc4782881b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53f25e236d2f4395b065a7d2d4cbcb97'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:04.841773 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1181/2365] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:49:04 2022] DELETE /identity/v3/users/53f25e236d2f4395b065a7d2d4cbcb97 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:49:04.994240 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c615b-db92-4ccc-90c7-caf9d80ce315 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:04.994401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b41c615b-db92-4ccc-90c7-caf9d80ce315 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:05.006995 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c615b-db92-4ccc-90c7-caf9d80ce315 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:05.077205 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f24db0-3b09-467e-a83d-1975bef98cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:05.077833 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f24db0-3b09-467e-a83d-1975bef98cb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:05.078110 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f24db0-3b09-467e-a83d-1975bef98cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:05.078387 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f24db0-3b09-467e-a83d-1975bef98cb8 admin admin] PATH_INFO: `/v3/projects/427e4360c3c04843b6b13b980e826797` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:05.079484 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f24db0-3b09-467e-a83d-1975bef98cb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=427e4360c3c04843b6b13b980e826797)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:05.081479 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f24db0-3b09-467e-a83d-1975bef98cb8 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:05.219530 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-14f24db0-3b09-467e-a83d-1975bef98cb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '427e4360c3c04843b6b13b980e826797', 'request_id': 'req-14f24db0-3b09-467e-a83d-1975bef98cb8'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:05.225234 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-14f24db0-3b09-467e-a83d-1975bef98cb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '427e4360c3c04843b6b13b980e826797', 'request_id': 'req-14f24db0-3b09-467e-a83d-1975bef98cb8'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:05.237259 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-14f24db0-3b09-467e-a83d-1975bef98cb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '427e4360c3c04843b6b13b980e826797', 'request_id': 'req-14f24db0-3b09-467e-a83d-1975bef98cb8'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:05.344106 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-14f24db0-3b09-467e-a83d-1975bef98cb8 admin admin] The token cache is being invalidate because project 427e4360c3c04843b6b13b980e826797 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:49:05.344381 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-14f24db0-3b09-467e-a83d-1975bef98cb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:05.345087 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-14f24db0-3b09-467e-a83d-1975bef98cb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:05.346844 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1185/2366] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:49:04 2022] DELETE /identity/v3/projects/427e4360c3c04843b6b13b980e826797 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:05.350635 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34090f-5259-403d-9eaf-35dc4782881b admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:05.352089 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-de34090f-5259-403d-9eaf-35dc4782881b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:05.366130 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34090f-5259-403d-9eaf-35dc4782881b admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:05.370619 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:05.416976 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f24db0-3b09-467e-a83d-1975bef98cb8 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:05.418482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-14f24db0-3b09-467e-a83d-1975bef98cb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:05.449262 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89368e5c-ee4d-4615-908c-cd68eb61a079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:05.449911 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89368e5c-ee4d-4615-908c-cd68eb61a079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:05.450370 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89368e5c-ee4d-4615-908c-cd68eb61a079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:05.450971 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89368e5c-ee4d-4615-908c-cd68eb61a079 admin admin] PATH_INFO: `/v3/users/835a9b5c1d174c29a19ed1bab9f298d9` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:05.452166 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89368e5c-ee4d-4615-908c-cd68eb61a079 admin admin] RBAC: Authorizing `identity:delete_user(user_id=835a9b5c1d174c29a19ed1bab9f298d9)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:05.454238 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89368e5c-ee4d-4615-908c-cd68eb61a079 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:05.468338 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:05.495203 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f24db0-3b09-467e-a83d-1975bef98cb8 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:05.499952 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb1b23-3a98-4419-a416-5e882482579a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:05.500622 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb1b23-3a98-4419-a416-5e882482579a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:05.500904 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb1b23-3a98-4419-a416-5e882482579a admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:05.501175 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb1b23-3a98-4419-a416-5e882482579a admin admin] PATH_INFO: `/v3/projects/d835eb381d1e4981b5b96e8e9135937e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:05.502327 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb1b23-3a98-4419-a416-5e882482579a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d835eb381d1e4981b5b96e8e9135937e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:05.504484 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb1b23-3a98-4419-a416-5e882482579a admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:05.628668 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-89368e5c-ee4d-4615-908c-cd68eb61a079 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '835a9b5c1d174c29a19ed1bab9f298d9'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:05.629236 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-98eb1b23-3a98-4419-a416-5e882482579a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd835eb381d1e4981b5b96e8e9135937e', 'request_id': 'req-98eb1b23-3a98-4419-a416-5e882482579a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:05.635354 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-98eb1b23-3a98-4419-a416-5e882482579a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd835eb381d1e4981b5b96e8e9135937e', 'request_id': 'req-98eb1b23-3a98-4419-a416-5e882482579a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:05.640817 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-89368e5c-ee4d-4615-908c-cd68eb61a079 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '835a9b5c1d174c29a19ed1bab9f298d9'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:05.641838 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-98eb1b23-3a98-4419-a416-5e882482579a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd835eb381d1e4981b5b96e8e9135937e', 'request_id': 'req-98eb1b23-3a98-4419-a416-5e882482579a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:05.647369 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-89368e5c-ee4d-4615-908c-cd68eb61a079 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '835a9b5c1d174c29a19ed1bab9f298d9'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:05.648080 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-89368e5c-ee4d-4615-908c-cd68eb61a079 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '835a9b5c1d174c29a19ed1bab9f298d9'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:05.648697 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-89368e5c-ee4d-4615-908c-cd68eb61a079 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '835a9b5c1d174c29a19ed1bab9f298d9'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:05.699380 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-98eb1b23-3a98-4419-a416-5e882482579a admin admin] The token cache is being invalidate because project d835eb381d1e4981b5b96e8e9135937e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:49:05.699585 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-98eb1b23-3a98-4419-a416-5e882482579a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:05.700242 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-98eb1b23-3a98-4419-a416-5e882482579a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:05.701774 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1186/2367] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:49:05 2022] DELETE /identity/v3/projects/d835eb381d1e4981b5b96e8e9135937e => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:49:05.706360 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644a37c-134c-402b-a9ae-85e2ee3e828f None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:05.706665 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644a37c-134c-402b-a9ae-85e2ee3e828f None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:05.706940 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644a37c-134c-402b-a9ae-85e2ee3e828f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:05.757546 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-2644a37c-134c-402b-a9ae-85e2ee3e828f None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:05.758739 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2644a37c-134c-402b-a9ae-85e2ee3e828f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:05.780039 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1182/2368] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:49:05 2022] DELETE /identity/v3/users/835a9b5c1d174c29a19ed1bab9f298d9 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:05.823886 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1187/2369] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:49:05.832735 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f803b7d-8bc8-4079-92f3-4e36d2b1e935 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:05.833040 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f803b7d-8bc8-4079-92f3-4e36d2b1e935 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:05.833355 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f803b7d-8bc8-4079-92f3-4e36d2b1e935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:05.857409 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-5f803b7d-8bc8-4079-92f3-4e36d2b1e935 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:05.858620 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-5f803b7d-8bc8-4079-92f3-4e36d2b1e935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:05.918226 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1183/2370] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:05.922663 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644a37c-134c-402b-a9ae-85e2ee3e828f None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:05.933299 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644a37c-134c-402b-a9ae-85e2ee3e828f None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:05.938377 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af76203-47b3-4111-88e5-d381c0b8e0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:05.939108 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af76203-47b3-4111-88e5-d381c0b8e0a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:05.939266 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af76203-47b3-4111-88e5-d381c0b8e0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:05.939540 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af76203-47b3-4111-88e5-d381c0b8e0a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:05.940223 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af76203-47b3-4111-88e5-d381c0b8e0a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:49:05.940529 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af76203-47b3-4111-88e5-d381c0b8e0a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:05.942356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af76203-47b3-4111-88e5-d381c0b8e0a8 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:05.955198 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1188/2371] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:49:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:49:05.959895 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f803b7d-8bc8-4079-92f3-4e36d2b1e935 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:05.984783 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f803b7d-8bc8-4079-92f3-4e36d2b1e935 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:05.993811 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b324b2-4833-4f25-a341-4dbdc1ec3245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:05.994384 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b324b2-4833-4f25-a341-4dbdc1ec3245 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:05.994674 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b324b2-4833-4f25-a341-4dbdc1ec3245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:05.994953 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b324b2-4833-4f25-a341-4dbdc1ec3245 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:05.995530 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b324b2-4833-4f25-a341-4dbdc1ec3245 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:05.997598 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b324b2-4833-4f25-a341-4dbdc1ec3245 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:06.068433 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1184/2372] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:49:05 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:49:06.073186 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af76203-47b3-4111-88e5-d381c0b8e0a8 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:06.084588 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af76203-47b3-4111-88e5-d381c0b8e0a8 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:06.113606 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:06.144417 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d9b3d-c36b-4867-88e5-59e9af189504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:06.145016 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d9b3d-c36b-4867-88e5-59e9af189504 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:06.145289 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d9b3d-c36b-4867-88e5-59e9af189504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:06.145557 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d9b3d-c36b-4867-88e5-59e9af189504 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:06.146174 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d9b3d-c36b-4867-88e5-59e9af189504 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:06.148084 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d9b3d-c36b-4867-88e5-59e9af189504 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:06.180067 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b324b2-4833-4f25-a341-4dbdc1ec3245 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:06.182098 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-d0b324b2-4833-4f25-a341-4dbdc1ec3245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:06.192413 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:06.197350 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b324b2-4833-4f25-a341-4dbdc1ec3245 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:06.202246 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a07bc-e2cd-44a6-a385-f473c6bf57c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:06.206093 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a07bc-e2cd-44a6-a385-f473c6bf57c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:06.206093 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a07bc-e2cd-44a6-a385-f473c6bf57c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:06.206093 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a07bc-e2cd-44a6-a385-f473c6bf57c2 admin admin] PATH_INFO: `/v3/projects/c41dc4ed7daa447fb085f534573a8b82` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:06.206093 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a07bc-e2cd-44a6-a385-f473c6bf57c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c41dc4ed7daa447fb085f534573a8b82)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:06.206973 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a07bc-e2cd-44a6-a385-f473c6bf57c2 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:06.259586 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1189/2373] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:49:06 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:49:06.264157 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d9b3d-c36b-4867-88e5-59e9af189504 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:06.274065 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d9b3d-c36b-4867-88e5-59e9af189504 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:06.279569 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c241765-f159-4d4d-a8fb-47289db98b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:06.280206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c241765-f159-4d4d-a8fb-47289db98b67 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:06.280474 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c241765-f159-4d4d-a8fb-47289db98b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:06.280745 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c241765-f159-4d4d-a8fb-47289db98b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:06.294635 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c241765-f159-4d4d-a8fb-47289db98b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:06.294635 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c241765-f159-4d4d-a8fb-47289db98b67 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:06.294635 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1190/2374] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:49:06.297463 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c241765-f159-4d4d-a8fb-47289db98b67 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:06.306892 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c241765-f159-4d4d-a8fb-47289db98b67 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:06.311512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a3085-bf4a-40ef-97cf-79cfce20fd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:06.312254 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a3085-bf4a-40ef-97cf-79cfce20fd62 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:06.312538 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a3085-bf4a-40ef-97cf-79cfce20fd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:06.312811 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a3085-bf4a-40ef-97cf-79cfce20fd62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:06.313440 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a3085-bf4a-40ef-97cf-79cfce20fd62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:06.315114 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a3085-bf4a-40ef-97cf-79cfce20fd62 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:06.330413 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1191/2375] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:49:06.331654 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a3085-bf4a-40ef-97cf-79cfce20fd62 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:06.336756 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-501a07bc-e2cd-44a6-a385-f473c6bf57c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c41dc4ed7daa447fb085f534573a8b82', 'request_id': 'req-501a07bc-e2cd-44a6-a385-f473c6bf57c2'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:06.343223 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a3085-bf4a-40ef-97cf-79cfce20fd62 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:06.344037 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-501a07bc-e2cd-44a6-a385-f473c6bf57c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c41dc4ed7daa447fb085f534573a8b82', 'request_id': 'req-501a07bc-e2cd-44a6-a385-f473c6bf57c2'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:06.350632 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-501a07bc-e2cd-44a6-a385-f473c6bf57c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c41dc4ed7daa447fb085f534573a8b82', 'request_id': 'req-501a07bc-e2cd-44a6-a385-f473c6bf57c2'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:06.403951 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e4d1b-8630-42b9-8aad-825fb68f63c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:06.404633 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e4d1b-8630-42b9-8aad-825fb68f63c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:06.405015 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e4d1b-8630-42b9-8aad-825fb68f63c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:06.405222 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e4d1b-8630-42b9-8aad-825fb68f63c8 admin admin] PATH_INFO: `/v3/projects/ee6ad63f5dcd4dceb0add6f4eed9e901/users/7a9e660f910f4a838fab665df9bfbb58/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:06.412138 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-501a07bc-e2cd-44a6-a385-f473c6bf57c2 admin admin] The token cache is being invalidate because project c41dc4ed7daa447fb085f534573a8b82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:49:06.412617 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-501a07bc-e2cd-44a6-a385-f473c6bf57c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:06.413259 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-501a07bc-e2cd-44a6-a385-f473c6bf57c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:06.414756 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1185/2376] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:49:06 2022] DELETE /identity/v3/projects/c41dc4ed7daa447fb085f534573a8b82 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:49:06.420125 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce4791-7eec-4f9a-bc57-c52a3d058c11 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:06.420418 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce4791-7eec-4f9a-bc57-c52a3d058c11 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:06.420693 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce4791-7eec-4f9a-bc57-c52a3d058c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:06.421234 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e4d1b-8630-42b9-8aad-825fb68f63c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee6ad63f5dcd4dceb0add6f4eed9e901, user_id=7a9e660f910f4a838fab665df9bfbb58, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:06.423888 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e4d1b-8630-42b9-8aad-825fb68f63c8 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:06.440151 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-5bce4791-7eec-4f9a-bc57-c52a3d058c11 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:06.441353 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-5bce4791-7eec-4f9a-bc57-c52a3d058c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:06.449319 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1186/2377] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:49:06.457988 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd271e-41d7-4ec3-9d69-da8860554397 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:06.458187 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd271e-41d7-4ec3-9d69-da8860554397 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:06.458481 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd271e-41d7-4ec3-9d69-da8860554397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:06.479351 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-a9dd271e-41d7-4ec3-9d69-da8860554397 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:06.484720 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a9dd271e-41d7-4ec3-9d69-da8860554397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:06.489305 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1187/2378] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:49:06.493926 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd271e-41d7-4ec3-9d69-da8860554397 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:06.503293 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd271e-41d7-4ec3-9d69-da8860554397 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:06.507955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baad2ce-ec3e-42f0-9f1a-948a3b1086e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:06.508573 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baad2ce-ec3e-42f0-9f1a-948a3b1086e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:06.509739 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baad2ce-ec3e-42f0-9f1a-948a3b1086e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:06.510016 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baad2ce-ec3e-42f0-9f1a-948a3b1086e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:06.510750 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baad2ce-ec3e-42f0-9f1a-948a3b1086e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:49:06.511052 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baad2ce-ec3e-42f0-9f1a-948a3b1086e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:06.512685 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baad2ce-ec3e-42f0-9f1a-948a3b1086e2 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:06.525577 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1188/2379] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:49:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:49:06.530014 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baad2ce-ec3e-42f0-9f1a-948a3b1086e2 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:06.543119 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baad2ce-ec3e-42f0-9f1a-948a3b1086e2 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:06.546027 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1192/2380] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:49:06 2022] PUT /identity/v3/projects/ee6ad63f5dcd4dceb0add6f4eed9e901/users/7a9e660f910f4a838fab665df9bfbb58/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:06.557803 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62327b-e408-4966-a313-b02ed26608d6 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:06.558467 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62327b-e408-4966-a313-b02ed26608d6 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:06.572758 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62327b-e408-4966-a313-b02ed26608d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:06.603118 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-ff62327b-e408-4966-a313-b02ed26608d6 None None] MFA Rules not processed for user `7a9e660f910f4a838fab665df9bfbb58`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:06.604382 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ff62327b-e408-4966-a313-b02ed26608d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:06.610157 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1af4e6-b7d6-4800-83bd-61c52189d2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:06.612235 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1af4e6-b7d6-4800-83bd-61c52189d2a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:06.612235 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1af4e6-b7d6-4800-83bd-61c52189d2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:06.612235 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1af4e6-b7d6-4800-83bd-61c52189d2a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:06.613360 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1af4e6-b7d6-4800-83bd-61c52189d2a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:06.616137 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1af4e6-b7d6-4800-83bd-61c52189d2a6 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:06.678075 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1193/2381] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:06.683014 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62327b-e408-4966-a313-b02ed26608d6 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:06.684359 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ff62327b-e408-4966-a313-b02ed26608d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:06.698090 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62327b-e408-4966-a313-b02ed26608d6 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:06.702698 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33738642-d6bc-498a-9eb5-daf4a9139a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:06.703303 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33738642-d6bc-498a-9eb5-daf4a9139a9a admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:06.703575 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33738642-d6bc-498a-9eb5-daf4a9139a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:06.703962 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33738642-d6bc-498a-9eb5-daf4a9139a9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:06.704646 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33738642-d6bc-498a-9eb5-daf4a9139a9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:06.706540 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33738642-d6bc-498a-9eb5-daf4a9139a9a admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:06.712235 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:06.721248 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1189/2382] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:49:06 2022] POST /identity/v3/projects => generated 365 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:49:06.722657 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1af4e6-b7d6-4800-83bd-61c52189d2a6 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:06.782419 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1194/2383] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:49:06 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:49:06.786915 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33738642-d6bc-498a-9eb5-daf4a9139a9a admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:06.787445 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:06.805321 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1af4e6-b7d6-4800-83bd-61c52189d2a6 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:06.858398 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33738642-d6bc-498a-9eb5-daf4a9139a9a admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:06.863664 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a8232-44b7-4147-9c95-095d89b0ed6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:06.864290 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a8232-44b7-4147-9c95-095d89b0ed6b admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:06.864570 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a8232-44b7-4147-9c95-095d89b0ed6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:06.864843 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a8232-44b7-4147-9c95-095d89b0ed6b admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:06.865478 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a8232-44b7-4147-9c95-095d89b0ed6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:06.867602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a8232-44b7-4147-9c95-095d89b0ed6b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:06.867992 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094ee58-09fd-4fc1-b85e-53fe42f03308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:06.872235 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094ee58-09fd-4fc1-b85e-53fe42f03308 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:06.872235 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094ee58-09fd-4fc1-b85e-53fe42f03308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:06.872235 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094ee58-09fd-4fc1-b85e-53fe42f03308 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:06.872235 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094ee58-09fd-4fc1-b85e-53fe42f03308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:06.872235 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094ee58-09fd-4fc1-b85e-53fe42f03308 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:06.940816 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1190/2384] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:49:06 2022] POST /identity/v3/users => generated 283 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:49:06.942499 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1195/2385] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:49:06 2022] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:49:06.947195 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094ee58-09fd-4fc1-b85e-53fe42f03308 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:06.947435 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a8232-44b7-4147-9c95-095d89b0ed6b admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:06.957654 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094ee58-09fd-4fc1-b85e-53fe42f03308 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:06.958295 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a8232-44b7-4147-9c95-095d89b0ed6b admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:06.963572 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28783266-39c3-4176-bd92-0c7b1cc944eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:06.964151 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28783266-39c3-4176-bd92-0c7b1cc944eb admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:06.964284 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8457e2-18a2-4f25-ab04-5ce643013816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:06.964414 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28783266-39c3-4176-bd92-0c7b1cc944eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:06.964935 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28783266-39c3-4176-bd92-0c7b1cc944eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:06.965074 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8457e2-18a2-4f25-ab04-5ce643013816 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:06.965312 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28783266-39c3-4176-bd92-0c7b1cc944eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:06.965441 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8457e2-18a2-4f25-ab04-5ce643013816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:06.965830 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8457e2-18a2-4f25-ab04-5ce643013816 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:06.966789 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8457e2-18a2-4f25-ab04-5ce643013816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:06.968487 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8457e2-18a2-4f25-ab04-5ce643013816 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:06.975662 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28783266-39c3-4176-bd92-0c7b1cc944eb admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:06.983304 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1191/2386] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:49:06.984327 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8457e2-18a2-4f25-ab04-5ce643013816 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:06.988486 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1196/2387] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:49:06.992137 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28783266-39c3-4176-bd92-0c7b1cc944eb admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:06.998901 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8457e2-18a2-4f25-ab04-5ce643013816 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:07.003022 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28783266-39c3-4176-bd92-0c7b1cc944eb admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:07.009388 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747aee3-7f38-404b-aef6-d8c92b87fbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:07.010626 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747aee3-7f38-404b-aef6-d8c92b87fbec admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:07.010842 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6cab1-64f8-4687-8533-2dadddb078bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:07.011101 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747aee3-7f38-404b-aef6-d8c92b87fbec admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:07.011470 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747aee3-7f38-404b-aef6-d8c92b87fbec admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:07.011974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6cab1-64f8-4687-8533-2dadddb078bc admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:07.012340 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1747aee3-7f38-404b-aef6-d8c92b87fbec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:07.012989 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6cab1-64f8-4687-8533-2dadddb078bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:07.013426 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6cab1-64f8-4687-8533-2dadddb078bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:07.014265 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf6cab1-64f8-4687-8533-2dadddb078bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:07.014398 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1747aee3-7f38-404b-aef6-d8c92b87fbec admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:07.016760 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf6cab1-64f8-4687-8533-2dadddb078bc admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:07.028981 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1192/2388] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:49:07.031016 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1197/2389] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:49:07.033127 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6cab1-64f8-4687-8533-2dadddb078bc admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:07.035136 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747aee3-7f38-404b-aef6-d8c92b87fbec admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:07.044363 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6cab1-64f8-4687-8533-2dadddb078bc admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:07.045293 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747aee3-7f38-404b-aef6-d8c92b87fbec admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:07.048964 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00eff8-6734-4382-ac71-39d440676528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:07.049604 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00eff8-6734-4382-ac71-39d440676528 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:07.049826 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80617e-aa05-4354-9c48-3089e834cbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:07.049952 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00eff8-6734-4382-ac71-39d440676528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:07.050138 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00eff8-6734-4382-ac71-39d440676528 admin admin] PATH_INFO: `/v3/projects/bb57d5a1bbbc4594987a45931d7b5865/users/b36daaab985947cb8c76205a9ac009fc/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:07.050595 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80617e-aa05-4354-9c48-3089e834cbe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:07.050877 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80617e-aa05-4354-9c48-3089e834cbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:07.051139 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80617e-aa05-4354-9c48-3089e834cbe4 admin admin] PATH_INFO: `/v3/projects/d0eb2265c4da4b3588577b7205c95178/users/398ec7f739c849a4832b515d0428f204/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:07.068024 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac00eff8-6734-4382-ac71-39d440676528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb57d5a1bbbc4594987a45931d7b5865, user_id=b36daaab985947cb8c76205a9ac009fc, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:07.068235 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c80617e-aa05-4354-9c48-3089e834cbe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0eb2265c4da4b3588577b7205c95178, user_id=398ec7f739c849a4832b515d0428f204, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:07.073482 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac00eff8-6734-4382-ac71-39d440676528 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:07.078096 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c80617e-aa05-4354-9c48-3089e834cbe4 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:07.179821 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1193/2390] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:49:07 2022] PUT /identity/v3/projects/bb57d5a1bbbc4594987a45931d7b5865/users/b36daaab985947cb8c76205a9ac009fc/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:49:07.190861 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc51f6b-9027-401e-abfc-799ec8bc9410 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:07.191130 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc51f6b-9027-401e-abfc-799ec8bc9410 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:07.191400 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc51f6b-9027-401e-abfc-799ec8bc9410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:07.215876 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1198/2391] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:49:07 2022] PUT /identity/v3/projects/d0eb2265c4da4b3588577b7205c95178/users/398ec7f739c849a4832b515d0428f204/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:49:07.227377 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258e769-5892-4311-9380-e2858df1600c None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:07.228602 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258e769-5892-4311-9380-e2858df1600c None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:07.228883 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258e769-5892-4311-9380-e2858df1600c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:07.229140 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-7fc51f6b-9027-401e-abfc-799ec8bc9410 None None] MFA Rules not processed for user `b36daaab985947cb8c76205a9ac009fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:07.230571 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-7fc51f6b-9027-401e-abfc-799ec8bc9410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:07.260141 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-d258e769-5892-4311-9380-e2858df1600c None None] MFA Rules not processed for user `398ec7f739c849a4832b515d0428f204`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:07.261424 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d258e769-5892-4311-9380-e2858df1600c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:07.318771 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1194/2392] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:49:07.327799 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc51f6b-9027-401e-abfc-799ec8bc9410 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:07.335925 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1199/2393] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:07.340401 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258e769-5892-4311-9380-e2858df1600c None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:07.361918 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:07.363647 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:07.402096 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc51f6b-9027-401e-abfc-799ec8bc9410 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:07.406804 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5579b-69de-440d-bb2c-13c5fa6b6e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:07.407418 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5579b-69de-440d-bb2c-13c5fa6b6e69 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:07.407695 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5579b-69de-440d-bb2c-13c5fa6b6e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:07.408445 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5579b-69de-440d-bb2c-13c5fa6b6e69 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:07.409077 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5579b-69de-440d-bb2c-13c5fa6b6e69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:07.411242 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258e769-5892-4311-9380-e2858df1600c None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:07.411396 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5579b-69de-440d-bb2c-13c5fa6b6e69 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:07.416574 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8fd1a-05af-4d06-9b95-ec4408cc0893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:07.417126 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8fd1a-05af-4d06-9b95-ec4408cc0893 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:07.417244 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8fd1a-05af-4d06-9b95-ec4408cc0893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:07.417425 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8fd1a-05af-4d06-9b95-ec4408cc0893 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:07.418117 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa8fd1a-05af-4d06-9b95-ec4408cc0893 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:07.420040 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa8fd1a-05af-4d06-9b95-ec4408cc0893 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:07.528952 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1195/2394] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:49:07 2022] POST /identity/v3/projects => generated 365 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:49:07.532955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5579b-69de-440d-bb2c-13c5fa6b6e69 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:07.575731 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1200/2395] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:49:07 2022] POST /identity/v3/projects => generated 385 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:49:07.579855 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8fd1a-05af-4d06-9b95-ec4408cc0893 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:07.612772 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5579b-69de-440d-bb2c-13c5fa6b6e69 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:07.689247 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c510f9-9e2f-454b-8934-393b45e4f4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:07.690690 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c510f9-9e2f-454b-8934-393b45e4f4fd admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:07.690976 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c510f9-9e2f-454b-8934-393b45e4f4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:07.691409 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c510f9-9e2f-454b-8934-393b45e4f4fd admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:07.692236 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c510f9-9e2f-454b-8934-393b45e4f4fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:07.694323 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c510f9-9e2f-454b-8934-393b45e4f4fd admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:07.695920 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8fd1a-05af-4d06-9b95-ec4408cc0893 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:07.701619 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b0324-32d7-4983-b0f1-209a59d72e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:07.702242 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b0324-32d7-4983-b0f1-209a59d72e1e admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:07.702523 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b0324-32d7-4983-b0f1-209a59d72e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:07.702798 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b0324-32d7-4983-b0f1-209a59d72e1e admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:07.703628 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b0324-32d7-4983-b0f1-209a59d72e1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:07.706052 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b0324-32d7-4983-b0f1-209a59d72e1e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:07.809169 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1201/2396] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:49:07 2022] POST /identity/v3/users => generated 299 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:49:07.814430 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b0324-32d7-4983-b0f1-209a59d72e1e admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:07.815253 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1196/2397] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:49:07 2022] POST /identity/v3/users => generated 289 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:49:07.816468 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c510f9-9e2f-454b-8934-393b45e4f4fd admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:07.828550 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c510f9-9e2f-454b-8934-393b45e4f4fd admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:07.838043 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b0324-32d7-4983-b0f1-209a59d72e1e admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:07.839595 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e42fd1-80a0-4896-91c5-a1572c02e750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:07.840236 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e42fd1-80a0-4896-91c5-a1572c02e750 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:07.840759 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e42fd1-80a0-4896-91c5-a1572c02e750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:07.841189 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e42fd1-80a0-4896-91c5-a1572c02e750 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:07.841974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e42fd1-80a0-4896-91c5-a1572c02e750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:07.843505 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d6056-2d93-4368-a9b7-8ade38269cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:07.844033 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e42fd1-80a0-4896-91c5-a1572c02e750 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:07.844192 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d6056-2d93-4368-a9b7-8ade38269cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:07.844426 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d6056-2d93-4368-a9b7-8ade38269cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:07.844701 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d6056-2d93-4368-a9b7-8ade38269cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:07.845340 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d6056-2d93-4368-a9b7-8ade38269cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:07.847070 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d6056-2d93-4368-a9b7-8ade38269cf4 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:07.857454 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1197/2398] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:49:07.858506 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1202/2399] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:49:07.862802 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d6056-2d93-4368-a9b7-8ade38269cf4 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:07.863755 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e42fd1-80a0-4896-91c5-a1572c02e750 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:07.874370 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d6056-2d93-4368-a9b7-8ade38269cf4 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:07.874570 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e42fd1-80a0-4896-91c5-a1572c02e750 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:07.879126 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3c4f8-8c9e-4a02-8221-882b940e3e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:07.879668 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c0008-38ec-419b-aff9-b297b2e1250f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:07.879795 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3c4f8-8c9e-4a02-8221-882b940e3e5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:07.880069 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3c4f8-8c9e-4a02-8221-882b940e3e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:07.880399 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3c4f8-8c9e-4a02-8221-882b940e3e5c admin admin] PATH_INFO: `/v3/projects/b83f4289f9cc414ab69a1aec39153a13/users/efaedb6b4da6472782217ae60a779bd1/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:07.880785 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c0008-38ec-419b-aff9-b297b2e1250f admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:07.881128 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c0008-38ec-419b-aff9-b297b2e1250f admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:07.881406 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c0008-38ec-419b-aff9-b297b2e1250f admin admin] PATH_INFO: `/v3/projects/a8c43ce3df1a4863b97e9b7860674043/users/8ff76a3c100b4a2e9ae73aa484091169/roles/9252c356af254127896f3626d925a88a` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:07.897684 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed3c4f8-8c9e-4a02-8221-882b940e3e5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b83f4289f9cc414ab69a1aec39153a13, user_id=efaedb6b4da6472782217ae60a779bd1, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:07.900994 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed3c4f8-8c9e-4a02-8221-882b940e3e5c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:07.902501 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c0008-38ec-419b-aff9-b297b2e1250f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8c43ce3df1a4863b97e9b7860674043, user_id=8ff76a3c100b4a2e9ae73aa484091169, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:07.905313 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c0008-38ec-419b-aff9-b297b2e1250f admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:07.991168 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1203/2400] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:49:07 2022] PUT /identity/v3/projects/b83f4289f9cc414ab69a1aec39153a13/users/efaedb6b4da6472782217ae60a779bd1/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:07.995618 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3c4f8-8c9e-4a02-8221-882b940e3e5c admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:07.997159 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1198/2401] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:49:07 2022] PUT /identity/v3/projects/a8c43ce3df1a4863b97e9b7860674043/users/8ff76a3c100b4a2e9ae73aa484091169/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:08.001882 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c0008-38ec-419b-aff9-b297b2e1250f admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:08.020151 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:08.062253 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3c4f8-8c9e-4a02-8221-882b940e3e5c admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:08.067094 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89a8e9-8883-4b60-b40d-767eb3fedeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:08.067705 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89a8e9-8883-4b60-b40d-767eb3fedeb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:08.067989 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89a8e9-8883-4b60-b40d-767eb3fedeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:08.068292 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89a8e9-8883-4b60-b40d-767eb3fedeb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:08.068931 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c89a8e9-8883-4b60-b40d-767eb3fedeb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:08.070540 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c89a8e9-8883-4b60-b40d-767eb3fedeb7 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:08.072923 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:08.083558 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1204/2402] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:49:08.085348 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c0008-38ec-419b-aff9-b297b2e1250f admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:08.087696 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89a8e9-8883-4b60-b40d-767eb3fedeb7 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:08.090767 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84956870-ebc6-457a-b886-11f4cfd046d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:08.091377 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84956870-ebc6-457a-b886-11f4cfd046d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:08.091658 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84956870-ebc6-457a-b886-11f4cfd046d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:08.091931 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84956870-ebc6-457a-b886-11f4cfd046d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:08.092616 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84956870-ebc6-457a-b886-11f4cfd046d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:08.094217 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84956870-ebc6-457a-b886-11f4cfd046d7 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:08.100330 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89a8e9-8883-4b60-b40d-767eb3fedeb7 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:08.104966 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1199/2403] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:49:08.105963 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d432d65-94d5-4625-b873-2a0d1d3a6534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:08.106627 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d432d65-94d5-4625-b873-2a0d1d3a6534 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:08.106907 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d432d65-94d5-4625-b873-2a0d1d3a6534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:08.107181 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d432d65-94d5-4625-b873-2a0d1d3a6534 admin admin] PATH_INFO: `/v3/projects/b83f4289f9cc414ab69a1aec39153a13/users/efaedb6b4da6472782217ae60a779bd1/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:08.108991 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84956870-ebc6-457a-b886-11f4cfd046d7 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:08.109595 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d432d65-94d5-4625-b873-2a0d1d3a6534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b83f4289f9cc414ab69a1aec39153a13, user_id=efaedb6b4da6472782217ae60a779bd1, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:08.112557 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d432d65-94d5-4625-b873-2a0d1d3a6534 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:08.120068 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84956870-ebc6-457a-b886-11f4cfd046d7 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:08.133435 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1205/2404] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:49:08 2022] PUT /identity/v3/projects/b83f4289f9cc414ab69a1aec39153a13/users/efaedb6b4da6472782217ae60a779bd1/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:08.137159 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b67255-6216-4867-bfb3-50dfa6c98e01 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:08.137420 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b67255-6216-4867-bfb3-50dfa6c98e01 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:08.138212 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b67255-6216-4867-bfb3-50dfa6c98e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:08.172277 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-d2b67255-6216-4867-bfb3-50dfa6c98e01 None None] MFA Rules not processed for user `efaedb6b4da6472782217ae60a779bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:08.173973 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d2b67255-6216-4867-bfb3-50dfa6c98e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:08.187670 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be656a1d-8154-498b-b499-b48985a3705f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:08.188514 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be656a1d-8154-498b-b499-b48985a3705f admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:08.188937 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be656a1d-8154-498b-b499-b48985a3705f admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:08.189271 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be656a1d-8154-498b-b499-b48985a3705f admin admin] PATH_INFO: `/v3/projects/a8c43ce3df1a4863b97e9b7860674043/users/8ff76a3c100b4a2e9ae73aa484091169/roles/9252c356af254127896f3626d925a88a` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:08.191343 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be656a1d-8154-498b-b499-b48985a3705f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8c43ce3df1a4863b97e9b7860674043, user_id=8ff76a3c100b4a2e9ae73aa484091169, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:08.194098 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be656a1d-8154-498b-b499-b48985a3705f admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:08.206307 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1200/2405] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:49:08 2022] PUT /identity/v3/projects/a8c43ce3df1a4863b97e9b7860674043/users/8ff76a3c100b4a2e9ae73aa484091169/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:08.216861 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bdb636-316b-4e5c-890b-e1d988442824 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:08.217305 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bdb636-316b-4e5c-890b-e1d988442824 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:08.217675 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bdb636-316b-4e5c-890b-e1d988442824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:08.251670 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-37bdb636-316b-4e5c-890b-e1d988442824 None None] MFA Rules not processed for user `8ff76a3c100b4a2e9ae73aa484091169`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:08.256501 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-37bdb636-316b-4e5c-890b-e1d988442824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:08.264535 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1206/2406] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:08 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:08.272609 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b67255-6216-4867-bfb3-50dfa6c98e01 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:08.274525 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d2b67255-6216-4867-bfb3-50dfa6c98e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:08.325399 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1201/2407] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:08 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:49:08.335873 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bdb636-316b-4e5c-890b-e1d988442824 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:08.336016 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b67255-6216-4867-bfb3-50dfa6c98e01 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:08.337692 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-37bdb636-316b-4e5c-890b-e1d988442824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:08.374368 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:08.395198 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc76e0b-66e6-4990-8dfd-a56c3cf8e409 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:08.395967 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc76e0b-66e6-4990-8dfd-a56c3cf8e409 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:08.396340 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc76e0b-66e6-4990-8dfd-a56c3cf8e409 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:08.396670 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc76e0b-66e6-4990-8dfd-a56c3cf8e409 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:08.406898 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bdb636-316b-4e5c-890b-e1d988442824 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:08.411669 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a8498-32ce-48cb-be2b-3906ef259ba6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:08.412326 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a8498-32ce-48cb-be2b-3906ef259ba6 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:08.412604 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a8498-32ce-48cb-be2b-3906ef259ba6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:08.417255 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a8498-32ce-48cb-be2b-3906ef259ba6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:08.423963 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a8498-32ce-48cb-be2b-3906ef259ba6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:08.425434 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a8498-32ce-48cb-be2b-3906ef259ba6 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:08.448390 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1202/2408] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:08 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:49:08.448825 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:08.475090 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc76e0b-66e6-4990-8dfd-a56c3cf8e409 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:08.476673 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc76e0b-66e6-4990-8dfd-a56c3cf8e409 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:08.494019 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1207/2409] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:08 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:49:08.750763 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a8498-32ce-48cb-be2b-3906ef259ba6 service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:08.771509 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a8498-32ce-48cb-be2b-3906ef259ba6 service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:08.780402 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f547c-b3a7-49a0-8eb4-2e01d4e0218f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:08.781455 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f547c-b3a7-49a0-8eb4-2e01d4e0218f service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:08.781918 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f547c-b3a7-49a0-8eb4-2e01d4e0218f service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:08.782391 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f547c-b3a7-49a0-8eb4-2e01d4e0218f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:08.860198 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f547c-b3a7-49a0-8eb4-2e01d4e0218f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:08.861713 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f547c-b3a7-49a0-8eb4-2e01d4e0218f service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:08.876877 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1203/2410] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:49:09.574486 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc76e0b-66e6-4990-8dfd-a56c3cf8e409 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:09.583372 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc76e0b-66e6-4990-8dfd-a56c3cf8e409 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:09.587645 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c41e0-5260-4bac-84c1-de1d13b7c15a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:09.588311 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c41e0-5260-4bac-84c1-de1d13b7c15a service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:09.588589 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c41e0-5260-4bac-84c1-de1d13b7c15a service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:09.596088 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c41e0-5260-4bac-84c1-de1d13b7c15a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:09.650988 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c41e0-5260-4bac-84c1-de1d13b7c15a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:09.653389 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c41e0-5260-4bac-84c1-de1d13b7c15a service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:09.663833 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1208/2411] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:49:15.559443 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f547c-b3a7-49a0-8eb4-2e01d4e0218f service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:15.569087 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f547c-b3a7-49a0-8eb4-2e01d4e0218f service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:15.573081 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afb255-ca57-4eff-904a-e7b216884e7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:15.573687 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afb255-ca57-4eff-904a-e7b216884e7e service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:15.573964 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afb255-ca57-4eff-904a-e7b216884e7e service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:15.574235 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afb255-ca57-4eff-904a-e7b216884e7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:15.632425 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afb255-ca57-4eff-904a-e7b216884e7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:15.633895 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afb255-ca57-4eff-904a-e7b216884e7e service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:15.642689 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1204/2412] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:49:18.343159 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c41e0-5260-4bac-84c1-de1d13b7c15a service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:18.406898 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c41e0-5260-4bac-84c1-de1d13b7c15a service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:18.412870 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dace8a9-4e6e-43e9-bf3a-f8a4a3fac9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:18.413671 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dace8a9-4e6e-43e9-bf3a-f8a4a3fac9c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:18.414045 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dace8a9-4e6e-43e9-bf3a-f8a4a3fac9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:18.414392 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dace8a9-4e6e-43e9-bf3a-f8a4a3fac9c2 admin admin] PATH_INFO: `/v3/users/b36daaab985947cb8c76205a9ac009fc` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:18.415860 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dace8a9-4e6e-43e9-bf3a-f8a4a3fac9c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b36daaab985947cb8c76205a9ac009fc)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:18.419037 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dace8a9-4e6e-43e9-bf3a-f8a4a3fac9c2 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:18.635625 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-9dace8a9-4e6e-43e9-bf3a-f8a4a3fac9c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b36daaab985947cb8c76205a9ac009fc'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:18.650732 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-9dace8a9-4e6e-43e9-bf3a-f8a4a3fac9c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b36daaab985947cb8c76205a9ac009fc'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:18.651733 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-9dace8a9-4e6e-43e9-bf3a-f8a4a3fac9c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b36daaab985947cb8c76205a9ac009fc'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:18.659271 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-9dace8a9-4e6e-43e9-bf3a-f8a4a3fac9c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b36daaab985947cb8c76205a9ac009fc'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:18.660144 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-9dace8a9-4e6e-43e9-bf3a-f8a4a3fac9c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b36daaab985947cb8c76205a9ac009fc'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:18.661844 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:18.746583 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1209/2413] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:49:18 2022] DELETE /identity/v3/users/b36daaab985947cb8c76205a9ac009fc => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:49:18.751080 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44893257-ba06-46b7-b047-1cd20d5f0ec0 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:18.751553 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44893257-ba06-46b7-b047-1cd20d5f0ec0 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:18.751646 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44893257-ba06-46b7-b047-1cd20d5f0ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:18.772532 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-44893257-ba06-46b7-b047-1cd20d5f0ec0 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:18.777022 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-44893257-ba06-46b7-b047-1cd20d5f0ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:18.834520 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1205/2414] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:18.844423 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dace8a9-4e6e-43e9-bf3a-f8a4a3fac9c2 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:18.845853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9dace8a9-4e6e-43e9-bf3a-f8a4a3fac9c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:18.906921 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dace8a9-4e6e-43e9-bf3a-f8a4a3fac9c2 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:18.911077 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b9550-ddfe-4d82-9263-24de7d501964 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:18.911689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b9550-ddfe-4d82-9263-24de7d501964 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:18.911967 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b9550-ddfe-4d82-9263-24de7d501964 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:18.912274 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b9550-ddfe-4d82-9263-24de7d501964 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:18.923170 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b9550-ddfe-4d82-9263-24de7d501964 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:18.924818 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b9550-ddfe-4d82-9263-24de7d501964 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:18.936733 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1210/2415] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:49:19.397553 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44893257-ba06-46b7-b047-1cd20d5f0ec0 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:19.399003 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-44893257-ba06-46b7-b047-1cd20d5f0ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:19.413506 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44893257-ba06-46b7-b047-1cd20d5f0ec0 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:19.418710 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0538b70-e211-4aef-b0f6-aeac37f4887b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:19.420492 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0538b70-e211-4aef-b0f6-aeac37f4887b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:19.420492 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0538b70-e211-4aef-b0f6-aeac37f4887b admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:19.420492 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0538b70-e211-4aef-b0f6-aeac37f4887b admin admin] PATH_INFO: `/v3/projects/bb57d5a1bbbc4594987a45931d7b5865` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:19.421862 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0538b70-e211-4aef-b0f6-aeac37f4887b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb57d5a1bbbc4594987a45931d7b5865)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:19.423749 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0538b70-e211-4aef-b0f6-aeac37f4887b admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:19.426594 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:19.567826 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c0538b70-e211-4aef-b0f6-aeac37f4887b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb57d5a1bbbc4594987a45931d7b5865', 'request_id': 'req-c0538b70-e211-4aef-b0f6-aeac37f4887b'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:19.574625 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c0538b70-e211-4aef-b0f6-aeac37f4887b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb57d5a1bbbc4594987a45931d7b5865', 'request_id': 'req-c0538b70-e211-4aef-b0f6-aeac37f4887b'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:19.580008 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c0538b70-e211-4aef-b0f6-aeac37f4887b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb57d5a1bbbc4594987a45931d7b5865', 'request_id': 'req-c0538b70-e211-4aef-b0f6-aeac37f4887b'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:19.685640 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c0538b70-e211-4aef-b0f6-aeac37f4887b admin admin] The token cache is being invalidate because project bb57d5a1bbbc4594987a45931d7b5865 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:49:19.685923 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c0538b70-e211-4aef-b0f6-aeac37f4887b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:19.686542 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c0538b70-e211-4aef-b0f6-aeac37f4887b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:19.688200 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1206/2416] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:49:19 2022] DELETE /identity/v3/projects/bb57d5a1bbbc4594987a45931d7b5865 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:19.692161 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b9550-ddfe-4d82-9263-24de7d501964 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:19.702214 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b9550-ddfe-4d82-9263-24de7d501964 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:19.761044 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c572ab3-5ad5-4821-95c4-1557b9f2288e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:19.761675 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c572ab3-5ad5-4821-95c4-1557b9f2288e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:19.761959 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c572ab3-5ad5-4821-95c4-1557b9f2288e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:19.762334 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c572ab3-5ad5-4821-95c4-1557b9f2288e admin admin] PATH_INFO: `/v3/users/efaedb6b4da6472782217ae60a779bd1` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:19.764074 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c572ab3-5ad5-4821-95c4-1557b9f2288e admin admin] RBAC: Authorizing `identity:delete_user(user_id=efaedb6b4da6472782217ae60a779bd1)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:19.767561 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c572ab3-5ad5-4821-95c4-1557b9f2288e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:19.824759 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0538b70-e211-4aef-b0f6-aeac37f4887b admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:19.826167 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c0538b70-e211-4aef-b0f6-aeac37f4887b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:19.838877 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0538b70-e211-4aef-b0f6-aeac37f4887b admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:19.843359 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9b69e-9e69-46fa-b7df-898b3bb087b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:19.843970 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9b69e-9e69-46fa-b7df-898b3bb087b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:19.844277 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9b69e-9e69-46fa-b7df-898b3bb087b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:19.844546 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9b69e-9e69-46fa-b7df-898b3bb087b8 admin admin] PATH_INFO: `/v3/users/7a9e660f910f4a838fab665df9bfbb58` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:19.845652 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9b69e-9e69-46fa-b7df-898b3bb087b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a9e660f910f4a838fab665df9bfbb58)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:19.847544 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9b69e-9e69-46fa-b7df-898b3bb087b8 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:19.976319 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-5c572ab3-5ad5-4821-95c4-1557b9f2288e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efaedb6b4da6472782217ae60a779bd1'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:19.989107 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-5c572ab3-5ad5-4821-95c4-1557b9f2288e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efaedb6b4da6472782217ae60a779bd1'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:19.989785 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-5c572ab3-5ad5-4821-95c4-1557b9f2288e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efaedb6b4da6472782217ae60a779bd1'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:19.997010 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-5c572ab3-5ad5-4821-95c4-1557b9f2288e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efaedb6b4da6472782217ae60a779bd1'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:19.997633 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-5c572ab3-5ad5-4821-95c4-1557b9f2288e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efaedb6b4da6472782217ae60a779bd1'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:20.044592 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b4f9b69e-9e69-46fa-b7df-898b3bb087b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a9e660f910f4a838fab665df9bfbb58'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:20.056543 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b4f9b69e-9e69-46fa-b7df-898b3bb087b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a9e660f910f4a838fab665df9bfbb58'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:20.063483 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b4f9b69e-9e69-46fa-b7df-898b3bb087b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a9e660f910f4a838fab665df9bfbb58'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:20.064219 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b4f9b69e-9e69-46fa-b7df-898b3bb087b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a9e660f910f4a838fab665df9bfbb58'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:20.064845 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b4f9b69e-9e69-46fa-b7df-898b3bb087b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a9e660f910f4a838fab665df9bfbb58'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:20.087074 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1211/2417] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:49:19 2022] DELETE /identity/v3/users/efaedb6b4da6472782217ae60a779bd1 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:20.157001 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1207/2418] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:49:19 2022] DELETE /identity/v3/users/7a9e660f910f4a838fab665df9bfbb58 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:20.162084 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2ed96-218e-4eef-94b0-7702f319fd03 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:20.162376 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2ed96-218e-4eef-94b0-7702f319fd03 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:20.162656 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2ed96-218e-4eef-94b0-7702f319fd03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:20.185475 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-69c2ed96-218e-4eef-94b0-7702f319fd03 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:20.186926 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-69c2ed96-218e-4eef-94b0-7702f319fd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:20.196557 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:20.254342 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1212/2419] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:49:20.275272 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9b69e-9e69-46fa-b7df-898b3bb087b8 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:20.276898 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-b4f9b69e-9e69-46fa-b7df-898b3bb087b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:20.357665 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9b69e-9e69-46fa-b7df-898b3bb087b8 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:20.361458 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e5585-6b12-46a0-aedc-f51c3b56d051 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:20.362073 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e5585-6b12-46a0-aedc-f51c3b56d051 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:20.362352 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e5585-6b12-46a0-aedc-f51c3b56d051 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:20.362691 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e5585-6b12-46a0-aedc-f51c3b56d051 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:20.373246 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218e5585-6b12-46a0-aedc-f51c3b56d051 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:20.374684 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218e5585-6b12-46a0-aedc-f51c3b56d051 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:20.384763 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1208/2420] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:49:20.556771 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2ed96-218e-4eef-94b0-7702f319fd03 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:20.556771 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-69c2ed96-218e-4eef-94b0-7702f319fd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:20.578616 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2ed96-218e-4eef-94b0-7702f319fd03 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:20.584826 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de589d-7a86-4e3b-9f82-66618969e104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:20.589016 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de589d-7a86-4e3b-9f82-66618969e104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:20.589016 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de589d-7a86-4e3b-9f82-66618969e104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:20.589016 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de589d-7a86-4e3b-9f82-66618969e104 admin admin] PATH_INFO: `/v3/projects/b83f4289f9cc414ab69a1aec39153a13` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:20.589016 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17de589d-7a86-4e3b-9f82-66618969e104 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b83f4289f9cc414ab69a1aec39153a13)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:20.590303 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17de589d-7a86-4e3b-9f82-66618969e104 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:20.711360 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-17de589d-7a86-4e3b-9f82-66618969e104 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b83f4289f9cc414ab69a1aec39153a13', 'request_id': 'req-17de589d-7a86-4e3b-9f82-66618969e104'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:20.718282 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-17de589d-7a86-4e3b-9f82-66618969e104 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b83f4289f9cc414ab69a1aec39153a13', 'request_id': 'req-17de589d-7a86-4e3b-9f82-66618969e104'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:20.725139 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-17de589d-7a86-4e3b-9f82-66618969e104 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b83f4289f9cc414ab69a1aec39153a13', 'request_id': 'req-17de589d-7a86-4e3b-9f82-66618969e104'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:20.784195 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-17de589d-7a86-4e3b-9f82-66618969e104 admin admin] The token cache is being invalidate because project b83f4289f9cc414ab69a1aec39153a13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:49:20.784709 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-17de589d-7a86-4e3b-9f82-66618969e104 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:20.785666 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-17de589d-7a86-4e3b-9f82-66618969e104 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:20.787581 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1213/2421] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:49:20 2022] DELETE /identity/v3/projects/b83f4289f9cc414ab69a1aec39153a13 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:20.800513 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433dbcbc-4e88-4bc8-a639-645bf79b8897 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:20.801038 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433dbcbc-4e88-4bc8-a639-645bf79b8897 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:20.801376 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433dbcbc-4e88-4bc8-a639-645bf79b8897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:20.816552 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:20.823179 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-433dbcbc-4e88-4bc8-a639-645bf79b8897 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:20.824453 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-433dbcbc-4e88-4bc8-a639-645bf79b8897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:20.886153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1209/2422] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:20.895000 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a142a-37c5-413b-a27b-8f23127f2b67 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:20.895282 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a142a-37c5-413b-a27b-8f23127f2b67 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:20.895553 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a142a-37c5-413b-a27b-8f23127f2b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:20.917808 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-b85a142a-37c5-413b-a27b-8f23127f2b67 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:20.919010 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b85a142a-37c5-413b-a27b-8f23127f2b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:20.933053 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1214/2423] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:20.937516 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433dbcbc-4e88-4bc8-a639-645bf79b8897 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:20.947330 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433dbcbc-4e88-4bc8-a639-645bf79b8897 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:20.952785 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd5dd1-440b-43b5-b670-adddcec1662c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:20.953391 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd5dd1-440b-43b5-b670-adddcec1662c admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:20.953667 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd5dd1-440b-43b5-b670-adddcec1662c admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:20.954100 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd5dd1-440b-43b5-b670-adddcec1662c admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:20.954742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd5dd1-440b-43b5-b670-adddcec1662c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:49:20.960444 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd5dd1-440b-43b5-b670-adddcec1662c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:20.960444 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd5dd1-440b-43b5-b670-adddcec1662c admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:20.971267 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1210/2424] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:49:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:49:20.976661 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a142a-37c5-413b-a27b-8f23127f2b67 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:20.988789 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a142a-37c5-413b-a27b-8f23127f2b67 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:20.994489 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b129d-e4fa-449b-b064-ccdc54a1fa49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:20.995096 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b129d-e4fa-449b-b064-ccdc54a1fa49 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:20.995403 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b129d-e4fa-449b-b064-ccdc54a1fa49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:20.995674 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b129d-e4fa-449b-b064-ccdc54a1fa49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:20.996342 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4b129d-e4fa-449b-b064-ccdc54a1fa49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:20.998288 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4b129d-e4fa-449b-b064-ccdc54a1fa49 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:21.115756 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1215/2425] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:49:20 2022] POST /identity/v3/projects => generated 367 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:49:21.116953 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd5dd1-440b-43b5-b670-adddcec1662c admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:21.127895 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd5dd1-440b-43b5-b670-adddcec1662c admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:21.179066 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b129d-e4fa-449b-b064-ccdc54a1fa49 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:21.181160 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8d4b129d-e4fa-449b-b064-ccdc54a1fa49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:21.184823 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931bd61f-b8f3-475d-929b-ead12ada5dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:21.185441 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bd61f-b8f3-475d-929b-ead12ada5dad admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:21.185720 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bd61f-b8f3-475d-929b-ead12ada5dad admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:21.186111 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bd61f-b8f3-475d-929b-ead12ada5dad admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:21.186745 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931bd61f-b8f3-475d-929b-ead12ada5dad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:21.188712 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931bd61f-b8f3-475d-929b-ead12ada5dad admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:21.195973 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b129d-e4fa-449b-b064-ccdc54a1fa49 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:21.203247 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70478d-1d83-4acd-8605-6b106d1fc416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:21.203903 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70478d-1d83-4acd-8605-6b106d1fc416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:21.204279 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70478d-1d83-4acd-8605-6b106d1fc416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:21.204664 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70478d-1d83-4acd-8605-6b106d1fc416 admin admin] PATH_INFO: `/v3/projects/ee6ad63f5dcd4dceb0add6f4eed9e901` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:21.205698 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70478d-1d83-4acd-8605-6b106d1fc416 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee6ad63f5dcd4dceb0add6f4eed9e901)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:21.207604 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70478d-1d83-4acd-8605-6b106d1fc416 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:21.287568 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1211/2426] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:49:21 2022] POST /identity/v3/users => generated 284 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:49:21.293510 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931bd61f-b8f3-475d-929b-ead12ada5dad admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:21.307830 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931bd61f-b8f3-475d-929b-ead12ada5dad admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:21.313363 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f9b00-fe52-4e0d-a5d1-b0089e6c3650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:21.314039 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f9b00-fe52-4e0d-a5d1-b0089e6c3650 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:21.314320 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f9b00-fe52-4e0d-a5d1-b0089e6c3650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:21.314591 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f9b00-fe52-4e0d-a5d1-b0089e6c3650 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:21.315244 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f9b00-fe52-4e0d-a5d1-b0089e6c3650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:21.316932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f9b00-fe52-4e0d-a5d1-b0089e6c3650 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:21.331572 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1212/2427] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:49:21.335591 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f9b00-fe52-4e0d-a5d1-b0089e6c3650 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:21.344407 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0c70478d-1d83-4acd-8605-6b106d1fc416 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee6ad63f5dcd4dceb0add6f4eed9e901', 'request_id': 'req-0c70478d-1d83-4acd-8605-6b106d1fc416'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:21.352409 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f9b00-fe52-4e0d-a5d1-b0089e6c3650 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:21.352699 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0c70478d-1d83-4acd-8605-6b106d1fc416 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee6ad63f5dcd4dceb0add6f4eed9e901', 'request_id': 'req-0c70478d-1d83-4acd-8605-6b106d1fc416'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:21.364840 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0c70478d-1d83-4acd-8605-6b106d1fc416 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee6ad63f5dcd4dceb0add6f4eed9e901', 'request_id': 'req-0c70478d-1d83-4acd-8605-6b106d1fc416'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:21.370305 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:21.440676 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae9955-16ef-4cb5-a19e-6f8dbbad04c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:21.441394 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae9955-16ef-4cb5-a19e-6f8dbbad04c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:21.441734 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae9955-16ef-4cb5-a19e-6f8dbbad04c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:21.442071 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae9955-16ef-4cb5-a19e-6f8dbbad04c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:21.442782 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae9955-16ef-4cb5-a19e-6f8dbbad04c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:21.444473 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae9955-16ef-4cb5-a19e-6f8dbbad04c8 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:21.463600 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1213/2428] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:49:21.467999 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae9955-16ef-4cb5-a19e-6f8dbbad04c8 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:21.479793 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0c70478d-1d83-4acd-8605-6b106d1fc416 admin admin] The token cache is being invalidate because project ee6ad63f5dcd4dceb0add6f4eed9e901 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:49:21.480291 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae9955-16ef-4cb5-a19e-6f8dbbad04c8 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:21.480996 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0c70478d-1d83-4acd-8605-6b106d1fc416 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:21.482981 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0c70478d-1d83-4acd-8605-6b106d1fc416 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:21.485629 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1216/2429] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:49:21 2022] DELETE /identity/v3/projects/ee6ad63f5dcd4dceb0add6f4eed9e901 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:49:21.488108 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2efde-8468-493a-a67d-f2d1029be431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:21.488847 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2efde-8468-493a-a67d-f2d1029be431 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:21.489124 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2efde-8468-493a-a67d-f2d1029be431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:21.489395 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2efde-8468-493a-a67d-f2d1029be431 admin admin] PATH_INFO: `/v3/projects/555ecd9bcaf2481e9641f1e876e4f329/users/e02af6294f7f4a63a9235b68b78b0188/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:21.492250 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70478d-1d83-4acd-8605-6b106d1fc416 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:21.493944 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:21.506605 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a2efde-8468-493a-a67d-f2d1029be431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=555ecd9bcaf2481e9641f1e876e4f329, user_id=e02af6294f7f4a63a9235b68b78b0188, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:21.509306 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0c70478d-1d83-4acd-8605-6b106d1fc416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:21.516135 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a2efde-8468-493a-a67d-f2d1029be431 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:21.524737 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70478d-1d83-4acd-8605-6b106d1fc416 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:21.530785 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2f308-e6fd-45b8-a9ad-bf01536ef32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:21.531442 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2f308-e6fd-45b8-a9ad-bf01536ef32a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:21.532141 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2f308-e6fd-45b8-a9ad-bf01536ef32a admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:21.532283 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2f308-e6fd-45b8-a9ad-bf01536ef32a admin admin] PATH_INFO: `/v3/users/398ec7f739c849a4832b515d0428f204` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:21.533385 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f2f308-e6fd-45b8-a9ad-bf01536ef32a admin admin] RBAC: Authorizing `identity:delete_user(user_id=398ec7f739c849a4832b515d0428f204)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:21.536347 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f2f308-e6fd-45b8-a9ad-bf01536ef32a admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:21.618585 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1214/2430] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:49:21 2022] PUT /identity/v3/projects/555ecd9bcaf2481e9641f1e876e4f329/users/e02af6294f7f4a63a9235b68b78b0188/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:49:21.629541 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a2f5e-ca4f-4756-b1fb-6b04a3f3c8cb None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:21.629824 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a2f5e-ca4f-4756-b1fb-6b04a3f3c8cb None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:21.630091 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a2f5e-ca4f-4756-b1fb-6b04a3f3c8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:21.658099 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-cf9a2f5e-ca4f-4756-b1fb-6b04a3f3c8cb None None] MFA Rules not processed for user `e02af6294f7f4a63a9235b68b78b0188`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:21.659280 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-cf9a2f5e-ca4f-4756-b1fb-6b04a3f3c8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:21.727935 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1215/2431] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:49:21.732511 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a2f5e-ca4f-4756-b1fb-6b04a3f3c8cb None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:21.733967 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-cf9a2f5e-ca4f-4756-b1fb-6b04a3f3c8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:21.736346 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-86f2f308-e6fd-45b8-a9ad-bf01536ef32a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '398ec7f739c849a4832b515d0428f204'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:21.750125 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-86f2f308-e6fd-45b8-a9ad-bf01536ef32a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '398ec7f739c849a4832b515d0428f204'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:21.750958 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-86f2f308-e6fd-45b8-a9ad-bf01536ef32a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '398ec7f739c849a4832b515d0428f204'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:21.759215 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-86f2f308-e6fd-45b8-a9ad-bf01536ef32a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '398ec7f739c849a4832b515d0428f204'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:21.760717 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-86f2f308-e6fd-45b8-a9ad-bf01536ef32a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '398ec7f739c849a4832b515d0428f204'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:21.800707 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a2f5e-ca4f-4756-b1fb-6b04a3f3c8cb None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:21.805333 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad15dd-80b4-4357-9cd5-474cd86e1690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:21.805930 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad15dd-80b4-4357-9cd5-474cd86e1690 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:21.806496 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad15dd-80b4-4357-9cd5-474cd86e1690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:21.806623 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad15dd-80b4-4357-9cd5-474cd86e1690 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:21.807205 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad15dd-80b4-4357-9cd5-474cd86e1690 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:21.809151 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad15dd-80b4-4357-9cd5-474cd86e1690 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:21.826358 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1217/2432] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:49:21 2022] DELETE /identity/v3/users/398ec7f739c849a4832b515d0428f204 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:21.942603 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1216/2433] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:49:21 2022] POST /identity/v3/projects => generated 367 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:49:21.947478 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2f308-e6fd-45b8-a9ad-bf01536ef32a admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:21.948907 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-86f2f308-e6fd-45b8-a9ad-bf01536ef32a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:22.015907 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2f308-e6fd-45b8-a9ad-bf01536ef32a admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:22.081667 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54444fb5-aeb3-4076-b3ff-6cd66fa917d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:22.082361 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54444fb5-aeb3-4076-b3ff-6cd66fa917d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:22.082703 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54444fb5-aeb3-4076-b3ff-6cd66fa917d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:22.082980 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54444fb5-aeb3-4076-b3ff-6cd66fa917d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:22.083624 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54444fb5-aeb3-4076-b3ff-6cd66fa917d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:22.085586 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54444fb5-aeb3-4076-b3ff-6cd66fa917d2 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:22.168154 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:INSERT=5,keystone:DELETE=11,keystone:SELECT=84 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:22.173750 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1218/2434] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:49:21 2022] POST /identity/v3/users => generated 290 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:49:22.177464 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad15dd-80b4-4357-9cd5-474cd86e1690 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:22.188939 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad15dd-80b4-4357-9cd5-474cd86e1690 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:22.193571 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1031c-7338-4bae-863a-bfe0d0b5a4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:22.194167 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1031c-7338-4bae-863a-bfe0d0b5a4d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:22.194447 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1031c-7338-4bae-863a-bfe0d0b5a4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:22.194717 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1031c-7338-4bae-863a-bfe0d0b5a4d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:22.195351 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d1031c-7338-4bae-863a-bfe0d0b5a4d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:22.196985 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d1031c-7338-4bae-863a-bfe0d0b5a4d9 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:22.222170 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1217/2435] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:49:22.225190 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54444fb5-aeb3-4076-b3ff-6cd66fa917d2 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:22.235927 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54444fb5-aeb3-4076-b3ff-6cd66fa917d2 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:22.240542 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10bd6a1-b077-407f-8f1c-7e6a085fa86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:22.241180 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10bd6a1-b077-407f-8f1c-7e6a085fa86f admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:22.241452 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10bd6a1-b077-407f-8f1c-7e6a085fa86f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:22.241718 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10bd6a1-b077-407f-8f1c-7e6a085fa86f admin admin] PATH_INFO: `/v3/projects/90bd1670d21448a8b2a0a9c50cbf7eb7/users/dde7c36c3dcb4c1eaf1c9a2dc6248d3b/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:22.256500 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10bd6a1-b077-407f-8f1c-7e6a085fa86f admin admin] RBAC: Authorizing `identity:create_grant(project_id=90bd1670d21448a8b2a0a9c50cbf7eb7, user_id=dde7c36c3dcb4c1eaf1c9a2dc6248d3b, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:22.259222 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10bd6a1-b077-407f-8f1c-7e6a085fa86f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:22.315623 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1031c-7338-4bae-863a-bfe0d0b5a4d9 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:22.315623 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c7d1031c-7338-4bae-863a-bfe0d0b5a4d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:22.331280 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1031c-7338-4bae-863a-bfe0d0b5a4d9 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:22.336740 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed6cdf-aea0-4744-ac7c-1821c5dbdbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:22.337454 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed6cdf-aea0-4744-ac7c-1821c5dbdbda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:22.337750 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed6cdf-aea0-4744-ac7c-1821c5dbdbda admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:22.338404 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed6cdf-aea0-4744-ac7c-1821c5dbdbda admin admin] PATH_INFO: `/v3/projects/d0eb2265c4da4b3588577b7205c95178` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:22.339648 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed6cdf-aea0-4744-ac7c-1821c5dbdbda admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0eb2265c4da4b3588577b7205c95178)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:22.346890 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed6cdf-aea0-4744-ac7c-1821c5dbdbda admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:22.347085 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1219/2436] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:49:22 2022] PUT /identity/v3/projects/90bd1670d21448a8b2a0a9c50cbf7eb7/users/dde7c36c3dcb4c1eaf1c9a2dc6248d3b/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:22.347726 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10bd6a1-b077-407f-8f1c-7e6a085fa86f admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:22.412028 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10bd6a1-b077-407f-8f1c-7e6a085fa86f admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:22.416958 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c3474-2999-4ce5-be95-02155c29cc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:22.417587 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c3474-2999-4ce5-be95-02155c29cc0d admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:22.417838 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c3474-2999-4ce5-be95-02155c29cc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:22.418108 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c3474-2999-4ce5-be95-02155c29cc0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:22.418738 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c3474-2999-4ce5-be95-02155c29cc0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:22.420382 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c3474-2999-4ce5-be95-02155c29cc0d admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:22.430117 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1220/2437] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:49:22.434653 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c3474-2999-4ce5-be95-02155c29cc0d admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:22.444038 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c3474-2999-4ce5-be95-02155c29cc0d admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:22.449675 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d54e9-b749-4731-aa63-7860a92efbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:22.450303 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d54e9-b749-4731-aa63-7860a92efbe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:22.450608 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d54e9-b749-4731-aa63-7860a92efbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:22.451038 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d54e9-b749-4731-aa63-7860a92efbe2 admin admin] PATH_INFO: `/v3/projects/90bd1670d21448a8b2a0a9c50cbf7eb7/users/dde7c36c3dcb4c1eaf1c9a2dc6248d3b/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:22.452982 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d54e9-b749-4731-aa63-7860a92efbe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90bd1670d21448a8b2a0a9c50cbf7eb7, user_id=dde7c36c3dcb4c1eaf1c9a2dc6248d3b, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:22.455626 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d54e9-b749-4731-aa63-7860a92efbe2 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:22.466854 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1221/2438] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:49:22 2022] PUT /identity/v3/projects/90bd1670d21448a8b2a0a9c50cbf7eb7/users/dde7c36c3dcb4c1eaf1c9a2dc6248d3b/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:49:22.485780 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:22.486140 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf3a4f-0e30-4ca0-9040-4d5341896867 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:22.486426 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf3a4f-0e30-4ca0-9040-4d5341896867 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:22.486728 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf3a4f-0e30-4ca0-9040-4d5341896867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:22.490458 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b3ed6cdf-aea0-4744-ac7c-1821c5dbdbda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0eb2265c4da4b3588577b7205c95178', 'request_id': 'req-b3ed6cdf-aea0-4744-ac7c-1821c5dbdbda'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:22.499935 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b3ed6cdf-aea0-4744-ac7c-1821c5dbdbda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0eb2265c4da4b3588577b7205c95178', 'request_id': 'req-b3ed6cdf-aea0-4744-ac7c-1821c5dbdbda'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:22.518683 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b3ed6cdf-aea0-4744-ac7c-1821c5dbdbda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0eb2265c4da4b3588577b7205c95178', 'request_id': 'req-b3ed6cdf-aea0-4744-ac7c-1821c5dbdbda'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:22.521036 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-50cf3a4f-0e30-4ca0-9040-4d5341896867 None None] MFA Rules not processed for user `dde7c36c3dcb4c1eaf1c9a2dc6248d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:22.522254 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-50cf3a4f-0e30-4ca0-9040-4d5341896867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:22.596415 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b3ed6cdf-aea0-4744-ac7c-1821c5dbdbda admin admin] The token cache is being invalidate because project d0eb2265c4da4b3588577b7205c95178 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:49:22.601594 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b3ed6cdf-aea0-4744-ac7c-1821c5dbdbda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:22.601594 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b3ed6cdf-aea0-4744-ac7c-1821c5dbdbda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:22.601808 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1222/2439] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:22 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:49:22.601899 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1218/2440] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:49:22 2022] DELETE /identity/v3/projects/d0eb2265c4da4b3588577b7205c95178 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:49:22.609496 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf3a4f-0e30-4ca0-9040-4d5341896867 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:22.666644 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:22.680712 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed6cdf-aea0-4744-ac7c-1821c5dbdbda admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:22.682238 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-b3ed6cdf-aea0-4744-ac7c-1821c5dbdbda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:22.683632 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf3a4f-0e30-4ca0-9040-4d5341896867 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:22.688280 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad827067-0733-4a05-a7a4-013910c89e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:22.688908 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad827067-0733-4a05-a7a4-013910c89e8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:22.689179 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad827067-0733-4a05-a7a4-013910c89e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:22.689446 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad827067-0733-4a05-a7a4-013910c89e8a admin admin] PATH_INFO: `/v3/users/8ff76a3c100b4a2e9ae73aa484091169` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:22.690563 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad827067-0733-4a05-a7a4-013910c89e8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ff76a3c100b4a2e9ae73aa484091169)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:22.692683 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad827067-0733-4a05-a7a4-013910c89e8a admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:22.741869 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed6cdf-aea0-4744-ac7c-1821c5dbdbda admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:22.745654 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c6220-838b-4eb0-915e-27680d5cae0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:22.746247 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c6220-838b-4eb0-915e-27680d5cae0c service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:22.746546 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c6220-838b-4eb0-915e-27680d5cae0c service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:22.746813 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c6220-838b-4eb0-915e-27680d5cae0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:22.748568 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-450c6220-838b-4eb0-915e-27680d5cae0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:22.760513 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c6220-838b-4eb0-915e-27680d5cae0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:22.761916 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c6220-838b-4eb0-915e-27680d5cae0c service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:22.771157 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1219/2441] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:22 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:49:22.867388 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ad827067-0733-4a05-a7a4-013910c89e8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ff76a3c100b4a2e9ae73aa484091169'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:22.879624 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ad827067-0733-4a05-a7a4-013910c89e8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ff76a3c100b4a2e9ae73aa484091169'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:22.880476 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ad827067-0733-4a05-a7a4-013910c89e8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ff76a3c100b4a2e9ae73aa484091169'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:22.888606 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ad827067-0733-4a05-a7a4-013910c89e8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ff76a3c100b4a2e9ae73aa484091169'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:22.889277 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ad827067-0733-4a05-a7a4-013910c89e8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ff76a3c100b4a2e9ae73aa484091169'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:22.898227 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c6220-838b-4eb0-915e-27680d5cae0c service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:22.899629 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-450c6220-838b-4eb0-915e-27680d5cae0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:22.911419 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c6220-838b-4eb0-915e-27680d5cae0c service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:22.915089 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7e8da-2687-4fe7-aced-211c8624acea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:22.915719 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7e8da-2687-4fe7-aced-211c8624acea service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:22.916070 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7e8da-2687-4fe7-aced-211c8624acea service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:22.916371 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7e8da-2687-4fe7-aced-211c8624acea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:22.918058 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-ded7e8da-2687-4fe7-aced-211c8624acea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:22.961346 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1223/2442] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:49:22 2022] DELETE /identity/v3/users/8ff76a3c100b4a2e9ae73aa484091169 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:22.982032 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded7e8da-2687-4fe7-aced-211c8624acea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:22.983481 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded7e8da-2687-4fe7-aced-211c8624acea service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:22.992906 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1220/2443] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:49:23.380279 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad827067-0733-4a05-a7a4-013910c89e8a admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:23.381754 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ad827067-0733-4a05-a7a4-013910c89e8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:23.451296 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad827067-0733-4a05-a7a4-013910c89e8a admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:23.455928 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102e6bb-e8cd-4b51-a087-f39247bbf710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:23.456583 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102e6bb-e8cd-4b51-a087-f39247bbf710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:23.456890 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102e6bb-e8cd-4b51-a087-f39247bbf710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:23.457160 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102e6bb-e8cd-4b51-a087-f39247bbf710 admin admin] PATH_INFO: `/v3/projects/a8c43ce3df1a4863b97e9b7860674043` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:23.458337 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102e6bb-e8cd-4b51-a087-f39247bbf710 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8c43ce3df1a4863b97e9b7860674043)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:23.460264 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102e6bb-e8cd-4b51-a087-f39247bbf710 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:23.595325 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-f102e6bb-e8cd-4b51-a087-f39247bbf710 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8c43ce3df1a4863b97e9b7860674043', 'request_id': 'req-f102e6bb-e8cd-4b51-a087-f39247bbf710'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:23.604104 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-f102e6bb-e8cd-4b51-a087-f39247bbf710 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8c43ce3df1a4863b97e9b7860674043', 'request_id': 'req-f102e6bb-e8cd-4b51-a087-f39247bbf710'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:23.614058 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-f102e6bb-e8cd-4b51-a087-f39247bbf710 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8c43ce3df1a4863b97e9b7860674043', 'request_id': 'req-f102e6bb-e8cd-4b51-a087-f39247bbf710'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:23.617459 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:23.692892 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-f102e6bb-e8cd-4b51-a087-f39247bbf710 admin admin] The token cache is being invalidate because project a8c43ce3df1a4863b97e9b7860674043 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:49:23.700485 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-f102e6bb-e8cd-4b51-a087-f39247bbf710 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:23.700485 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-f102e6bb-e8cd-4b51-a087-f39247bbf710 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:23.700485 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1224/2444] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:49:23 2022] DELETE /identity/v3/projects/a8c43ce3df1a4863b97e9b7860674043 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:23.702233 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831487d9-6a51-498c-978c-a5baf2eb8e6b None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:23.702517 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831487d9-6a51-498c-978c-a5baf2eb8e6b None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:23.702793 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831487d9-6a51-498c-978c-a5baf2eb8e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:23.723917 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-831487d9-6a51-498c-978c-a5baf2eb8e6b None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:23.725701 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-831487d9-6a51-498c-978c-a5baf2eb8e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:23.791563 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1221/2445] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:23.800489 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef5179-6f2b-4733-bb70-749d574698d4 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:23.801025 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef5179-6f2b-4733-bb70-749d574698d4 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:23.801502 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef5179-6f2b-4733-bb70-749d574698d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:23.823068 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-42ef5179-6f2b-4733-bb70-749d574698d4 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:23.825023 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-42ef5179-6f2b-4733-bb70-749d574698d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:23.833760 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1225/2446] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:23.838403 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831487d9-6a51-498c-978c-a5baf2eb8e6b None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:23.848667 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831487d9-6a51-498c-978c-a5baf2eb8e6b None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:23.853214 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f9231-5544-413a-9ffe-410d57b4ec39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:23.853817 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f9231-5544-413a-9ffe-410d57b4ec39 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:23.854150 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f9231-5544-413a-9ffe-410d57b4ec39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:23.854431 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f9231-5544-413a-9ffe-410d57b4ec39 admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:23.855070 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f9231-5544-413a-9ffe-410d57b4ec39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:49:23.855363 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f9231-5544-413a-9ffe-410d57b4ec39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:23.856985 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f9231-5544-413a-9ffe-410d57b4ec39 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:23.866444 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:23.870819 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1222/2447] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:49:23.879198 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef5179-6f2b-4733-bb70-749d574698d4 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:23.889493 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef5179-6f2b-4733-bb70-749d574698d4 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:23.895087 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44f898-9870-4a96-bbfc-dacbefea287e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:23.895637 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44f898-9870-4a96-bbfc-dacbefea287e admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:23.895913 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44f898-9870-4a96-bbfc-dacbefea287e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:23.896298 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44f898-9870-4a96-bbfc-dacbefea287e admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:23.898856 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44f898-9870-4a96-bbfc-dacbefea287e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:23.898856 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44f898-9870-4a96-bbfc-dacbefea287e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:23.989218 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb4f78-b55d-45a5-956a-0d06c66a270b None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:23.989689 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb4f78-b55d-45a5-956a-0d06c66a270b None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:23.989803 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb4f78-b55d-45a5-956a-0d06c66a270b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:24.020817 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-5adb4f78-b55d-45a5-956a-0d06c66a270b None None] MFA Rules not processed for user `0c65f5001a224e0b92e94dc6df9f8f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:24.021940 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1226/2448] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:49:23 2022] POST /identity/v3/projects => generated 387 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:49:24.025364 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-5adb4f78-b55d-45a5-956a-0d06c66a270b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:24.026297 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44f898-9870-4a96-bbfc-dacbefea287e admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:24.092679 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1223/2449] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Nov 2 07:49:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:49:24.097987 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44f898-9870-4a96-bbfc-dacbefea287e admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:24.103821 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22dc3f4-e129-41f5-b626-a2f15bc5e0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:24.104469 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22dc3f4-e129-41f5-b626-a2f15bc5e0e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:24.104741 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22dc3f4-e129-41f5-b626-a2f15bc5e0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:24.105014 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22dc3f4-e129-41f5-b626-a2f15bc5e0e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:24.105647 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22dc3f4-e129-41f5-b626-a2f15bc5e0e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:24.107712 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22dc3f4-e129-41f5-b626-a2f15bc5e0e1 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:24.173590 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1227/2450] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:49:24 2022] POST /identity/v3/users => generated 294 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:49:24.177672 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb4f78-b55d-45a5-956a-0d06c66a270b None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:24.189059 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb4f78-b55d-45a5-956a-0d06c66a270b None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:24.193726 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332fa35-1ec0-4f4e-bdc4-157076a9458b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:24.194359 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332fa35-1ec0-4f4e-bdc4-157076a9458b admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:24.194639 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332fa35-1ec0-4f4e-bdc4-157076a9458b admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:24.194913 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332fa35-1ec0-4f4e-bdc4-157076a9458b admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:24.195546 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332fa35-1ec0-4f4e-bdc4-157076a9458b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:24.197328 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332fa35-1ec0-4f4e-bdc4-157076a9458b admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:24.206484 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22dc3f4-e129-41f5-b626-a2f15bc5e0e1 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:24.208256 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e22dc3f4-e129-41f5-b626-a2f15bc5e0e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:24.208727 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1224/2451] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:49:24.212399 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332fa35-1ec0-4f4e-bdc4-157076a9458b admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:24.223311 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332fa35-1ec0-4f4e-bdc4-157076a9458b admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:24.227994 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485731f-a4c7-471d-8cfa-3b17e3545404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:24.228628 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485731f-a4c7-471d-8cfa-3b17e3545404 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:24.228912 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485731f-a4c7-471d-8cfa-3b17e3545404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:24.229193 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485731f-a4c7-471d-8cfa-3b17e3545404 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:24.230934 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485731f-a4c7-471d-8cfa-3b17e3545404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:24.232541 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485731f-a4c7-471d-8cfa-3b17e3545404 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:24.242692 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1225/2452] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:49:24.247850 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485731f-a4c7-471d-8cfa-3b17e3545404 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:24.257455 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485731f-a4c7-471d-8cfa-3b17e3545404 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:24.262909 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99827231-2ee8-4906-a9cb-ebcefd7078d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:24.263506 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99827231-2ee8-4906-a9cb-ebcefd7078d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:24.263788 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99827231-2ee8-4906-a9cb-ebcefd7078d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:24.264087 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99827231-2ee8-4906-a9cb-ebcefd7078d5 admin admin] PATH_INFO: `/v3/projects/b27663d109de4ff2a63221ae50700949/users/776ccd85609345cd9fdaac285d54b897/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:24.279647 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99827231-2ee8-4906-a9cb-ebcefd7078d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b27663d109de4ff2a63221ae50700949, user_id=776ccd85609345cd9fdaac285d54b897, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:24.282407 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99827231-2ee8-4906-a9cb-ebcefd7078d5 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:24.285493 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22dc3f4-e129-41f5-b626-a2f15bc5e0e1 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:24.290621 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38027153-7405-457c-8d55-5b4ac532fbae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d63a04c2d74c90b95a4f48c49ddb29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:24.291260 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38027153-7405-457c-8d55-5b4ac532fbae service swift] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:24.291540 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38027153-7405-457c-8d55-5b4ac532fbae service swift] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:24.292408 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38027153-7405-457c-8d55-5b4ac532fbae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:24.300749 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38027153-7405-457c-8d55-5b4ac532fbae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:24.302332 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38027153-7405-457c-8d55-5b4ac532fbae service swift] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:24.311395 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1228/2453] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Nov 2 07:49:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:49:24.339464 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1226/2454] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:49:24 2022] PUT /identity/v3/projects/b27663d109de4ff2a63221ae50700949/users/776ccd85609345cd9fdaac285d54b897/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:49:24.407197 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b35ba0-3f99-4e03-83f4-d0f26c78db26 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:24.407482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b35ba0-3f99-4e03-83f4-d0f26c78db26 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:24.407760 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b35ba0-3f99-4e03-83f4-d0f26c78db26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:24.436792 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-12b35ba0-3f99-4e03-83f4-d0f26c78db26 None None] MFA Rules not processed for user `776ccd85609345cd9fdaac285d54b897`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:24.437932 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-12b35ba0-3f99-4e03-83f4-d0f26c78db26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:24.471769 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:24.506084 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1229/2455] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:24.510651 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99827231-2ee8-4906-a9cb-ebcefd7078d5 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:24.573487 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99827231-2ee8-4906-a9cb-ebcefd7078d5 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:24.579560 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288ee21-6d07-4db1-b27b-793f186860e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:24.583576 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288ee21-6d07-4db1-b27b-793f186860e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:24.583576 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288ee21-6d07-4db1-b27b-793f186860e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:24.583576 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288ee21-6d07-4db1-b27b-793f186860e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:24.583576 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288ee21-6d07-4db1-b27b-793f186860e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:24.583576 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288ee21-6d07-4db1-b27b-793f186860e7 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:24.671609 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1227/2456] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:49:24 2022] POST /identity/v3/projects => generated 385 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:49:24.675703 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b35ba0-3f99-4e03-83f4-d0f26c78db26 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:24.687309 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b35ba0-3f99-4e03-83f4-d0f26c78db26 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:24.748373 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce6598-e0da-45c0-9bd3-25578803dd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:24.748842 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce6598-e0da-45c0-9bd3-25578803dd5b admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:24.749120 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce6598-e0da-45c0-9bd3-25578803dd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:24.749393 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce6598-e0da-45c0-9bd3-25578803dd5b admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:24.750035 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce6598-e0da-45c0-9bd3-25578803dd5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:24.751956 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce6598-e0da-45c0-9bd3-25578803dd5b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:24.855280 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1230/2457] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:49:24 2022] POST /identity/v3/users => generated 299 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:49:24.859538 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288ee21-6d07-4db1-b27b-793f186860e7 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:24.871029 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288ee21-6d07-4db1-b27b-793f186860e7 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:24.875999 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba84fc-7d52-45d7-a58b-138e19726e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:24.876643 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba84fc-7d52-45d7-a58b-138e19726e09 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:24.876929 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba84fc-7d52-45d7-a58b-138e19726e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:24.877204 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba84fc-7d52-45d7-a58b-138e19726e09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:24.877875 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba84fc-7d52-45d7-a58b-138e19726e09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:24.879474 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba84fc-7d52-45d7-a58b-138e19726e09 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:24.894596 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1228/2458] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:49:24.898845 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce6598-e0da-45c0-9bd3-25578803dd5b admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:24.910774 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce6598-e0da-45c0-9bd3-25578803dd5b admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:24.915445 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cce96c-0064-4eb6-b725-41ddc63d0590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:24.916135 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cce96c-0064-4eb6-b725-41ddc63d0590 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:24.916421 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cce96c-0064-4eb6-b725-41ddc63d0590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:24.917212 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cce96c-0064-4eb6-b725-41ddc63d0590 admin admin] PATH_INFO: `/v3/projects/1e0b1702cc7546e5a4c77160dc595509/users/a55872644cd54cfea8c76616854b4ec5/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:24.942068 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cce96c-0064-4eb6-b725-41ddc63d0590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e0b1702cc7546e5a4c77160dc595509, user_id=a55872644cd54cfea8c76616854b4ec5, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:24.945004 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cce96c-0064-4eb6-b725-41ddc63d0590 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:25.040573 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1231/2459] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:49:24 2022] PUT /identity/v3/projects/1e0b1702cc7546e5a4c77160dc595509/users/a55872644cd54cfea8c76616854b4ec5/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:25.045825 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba84fc-7d52-45d7-a58b-138e19726e09 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:25.064470 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba84fc-7d52-45d7-a58b-138e19726e09 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:25.082836 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:25.127178 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c483da-9c48-462d-8af9-a36e2984f398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:25.127785 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c483da-9c48-462d-8af9-a36e2984f398 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:25.128092 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c483da-9c48-462d-8af9-a36e2984f398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:25.128491 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c483da-9c48-462d-8af9-a36e2984f398 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:25.129126 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c483da-9c48-462d-8af9-a36e2984f398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:25.130689 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c483da-9c48-462d-8af9-a36e2984f398 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:25.140849 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1229/2460] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:49:25.145953 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cce96c-0064-4eb6-b725-41ddc63d0590 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:25.159553 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cce96c-0064-4eb6-b725-41ddc63d0590 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:25.168662 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee3be5-061d-4af5-8cca-72112a78fdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:25.168662 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee3be5-061d-4af5-8cca-72112a78fdc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:25.168934 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee3be5-061d-4af5-8cca-72112a78fdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:25.169200 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee3be5-061d-4af5-8cca-72112a78fdc9 admin admin] PATH_INFO: `/v3/projects/1e0b1702cc7546e5a4c77160dc595509/users/a55872644cd54cfea8c76616854b4ec5/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:25.171449 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ee3be5-061d-4af5-8cca-72112a78fdc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e0b1702cc7546e5a4c77160dc595509, user_id=a55872644cd54cfea8c76616854b4ec5, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:25.191722 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ee3be5-061d-4af5-8cca-72112a78fdc9 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:25.205513 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1232/2461] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:49:25 2022] PUT /identity/v3/projects/1e0b1702cc7546e5a4c77160dc595509/users/a55872644cd54cfea8c76616854b4ec5/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:25.212529 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb72f69-1138-4b79-a19b-9ebcf11960f7 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:25.216695 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb72f69-1138-4b79-a19b-9ebcf11960f7 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:25.216695 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb72f69-1138-4b79-a19b-9ebcf11960f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:25.216956 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633af1c5-2516-48c0-88f1-ea32197afcfa None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:25.217243 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633af1c5-2516-48c0-88f1-ea32197afcfa None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:25.217517 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633af1c5-2516-48c0-88f1-ea32197afcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:25.234522 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-fcb72f69-1138-4b79-a19b-9ebcf11960f7 None None] MFA Rules not processed for user `0c65f5001a224e0b92e94dc6df9f8f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:25.235750 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-fcb72f69-1138-4b79-a19b-9ebcf11960f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:25.246359 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-633af1c5-2516-48c0-88f1-ea32197afcfa None None] MFA Rules not processed for user `a55872644cd54cfea8c76616854b4ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:25.247604 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-633af1c5-2516-48c0-88f1-ea32197afcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:25.299572 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1230/2462] 10.222.0.16 () {58 vars in 967 bytes} [Wed Nov 2 07:49:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:49:25.312812 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb72f69-1138-4b79-a19b-9ebcf11960f7 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:25.320942 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1233/2463] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:25 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:49:25.333824 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633af1c5-2516-48c0-88f1-ea32197afcfa None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:25.334912 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-633af1c5-2516-48c0-88f1-ea32197afcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:25.349007 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:25.384794 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb72f69-1138-4b79-a19b-9ebcf11960f7 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:25.390631 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4e79a-8122-4a3a-b673-95e445858c09 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d63a04c2d74c90b95a4f48c49ddb29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:25.391363 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4e79a-8122-4a3a-b673-95e445858c09 service swift] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:25.391647 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4e79a-8122-4a3a-b673-95e445858c09 service swift] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:25.391920 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4e79a-8122-4a3a-b673-95e445858c09 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:25.395972 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633af1c5-2516-48c0-88f1-ea32197afcfa None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:25.399999 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04693087-5a73-451e-8ac4-1d4e92f872ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:25.400349 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d4e79a-8122-4a3a-b673-95e445858c09 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:25.400624 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04693087-5a73-451e-8ac4-1d4e92f872ba service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:25.400907 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04693087-5a73-451e-8ac4-1d4e92f872ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:25.401177 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04693087-5a73-451e-8ac4-1d4e92f872ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:25.402095 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d4e79a-8122-4a3a-b673-95e445858c09 service swift] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:25.410377 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1231/2464] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Nov 2 07:49:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 07:49:25.410927 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04693087-5a73-451e-8ac4-1d4e92f872ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:25.417992 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04693087-5a73-451e-8ac4-1d4e92f872ba service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:25.425506 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1234/2465] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:25 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:49:26.098269 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97178504-59de-48a0-9026-c034a212c403 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:26.098798 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97178504-59de-48a0-9026-c034a212c403 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:26.098798 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97178504-59de-48a0-9026-c034a212c403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:26.119521 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-97178504-59de-48a0-9026-c034a212c403 None None] MFA Rules not processed for user `0c65f5001a224e0b92e94dc6df9f8f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:26.121611 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-97178504-59de-48a0-9026-c034a212c403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:26.128898 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1232/2466] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Nov 2 07:49:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:26.143969 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04693087-5a73-451e-8ac4-1d4e92f872ba service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:26.153782 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04693087-5a73-451e-8ac4-1d4e92f872ba service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:26.158754 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8775cc66-f1c4-47ff-a63e-8e2040bf02b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d63a04c2d74c90b95a4f48c49ddb29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:26.159352 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775cc66-f1c4-47ff-a63e-8e2040bf02b6 service swift] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:26.159634 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775cc66-f1c4-47ff-a63e-8e2040bf02b6 service swift] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:26.160199 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775cc66-f1c4-47ff-a63e-8e2040bf02b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:26.169343 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8775cc66-f1c4-47ff-a63e-8e2040bf02b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:26.170933 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8775cc66-f1c4-47ff-a63e-8e2040bf02b6 service swift] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:26.179490 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1235/2467] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Nov 2 07:49:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:49:26.639988 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97178504-59de-48a0-9026-c034a212c403 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:26.686302 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:26.704466 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97178504-59de-48a0-9026-c034a212c403 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:26.710868 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e66bbe-66ea-4b6a-89cf-ab64e79313f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:26.710868 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e66bbe-66ea-4b6a-89cf-ab64e79313f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:26.710868 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e66bbe-66ea-4b6a-89cf-ab64e79313f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:26.710868 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e66bbe-66ea-4b6a-89cf-ab64e79313f8 admin admin] PATH_INFO: `/v3/users/776ccd85609345cd9fdaac285d54b897` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:26.711535 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e66bbe-66ea-4b6a-89cf-ab64e79313f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=776ccd85609345cd9fdaac285d54b897)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:26.713494 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e66bbe-66ea-4b6a-89cf-ab64e79313f8 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:26.739950 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8f004-f4e5-4069-91b4-9a3f72c73d2a None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:26.740262 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8f004-f4e5-4069-91b4-9a3f72c73d2a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:26.740532 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8f004-f4e5-4069-91b4-9a3f72c73d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:26.759665 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-b7f8f004-f4e5-4069-91b4-9a3f72c73d2a None None] MFA Rules not processed for user `0c65f5001a224e0b92e94dc6df9f8f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:26.761042 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b7f8f004-f4e5-4069-91b4-9a3f72c73d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:26.768443 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1236/2468] 10.222.0.16 () {58 vars in 967 bytes} [Wed Nov 2 07:49:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:26.781006 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8f004-f4e5-4069-91b4-9a3f72c73d2a None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:26.794831 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8f004-f4e5-4069-91b4-9a3f72c73d2a None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:26.799931 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5bef1f-85f4-4537-b34d-15430efc69e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d63a04c2d74c90b95a4f48c49ddb29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:26.800572 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bef1f-85f4-4537-b34d-15430efc69e5 service swift] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:26.800842 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bef1f-85f4-4537-b34d-15430efc69e5 service swift] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:26.801110 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bef1f-85f4-4537-b34d-15430efc69e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:26.809670 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5bef1f-85f4-4537-b34d-15430efc69e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:26.811252 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5bef1f-85f4-4537-b34d-15430efc69e5 service swift] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:26.820941 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1237/2469] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Nov 2 07:49:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:49:26.896248 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-32e66bbe-66ea-4b6a-89cf-ab64e79313f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '776ccd85609345cd9fdaac285d54b897'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:26.911011 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-32e66bbe-66ea-4b6a-89cf-ab64e79313f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '776ccd85609345cd9fdaac285d54b897'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:26.920779 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-32e66bbe-66ea-4b6a-89cf-ab64e79313f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '776ccd85609345cd9fdaac285d54b897'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:26.921568 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-32e66bbe-66ea-4b6a-89cf-ab64e79313f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '776ccd85609345cd9fdaac285d54b897'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:26.922366 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-32e66bbe-66ea-4b6a-89cf-ab64e79313f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '776ccd85609345cd9fdaac285d54b897'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:27.027615 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1233/2470] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:49:26 2022] DELETE /identity/v3/users/776ccd85609345cd9fdaac285d54b897 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:27.032665 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055dd39-6160-4894-97f0-0b6c0b88cfe9 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:27.032941 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055dd39-6160-4894-97f0-0b6c0b88cfe9 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:27.033202 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055dd39-6160-4894-97f0-0b6c0b88cfe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:27.054121 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-0055dd39-6160-4894-97f0-0b6c0b88cfe9 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:27.055315 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0055dd39-6160-4894-97f0-0b6c0b88cfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:27.119313 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1238/2471] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:27.129509 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e66bbe-66ea-4b6a-89cf-ab64e79313f8 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:27.130933 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-32e66bbe-66ea-4b6a-89cf-ab64e79313f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:27.210452 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e66bbe-66ea-4b6a-89cf-ab64e79313f8 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:27.214336 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612ed5a-530c-475b-b65b-a860bd9f9152 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:27.215542 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612ed5a-530c-475b-b65b-a860bd9f9152 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:27.215877 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612ed5a-530c-475b-b65b-a860bd9f9152 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:27.216182 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612ed5a-530c-475b-b65b-a860bd9f9152 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:27.226469 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f612ed5a-530c-475b-b65b-a860bd9f9152 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:27.227974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f612ed5a-530c-475b-b65b-a860bd9f9152 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:27.239064 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1234/2472] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:49:27.723243 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055dd39-6160-4894-97f0-0b6c0b88cfe9 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:27.726724 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0055dd39-6160-4894-97f0-0b6c0b88cfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:27.752662 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055dd39-6160-4894-97f0-0b6c0b88cfe9 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:27.758048 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbb04f-073f-4487-8197-4183eb157668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:27.758680 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbb04f-073f-4487-8197-4183eb157668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:27.758955 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbb04f-073f-4487-8197-4183eb157668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:27.759317 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbb04f-073f-4487-8197-4183eb157668 admin admin] PATH_INFO: `/v3/projects/b27663d109de4ff2a63221ae50700949` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:27.760506 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdbb04f-073f-4487-8197-4183eb157668 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b27663d109de4ff2a63221ae50700949)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:27.762495 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdbb04f-073f-4487-8197-4183eb157668 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:27.933673 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bcdbb04f-073f-4487-8197-4183eb157668 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b27663d109de4ff2a63221ae50700949', 'request_id': 'req-bcdbb04f-073f-4487-8197-4183eb157668'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:27.939730 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bcdbb04f-073f-4487-8197-4183eb157668 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b27663d109de4ff2a63221ae50700949', 'request_id': 'req-bcdbb04f-073f-4487-8197-4183eb157668'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:27.947410 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bcdbb04f-073f-4487-8197-4183eb157668 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b27663d109de4ff2a63221ae50700949', 'request_id': 'req-bcdbb04f-073f-4487-8197-4183eb157668'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:28.010663 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612ed5a-530c-475b-b65b-a860bd9f9152 service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:28.012662 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f612ed5a-530c-475b-b65b-a860bd9f9152 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:28.024304 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bcdbb04f-073f-4487-8197-4183eb157668 admin admin] The token cache is being invalidate because project b27663d109de4ff2a63221ae50700949 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:49:28.025268 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bcdbb04f-073f-4487-8197-4183eb157668 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:28.025268 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bcdbb04f-073f-4487-8197-4183eb157668 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:28.026169 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612ed5a-530c-475b-b65b-a860bd9f9152 service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:28.026795 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1239/2473] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:49:27 2022] DELETE /identity/v3/projects/b27663d109de4ff2a63221ae50700949 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:28.031298 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbb04f-073f-4487-8197-4183eb157668 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:28.032599 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-bcdbb04f-073f-4487-8197-4183eb157668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:28.039947 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:28.074906 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:28.091487 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a4795-af4d-450b-873d-cc5f19cedefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:28.092274 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a4795-af4d-450b-873d-cc5f19cedefd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:28.092649 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a4795-af4d-450b-873d-cc5f19cedefd admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:28.092985 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a4795-af4d-450b-873d-cc5f19cedefd admin admin] PATH_INFO: `/v3/users/e02af6294f7f4a63a9235b68b78b0188` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:28.094270 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3a4795-af4d-450b-873d-cc5f19cedefd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e02af6294f7f4a63a9235b68b78b0188)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:28.096452 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3a4795-af4d-450b-873d-cc5f19cedefd admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:28.106272 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbb04f-073f-4487-8197-4183eb157668 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:28.112026 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b06755d-55e3-450d-ad42-8a49a8ab5a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:28.112696 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06755d-55e3-450d-ad42-8a49a8ab5a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:28.112996 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06755d-55e3-450d-ad42-8a49a8ab5a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:28.113274 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06755d-55e3-450d-ad42-8a49a8ab5a1d admin admin] PATH_INFO: `/v3/users/a55872644cd54cfea8c76616854b4ec5` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:28.114535 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b06755d-55e3-450d-ad42-8a49a8ab5a1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a55872644cd54cfea8c76616854b4ec5)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:28.116512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b06755d-55e3-450d-ad42-8a49a8ab5a1d admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:28.305281 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-ca3a4795-af4d-450b-873d-cc5f19cedefd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e02af6294f7f4a63a9235b68b78b0188'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:28.315656 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3b06755d-55e3-450d-ad42-8a49a8ab5a1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a55872644cd54cfea8c76616854b4ec5'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:28.319549 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-ca3a4795-af4d-450b-873d-cc5f19cedefd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e02af6294f7f4a63a9235b68b78b0188'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:28.330045 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-ca3a4795-af4d-450b-873d-cc5f19cedefd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e02af6294f7f4a63a9235b68b78b0188'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:28.330356 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3b06755d-55e3-450d-ad42-8a49a8ab5a1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a55872644cd54cfea8c76616854b4ec5'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:28.330933 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-ca3a4795-af4d-450b-873d-cc5f19cedefd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e02af6294f7f4a63a9235b68b78b0188'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:28.331059 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3b06755d-55e3-450d-ad42-8a49a8ab5a1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a55872644cd54cfea8c76616854b4ec5'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:28.331585 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-ca3a4795-af4d-450b-873d-cc5f19cedefd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e02af6294f7f4a63a9235b68b78b0188'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:28.338871 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3b06755d-55e3-450d-ad42-8a49a8ab5a1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a55872644cd54cfea8c76616854b4ec5'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:28.339566 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3b06755d-55e3-450d-ad42-8a49a8ab5a1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a55872644cd54cfea8c76616854b4ec5'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:28.412609 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1235/2474] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:49:28 2022] DELETE /identity/v3/users/e02af6294f7f4a63a9235b68b78b0188 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:49:28.416947 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65a6f2-e661-49b0-8f11-336f06e3c09e None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:28.417229 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65a6f2-e661-49b0-8f11-336f06e3c09e None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:28.417503 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65a6f2-e661-49b0-8f11-336f06e3c09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:28.437565 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-dc65a6f2-e661-49b0-8f11-336f06e3c09e None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:28.438714 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-dc65a6f2-e661-49b0-8f11-336f06e3c09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:28.489790 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1240/2475] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:49:28 2022] DELETE /identity/v3/users/a55872644cd54cfea8c76616854b4ec5 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:49:28.499476 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1236/2476] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:49:28.513972 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b06755d-55e3-450d-ad42-8a49a8ab5a1d admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:28.513972 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3b06755d-55e3-450d-ad42-8a49a8ab5a1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:28.570766 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b06755d-55e3-450d-ad42-8a49a8ab5a1d admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:28.574689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa85115e-02ea-4534-ae76-e3910f4dbe75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:28.575309 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85115e-02ea-4534-ae76-e3910f4dbe75 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:28.575590 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85115e-02ea-4534-ae76-e3910f4dbe75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:28.575863 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85115e-02ea-4534-ae76-e3910f4dbe75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:28.617668 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:28.640073 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa85115e-02ea-4534-ae76-e3910f4dbe75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:28.641559 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa85115e-02ea-4534-ae76-e3910f4dbe75 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:28.656213 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1241/2477] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:49:28.974449 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc65a6f2-e661-49b0-8f11-336f06e3c09e None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:28.976515 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-dc65a6f2-e661-49b0-8f11-336f06e3c09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:28.992547 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc65a6f2-e661-49b0-8f11-336f06e3c09e None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:29.000394 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b51c3-d5fb-42e2-a3c8-49a39525c78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:29.001040 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b51c3-d5fb-42e2-a3c8-49a39525c78e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:29.003948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b51c3-d5fb-42e2-a3c8-49a39525c78e admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:29.003948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b51c3-d5fb-42e2-a3c8-49a39525c78e admin admin] PATH_INFO: `/v3/projects/1e0b1702cc7546e5a4c77160dc595509` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:29.003948 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b51c3-d5fb-42e2-a3c8-49a39525c78e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e0b1702cc7546e5a4c77160dc595509)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:29.006244 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b51c3-d5fb-42e2-a3c8-49a39525c78e admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:29.096271 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa85115e-02ea-4534-ae76-e3910f4dbe75 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:29.097774 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-fa85115e-02ea-4534-ae76-e3910f4dbe75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:29.112216 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa85115e-02ea-4534-ae76-e3910f4dbe75 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:29.117141 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f07196-64e1-4932-a109-bb4176a85d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:29.117844 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f07196-64e1-4932-a109-bb4176a85d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:29.118200 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f07196-64e1-4932-a109-bb4176a85d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:29.118554 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f07196-64e1-4932-a109-bb4176a85d29 admin admin] PATH_INFO: `/v3/projects/555ecd9bcaf2481e9641f1e876e4f329` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:29.119837 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f07196-64e1-4932-a109-bb4176a85d29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=555ecd9bcaf2481e9641f1e876e4f329)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:29.124732 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f07196-64e1-4932-a109-bb4176a85d29 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:29.206837 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-bb0b51c3-d5fb-42e2-a3c8-49a39525c78e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e0b1702cc7546e5a4c77160dc595509', 'request_id': 'req-bb0b51c3-d5fb-42e2-a3c8-49a39525c78e'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:29.213031 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-bb0b51c3-d5fb-42e2-a3c8-49a39525c78e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e0b1702cc7546e5a4c77160dc595509', 'request_id': 'req-bb0b51c3-d5fb-42e2-a3c8-49a39525c78e'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:29.217698 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:29.219810 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-bb0b51c3-d5fb-42e2-a3c8-49a39525c78e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e0b1702cc7546e5a4c77160dc595509', 'request_id': 'req-bb0b51c3-d5fb-42e2-a3c8-49a39525c78e'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:29.296780 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d4f07196-64e1-4932-a109-bb4176a85d29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '555ecd9bcaf2481e9641f1e876e4f329', 'request_id': 'req-d4f07196-64e1-4932-a109-bb4176a85d29'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:29.302812 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d4f07196-64e1-4932-a109-bb4176a85d29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '555ecd9bcaf2481e9641f1e876e4f329', 'request_id': 'req-d4f07196-64e1-4932-a109-bb4176a85d29'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:29.310030 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d4f07196-64e1-4932-a109-bb4176a85d29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '555ecd9bcaf2481e9641f1e876e4f329', 'request_id': 'req-d4f07196-64e1-4932-a109-bb4176a85d29'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:29.332401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-bb0b51c3-d5fb-42e2-a3c8-49a39525c78e admin admin] The token cache is being invalidate because project 1e0b1702cc7546e5a4c77160dc595509 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:49:29.332926 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-bb0b51c3-d5fb-42e2-a3c8-49a39525c78e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:29.333334 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-bb0b51c3-d5fb-42e2-a3c8-49a39525c78e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:29.334812 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1237/2478] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:49:28 2022] DELETE /identity/v3/projects/1e0b1702cc7546e5a4c77160dc595509 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:29.340252 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e742b1-a32e-4544-b834-e00ced8a2a1d None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:29.340534 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e742b1-a32e-4544-b834-e00ced8a2a1d None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:29.340806 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e742b1-a32e-4544-b834-e00ced8a2a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:29.360559 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-d6e742b1-a32e-4544-b834-e00ced8a2a1d None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:29.361794 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-d6e742b1-a32e-4544-b834-e00ced8a2a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:29.407881 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d4f07196-64e1-4932-a109-bb4176a85d29 admin admin] The token cache is being invalidate because project 555ecd9bcaf2481e9641f1e876e4f329 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:49:29.408295 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d4f07196-64e1-4932-a109-bb4176a85d29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:29.409018 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d4f07196-64e1-4932-a109-bb4176a85d29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:29.410826 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1242/2479] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:49:29 2022] DELETE /identity/v3/projects/555ecd9bcaf2481e9641f1e876e4f329 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:49:29.414784 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f07196-64e1-4932-a109-bb4176a85d29 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:29.416311 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d4f07196-64e1-4932-a109-bb4176a85d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:29.425267 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1238/2480] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:29.432764 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaff2a5-212a-4576-8b51-3d3e5c2d145f None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:29.433051 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaff2a5-212a-4576-8b51-3d3e5c2d145f None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:29.433349 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaff2a5-212a-4576-8b51-3d3e5c2d145f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:29.454973 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-fcaff2a5-212a-4576-8b51-3d3e5c2d145f None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:29.457255 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-fcaff2a5-212a-4576-8b51-3d3e5c2d145f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:29.465468 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1239/2481] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:49:29.469823 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaff2a5-212a-4576-8b51-3d3e5c2d145f None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:29.478688 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaff2a5-212a-4576-8b51-3d3e5c2d145f None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:29.486580 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457014a6-990f-4f9e-a3e0-62010b61faf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:29.486580 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457014a6-990f-4f9e-a3e0-62010b61faf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:29.486821 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f07196-64e1-4932-a109-bb4176a85d29 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:29.486924 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457014a6-990f-4f9e-a3e0-62010b61faf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:29.486924 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457014a6-990f-4f9e-a3e0-62010b61faf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:29.486924 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457014a6-990f-4f9e-a3e0-62010b61faf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:49:29.486924 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457014a6-990f-4f9e-a3e0-62010b61faf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:29.487752 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457014a6-990f-4f9e-a3e0-62010b61faf0 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:29.489877 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbdc6e6-6ee4-4b29-923d-3aa151a0b467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:29.490578 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdc6e6-6ee4-4b29-923d-3aa151a0b467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:29.490865 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdc6e6-6ee4-4b29-923d-3aa151a0b467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:29.491142 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdc6e6-6ee4-4b29-923d-3aa151a0b467 admin admin] PATH_INFO: `/v3/users/dde7c36c3dcb4c1eaf1c9a2dc6248d3b` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:29.492304 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbdc6e6-6ee4-4b29-923d-3aa151a0b467 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dde7c36c3dcb4c1eaf1c9a2dc6248d3b)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:29.494221 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbdc6e6-6ee4-4b29-923d-3aa151a0b467 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:29.503643 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1240/2482] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:49:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:49:29.509098 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457014a6-990f-4f9e-a3e0-62010b61faf0 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:29.520834 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457014a6-990f-4f9e-a3e0-62010b61faf0 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:29.525560 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1c0c4-9854-4fc7-b1b9-0f067c12a16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:29.526157 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1c0c4-9854-4fc7-b1b9-0f067c12a16d admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:29.526440 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1c0c4-9854-4fc7-b1b9-0f067c12a16d admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:29.526713 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1c0c4-9854-4fc7-b1b9-0f067c12a16d admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:29.527892 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1c0c4-9854-4fc7-b1b9-0f067c12a16d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:29.530369 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1c0c4-9854-4fc7-b1b9-0f067c12a16d admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:29.700097 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1241/2483] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:49:29 2022] POST /identity/v3/projects => generated 377 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:49:29.702916 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1c0c4-9854-4fc7-b1b9-0f067c12a16d admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:29.703179 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-2cd1c0c4-9854-4fc7-b1b9-0f067c12a16d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:29.765844 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1c0c4-9854-4fc7-b1b9-0f067c12a16d admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:29.770470 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35aacce-dec7-42a9-b108-d443d7cf7c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:29.771090 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35aacce-dec7-42a9-b108-d443d7cf7c23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:29.771372 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35aacce-dec7-42a9-b108-d443d7cf7c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:29.771649 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35aacce-dec7-42a9-b108-d443d7cf7c23 admin admin] PATH_INFO: `/v3/users/f70e5cb58c64432c87c7828de1096394` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:29.772857 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35aacce-dec7-42a9-b108-d443d7cf7c23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f70e5cb58c64432c87c7828de1096394)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:29.774779 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35aacce-dec7-42a9-b108-d443d7cf7c23 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:29.815095 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ebbdc6e6-6ee4-4b29-923d-3aa151a0b467 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dde7c36c3dcb4c1eaf1c9a2dc6248d3b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:29.823024 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:29.827459 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ebbdc6e6-6ee4-4b29-923d-3aa151a0b467 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dde7c36c3dcb4c1eaf1c9a2dc6248d3b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:29.828204 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ebbdc6e6-6ee4-4b29-923d-3aa151a0b467 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dde7c36c3dcb4c1eaf1c9a2dc6248d3b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:29.835080 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ebbdc6e6-6ee4-4b29-923d-3aa151a0b467 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dde7c36c3dcb4c1eaf1c9a2dc6248d3b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:29.838909 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ebbdc6e6-6ee4-4b29-923d-3aa151a0b467 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dde7c36c3dcb4c1eaf1c9a2dc6248d3b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:29.990085 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1243/2484] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:49:29 2022] DELETE /identity/v3/users/dde7c36c3dcb4c1eaf1c9a2dc6248d3b => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:49:29.993151 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbdc6e6-6ee4-4b29-923d-3aa151a0b467 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:29.993151 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ebbdc6e6-6ee4-4b29-923d-3aa151a0b467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:30.025816 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d35aacce-dec7-42a9-b108-d443d7cf7c23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f70e5cb58c64432c87c7828de1096394'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:30.026849 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:30.041049 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d35aacce-dec7-42a9-b108-d443d7cf7c23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f70e5cb58c64432c87c7828de1096394'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:30.049021 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d35aacce-dec7-42a9-b108-d443d7cf7c23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f70e5cb58c64432c87c7828de1096394'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:30.049966 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d35aacce-dec7-42a9-b108-d443d7cf7c23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f70e5cb58c64432c87c7828de1096394'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:30.050698 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d35aacce-dec7-42a9-b108-d443d7cf7c23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f70e5cb58c64432c87c7828de1096394'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:30.063923 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbdc6e6-6ee4-4b29-923d-3aa151a0b467 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:30.068640 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68a788-c2a6-4238-a7f4-880eb4b9d2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:30.069250 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68a788-c2a6-4238-a7f4-880eb4b9d2d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:30.069526 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68a788-c2a6-4238-a7f4-880eb4b9d2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:30.069797 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68a788-c2a6-4238-a7f4-880eb4b9d2d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:30.070431 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68a788-c2a6-4238-a7f4-880eb4b9d2d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:30.072387 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68a788-c2a6-4238-a7f4-880eb4b9d2d1 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:30.128168 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1242/2485] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:49:29 2022] DELETE /identity/v3/users/f70e5cb58c64432c87c7828de1096394 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:30.132525 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90417f-d953-45f5-99dd-451e0f998948 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:30.132810 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90417f-d953-45f5-99dd-451e0f998948 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:30.133082 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90417f-d953-45f5-99dd-451e0f998948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:30.151380 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-8d90417f-d953-45f5-99dd-451e0f998948 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:30.152599 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-8d90417f-d953-45f5-99dd-451e0f998948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:30.179078 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1244/2486] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:49:29 2022] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:49:30.187629 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68a788-c2a6-4238-a7f4-880eb4b9d2d1 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:30.189405 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8d68a788-c2a6-4238-a7f4-880eb4b9d2d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:30.203682 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68a788-c2a6-4238-a7f4-880eb4b9d2d1 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:30.220027 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1243/2487] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:49:30.230431 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d90417f-d953-45f5-99dd-451e0f998948 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:30.233221 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-8d90417f-d953-45f5-99dd-451e0f998948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:30.282837 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae09fe-4925-4338-99c9-8d83e105d989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:30.283454 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae09fe-4925-4338-99c9-8d83e105d989 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:30.283727 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae09fe-4925-4338-99c9-8d83e105d989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:30.284000 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae09fe-4925-4338-99c9-8d83e105d989 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:30.284665 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae09fe-4925-4338-99c9-8d83e105d989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:30.286916 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae09fe-4925-4338-99c9-8d83e105d989 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:30.298176 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1245/2488] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:49:30.302413 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae09fe-4925-4338-99c9-8d83e105d989 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:30.304294 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d90417f-d953-45f5-99dd-451e0f998948 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:30.308499 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722421a8-114f-49b0-bdb2-eb86b64243f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:30.309147 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722421a8-114f-49b0-bdb2-eb86b64243f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:30.309423 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722421a8-114f-49b0-bdb2-eb86b64243f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:30.309694 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722421a8-114f-49b0-bdb2-eb86b64243f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:30.313879 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae09fe-4925-4338-99c9-8d83e105d989 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:30.320665 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3dfd0-ab21-4ef8-b6e8-5ffd8148aea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:30.321276 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3dfd0-ab21-4ef8-b6e8-5ffd8148aea9 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:30.326374 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3dfd0-ab21-4ef8-b6e8-5ffd8148aea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:30.326613 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722421a8-114f-49b0-bdb2-eb86b64243f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:30.326724 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3dfd0-ab21-4ef8-b6e8-5ffd8148aea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:30.326724 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3dfd0-ab21-4ef8-b6e8-5ffd8148aea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:30.326890 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722421a8-114f-49b0-bdb2-eb86b64243f1 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:30.326981 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3dfd0-ab21-4ef8-b6e8-5ffd8148aea9 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:30.338536 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1246/2489] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:49:30.338753 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1244/2490] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:49:30.339570 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3dfd0-ab21-4ef8-b6e8-5ffd8148aea9 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:30.350714 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3dfd0-ab21-4ef8-b6e8-5ffd8148aea9 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:30.355586 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d35919-aed8-42e7-a9f5-8dcb403e93d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:30.356295 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d35919-aed8-42e7-a9f5-8dcb403e93d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:30.356577 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d35919-aed8-42e7-a9f5-8dcb403e93d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:30.356888 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d35919-aed8-42e7-a9f5-8dcb403e93d1 admin admin] PATH_INFO: `/v3/projects/9d43d94bd0f041e6926605e43010e112/users/4973d402ca1944409639476f1ced778a/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:30.375946 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d35919-aed8-42e7-a9f5-8dcb403e93d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d43d94bd0f041e6926605e43010e112, user_id=4973d402ca1944409639476f1ced778a, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:30.383272 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d35919-aed8-42e7-a9f5-8dcb403e93d1 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:30.462796 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722421a8-114f-49b0-bdb2-eb86b64243f1 service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:30.464282 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-722421a8-114f-49b0-bdb2-eb86b64243f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:30.478630 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722421a8-114f-49b0-bdb2-eb86b64243f1 service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:30.488901 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985abd6-709f-49b6-bf4c-20692dfd8632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:30.489834 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985abd6-709f-49b6-bf4c-20692dfd8632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:30.490324 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985abd6-709f-49b6-bf4c-20692dfd8632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:30.490724 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985abd6-709f-49b6-bf4c-20692dfd8632 admin admin] PATH_INFO: `/v3/projects/90bd1670d21448a8b2a0a9c50cbf7eb7` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:30.492598 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4985abd6-709f-49b6-bf4c-20692dfd8632 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90bd1670d21448a8b2a0a9c50cbf7eb7)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:30.495065 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4985abd6-709f-49b6-bf4c-20692dfd8632 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:30.502361 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1247/2491] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:49:30 2022] PUT /identity/v3/projects/9d43d94bd0f041e6926605e43010e112/users/4973d402ca1944409639476f1ced778a/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:49:30.515607 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5222f4a-cd5b-451c-a283-99931857aae3 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:30.515954 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5222f4a-cd5b-451c-a283-99931857aae3 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:30.518032 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5222f4a-cd5b-451c-a283-99931857aae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:30.546747 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-e5222f4a-cd5b-451c-a283-99931857aae3 None None] MFA Rules not processed for user `4973d402ca1944409639476f1ced778a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:30.547930 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e5222f4a-cd5b-451c-a283-99931857aae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:30.561134 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:30.614664 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1248/2492] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:49:30.615610 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5222f4a-cd5b-451c-a283-99931857aae3 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:30.619987 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e5222f4a-cd5b-451c-a283-99931857aae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:30.652206 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4985abd6-709f-49b6-bf4c-20692dfd8632 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90bd1670d21448a8b2a0a9c50cbf7eb7', 'request_id': 'req-4985abd6-709f-49b6-bf4c-20692dfd8632'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:30.659073 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4985abd6-709f-49b6-bf4c-20692dfd8632 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90bd1670d21448a8b2a0a9c50cbf7eb7', 'request_id': 'req-4985abd6-709f-49b6-bf4c-20692dfd8632'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:30.665151 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4985abd6-709f-49b6-bf4c-20692dfd8632 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90bd1670d21448a8b2a0a9c50cbf7eb7', 'request_id': 'req-4985abd6-709f-49b6-bf4c-20692dfd8632'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:30.667308 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:30.689149 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5222f4a-cd5b-451c-a283-99931857aae3 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:30.733068 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4985abd6-709f-49b6-bf4c-20692dfd8632 admin admin] The token cache is being invalidate because project 90bd1670d21448a8b2a0a9c50cbf7eb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:49:30.733483 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4985abd6-709f-49b6-bf4c-20692dfd8632 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:30.734134 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4985abd6-709f-49b6-bf4c-20692dfd8632 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:30.735628 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1245/2493] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:49:30 2022] DELETE /identity/v3/projects/90bd1670d21448a8b2a0a9c50cbf7eb7 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:49:30.736663 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985abd6-709f-49b6-bf4c-20692dfd8632 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:30.738148 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-4985abd6-709f-49b6-bf4c-20692dfd8632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:30.749967 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36816708-a3df-4acd-9c12-90b346a6c1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:30.750849 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36816708-a3df-4acd-9c12-90b346a6c1c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:30.751047 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36816708-a3df-4acd-9c12-90b346a6c1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:30.751330 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36816708-a3df-4acd-9c12-90b346a6c1c9 admin admin] PATH_INFO: `/v3/projects/f0c75eae652241458ed9bb0850b5d128` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:30.752500 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36816708-a3df-4acd-9c12-90b346a6c1c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0c75eae652241458ed9bb0850b5d128)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:30.754452 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36816708-a3df-4acd-9c12-90b346a6c1c9 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:30.822330 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985abd6-709f-49b6-bf4c-20692dfd8632 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:30.830382 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-36816708-a3df-4acd-9c12-90b346a6c1c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0c75eae652241458ed9bb0850b5d128', 'request_id': 'req-36816708-a3df-4acd-9c12-90b346a6c1c9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:30.835793 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-36816708-a3df-4acd-9c12-90b346a6c1c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0c75eae652241458ed9bb0850b5d128', 'request_id': 'req-36816708-a3df-4acd-9c12-90b346a6c1c9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:30.842493 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-36816708-a3df-4acd-9c12-90b346a6c1c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0c75eae652241458ed9bb0850b5d128', 'request_id': 'req-36816708-a3df-4acd-9c12-90b346a6c1c9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:30.870240 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f77265-ced5-490c-b666-e6597ae2ae92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:30.870846 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f77265-ced5-490c-b666-e6597ae2ae92 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:30.871123 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f77265-ced5-490c-b666-e6597ae2ae92 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:30.871398 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f77265-ced5-490c-b666-e6597ae2ae92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:30.874032 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-19f77265-ced5-490c-b666-e6597ae2ae92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:30.897896 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-36816708-a3df-4acd-9c12-90b346a6c1c9 admin admin] The token cache is being invalidate because project f0c75eae652241458ed9bb0850b5d128 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:49:30.898370 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-36816708-a3df-4acd-9c12-90b346a6c1c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:30.899057 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-36816708-a3df-4acd-9c12-90b346a6c1c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:30.900853 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1249/2494] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:49:30 2022] DELETE /identity/v3/projects/f0c75eae652241458ed9bb0850b5d128 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:30.901803 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2d87d-650a-4f37-ae52-c106341fc76e None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:30.902086 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2d87d-650a-4f37-ae52-c106341fc76e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:30.905183 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2d87d-650a-4f37-ae52-c106341fc76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:30.924451 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-0da2d87d-650a-4f37-ae52-c106341fc76e None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:30.925743 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0da2d87d-650a-4f37-ae52-c106341fc76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:30.936111 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f77265-ced5-490c-b666-e6597ae2ae92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:30.937544 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f77265-ced5-490c-b666-e6597ae2ae92 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:30.946639 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1246/2495] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:49:30.947869 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa94696-8afa-49fc-8e9b-dc7bcce9468b None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:30.948204 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa94696-8afa-49fc-8e9b-dc7bcce9468b None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:30.948480 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa94696-8afa-49fc-8e9b-dc7bcce9468b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:30.971833 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-4fa94696-8afa-49fc-8e9b-dc7bcce9468b None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:30.972795 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-4fa94696-8afa-49fc-8e9b-dc7bcce9468b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:30.991103 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1250/2496] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:30.998868 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3fd45-4d00-4460-9e40-832e0772b3b2 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:31.000339 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3fd45-4d00-4460-9e40-832e0772b3b2 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:31.000339 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3fd45-4d00-4460-9e40-832e0772b3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:31.020014 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-d3e3fd45-4d00-4460-9e40-832e0772b3b2 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:31.021497 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d3e3fd45-4d00-4460-9e40-832e0772b3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:31.025157 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:31.032001 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1251/2497] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:49:31.036597 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3fd45-4d00-4460-9e40-832e0772b3b2 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:31.041393 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1247/2498] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:31.047412 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3fd45-4d00-4460-9e40-832e0772b3b2 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:31.050591 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d8eb3-e0b7-4db3-9736-8897c5903304 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:31.051627 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d8eb3-e0b7-4db3-9736-8897c5903304 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:31.052427 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d8eb3-e0b7-4db3-9736-8897c5903304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:31.052578 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10661597-3805-4e25-bde1-1df4e7aa24cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:31.053148 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10661597-3805-4e25-bde1-1df4e7aa24cf admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:31.053451 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10661597-3805-4e25-bde1-1df4e7aa24cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:31.053724 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10661597-3805-4e25-bde1-1df4e7aa24cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:31.054363 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10661597-3805-4e25-bde1-1df4e7aa24cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:49:31.054660 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10661597-3805-4e25-bde1-1df4e7aa24cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:31.056262 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10661597-3805-4e25-bde1-1df4e7aa24cf admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:31.056987 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:31.069103 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1252/2499] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:49:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:49:31.073188 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10661597-3805-4e25-bde1-1df4e7aa24cf admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:31.079396 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-220d8eb3-e0b7-4db3-9736-8897c5903304 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:31.080295 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-220d8eb3-e0b7-4db3-9736-8897c5903304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:31.086028 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10661597-3805-4e25-bde1-1df4e7aa24cf admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:31.090181 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1248/2500] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:31.094233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5037093-07b5-4e37-8a1f-1d12b1a64e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:31.094233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5037093-07b5-4e37-8a1f-1d12b1a64e1c admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:31.094233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5037093-07b5-4e37-8a1f-1d12b1a64e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:31.094233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5037093-07b5-4e37-8a1f-1d12b1a64e1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:31.094584 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5037093-07b5-4e37-8a1f-1d12b1a64e1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:31.096266 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5037093-07b5-4e37-8a1f-1d12b1a64e1c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:31.097182 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d8eb3-e0b7-4db3-9736-8897c5903304 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:31.108135 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d8eb3-e0b7-4db3-9736-8897c5903304 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:31.113684 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d908c-3a89-47ef-9a2a-1d11a1de23c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:31.120850 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d908c-3a89-47ef-9a2a-1d11a1de23c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:31.120850 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d908c-3a89-47ef-9a2a-1d11a1de23c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:31.120850 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d908c-3a89-47ef-9a2a-1d11a1de23c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:31.120850 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d908c-3a89-47ef-9a2a-1d11a1de23c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:49:31.120850 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d908c-3a89-47ef-9a2a-1d11a1de23c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:31.120850 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d908c-3a89-47ef-9a2a-1d11a1de23c1 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:31.131222 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1249/2501] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:49:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:49:31.135484 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d908c-3a89-47ef-9a2a-1d11a1de23c1 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:31.145807 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d908c-3a89-47ef-9a2a-1d11a1de23c1 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:31.150435 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fb20d-a449-4da8-9928-e21f4ea0c48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:31.151031 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fb20d-a449-4da8-9928-e21f4ea0c48f admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:31.151309 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fb20d-a449-4da8-9928-e21f4ea0c48f admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:31.151580 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fb20d-a449-4da8-9928-e21f4ea0c48f admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:31.152363 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781fb20d-a449-4da8-9928-e21f4ea0c48f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:31.154248 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781fb20d-a449-4da8-9928-e21f4ea0c48f admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:31.255436 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1253/2502] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:49:31 2022] POST /identity/v3/projects => generated 401 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:49:31.259665 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5037093-07b5-4e37-8a1f-1d12b1a64e1c admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:31.282023 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1250/2503] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:49:31 2022] POST /identity/v3/projects => generated 369 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:49:31.288016 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fb20d-a449-4da8-9928-e21f4ea0c48f admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:31.329784 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5037093-07b5-4e37-8a1f-1d12b1a64e1c admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:31.351529 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fb20d-a449-4da8-9928-e21f4ea0c48f admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:31.356936 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc2856-5776-461b-b455-8e47d3ab7939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:31.359691 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc2856-5776-461b-b455-8e47d3ab7939 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:31.359691 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc2856-5776-461b-b455-8e47d3ab7939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:31.359691 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc2856-5776-461b-b455-8e47d3ab7939 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:31.359691 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc2856-5776-461b-b455-8e47d3ab7939 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:31.360896 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc2856-5776-461b-b455-8e47d3ab7939 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:31.386058 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c5b323-0d9d-46b3-b1a1-75970b24a439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:31.386667 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5b323-0d9d-46b3-b1a1-75970b24a439 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:31.386950 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5b323-0d9d-46b3-b1a1-75970b24a439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:31.387224 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5b323-0d9d-46b3-b1a1-75970b24a439 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:31.387936 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c5b323-0d9d-46b3-b1a1-75970b24a439 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:31.390699 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c5b323-0d9d-46b3-b1a1-75970b24a439 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:31.424710 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:31.430357 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1251/2504] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:49:31 2022] POST /identity/v3/users => generated 285 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:49:31.434368 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc2856-5776-461b-b455-8e47d3ab7939 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:31.444817 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc2856-5776-461b-b455-8e47d3ab7939 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:31.449473 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975103e-133d-4260-978e-578f6c94aba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:31.450044 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975103e-133d-4260-978e-578f6c94aba3 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:31.450355 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975103e-133d-4260-978e-578f6c94aba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:31.451474 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975103e-133d-4260-978e-578f6c94aba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:31.452132 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8975103e-133d-4260-978e-578f6c94aba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:31.453686 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8975103e-133d-4260-978e-578f6c94aba3 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:31.464006 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1252/2505] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:49:31.468901 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975103e-133d-4260-978e-578f6c94aba3 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:31.478364 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975103e-133d-4260-978e-578f6c94aba3 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:31.483691 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4a308-7738-4628-888d-20b710215b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:31.484334 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4a308-7738-4628-888d-20b710215b63 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:31.484609 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4a308-7738-4628-888d-20b710215b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:31.484878 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4a308-7738-4628-888d-20b710215b63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:31.485481 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4a308-7738-4628-888d-20b710215b63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:31.487021 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4a308-7738-4628-888d-20b710215b63 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:31.498720 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1253/2506] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:49:31.502848 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4a308-7738-4628-888d-20b710215b63 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:31.512543 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1254/2507] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:49:31 2022] POST /identity/v3/users => generated 301 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:49:31.512755 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4a308-7738-4628-888d-20b710215b63 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:31.513644 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c5b323-0d9d-46b3-b1a1-75970b24a439 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:31.519098 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00407f5b-a54b-4119-ba80-cd39310308f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:31.519865 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00407f5b-a54b-4119-ba80-cd39310308f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:31.521342 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00407f5b-a54b-4119-ba80-cd39310308f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:31.521628 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00407f5b-a54b-4119-ba80-cd39310308f5 admin admin] PATH_INFO: `/v3/projects/c0dc8c51819f41f2b84b7ee652537db7/users/040337d14e044fc6afe740fe1293418f/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:31.524747 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c5b323-0d9d-46b3-b1a1-75970b24a439 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:31.529954 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14a44b-5026-487a-953b-4727c5f2e2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:31.530159 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14a44b-5026-487a-953b-4727c5f2e2de admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:31.530742 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14a44b-5026-487a-953b-4727c5f2e2de admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:31.530742 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14a44b-5026-487a-953b-4727c5f2e2de admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:31.531369 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f14a44b-5026-487a-953b-4727c5f2e2de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:31.533000 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f14a44b-5026-487a-953b-4727c5f2e2de admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:31.537581 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00407f5b-a54b-4119-ba80-cd39310308f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0dc8c51819f41f2b84b7ee652537db7, user_id=040337d14e044fc6afe740fe1293418f, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:31.540341 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00407f5b-a54b-4119-ba80-cd39310308f5 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:31.543847 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1255/2508] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:49:31.548181 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14a44b-5026-487a-953b-4727c5f2e2de admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:31.558160 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14a44b-5026-487a-953b-4727c5f2e2de admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:31.563678 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8a7bf-37a1-45e4-ba5d-f3c905adcf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:31.564311 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8a7bf-37a1-45e4-ba5d-f3c905adcf1c admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:31.564590 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8a7bf-37a1-45e4-ba5d-f3c905adcf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:31.564858 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8a7bf-37a1-45e4-ba5d-f3c905adcf1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:31.565482 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc8a7bf-37a1-45e4-ba5d-f3c905adcf1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:31.567056 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc8a7bf-37a1-45e4-ba5d-f3c905adcf1c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:31.578736 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1256/2509] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:49:31.583198 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8a7bf-37a1-45e4-ba5d-f3c905adcf1c admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:31.592361 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8a7bf-37a1-45e4-ba5d-f3c905adcf1c admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:31.597250 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0269d2-55e9-46f6-997b-f4aef4986e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:31.597869 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0269d2-55e9-46f6-997b-f4aef4986e1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:31.598145 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0269d2-55e9-46f6-997b-f4aef4986e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:31.598414 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0269d2-55e9-46f6-997b-f4aef4986e1e admin admin] PATH_INFO: `/v3/projects/6196ea04653b4bf983c61fb05fab6e02/users/ce5f14b81e134cf891cf867f7c104887/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:31.613119 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0269d2-55e9-46f6-997b-f4aef4986e1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6196ea04653b4bf983c61fb05fab6e02, user_id=ce5f14b81e134cf891cf867f7c104887, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:31.615752 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0269d2-55e9-46f6-997b-f4aef4986e1e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:31.635513 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1254/2510] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:49:31 2022] PUT /identity/v3/projects/c0dc8c51819f41f2b84b7ee652537db7/users/040337d14e044fc6afe740fe1293418f/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:49:31.640333 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49259c2b-c0f2-4ab2-b678-455803e30be3 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:31.640614 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49259c2b-c0f2-4ab2-b678-455803e30be3 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:31.640883 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49259c2b-c0f2-4ab2-b678-455803e30be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:31.659251 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-49259c2b-c0f2-4ab2-b678-455803e30be3 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:31.663290 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-49259c2b-c0f2-4ab2-b678-455803e30be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:31.706875 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:31.726406 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1255/2511] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:49:31.735358 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1257/2512] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:49:31 2022] PUT /identity/v3/projects/6196ea04653b4bf983c61fb05fab6e02/users/ce5f14b81e134cf891cf867f7c104887/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:49:31.742307 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49259c2b-c0f2-4ab2-b678-455803e30be3 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:31.743683 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-49259c2b-c0f2-4ab2-b678-455803e30be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:31.745458 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c0dc2-4733-4324-843c-6f3167c48711 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:31.745810 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c0dc2-4733-4324-843c-6f3167c48711 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:31.746189 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c0dc2-4733-4324-843c-6f3167c48711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:31.777165 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-7d7c0dc2-4733-4324-843c-6f3167c48711 None None] MFA Rules not processed for user `ce5f14b81e134cf891cf867f7c104887`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:31.778513 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7d7c0dc2-4733-4324-843c-6f3167c48711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:31.807139 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49259c2b-c0f2-4ab2-b678-455803e30be3 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:31.857542 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1258/2513] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:31 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:49:31.858426 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdce3fc-092c-4225-b29d-9c143ad94822 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:31.859037 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdce3fc-092c-4225-b29d-9c143ad94822 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:31.859316 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdce3fc-092c-4225-b29d-9c143ad94822 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:31.859584 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdce3fc-092c-4225-b29d-9c143ad94822 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:31.862016 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c0dc2-4733-4324-843c-6f3167c48711 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:31.921664 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdce3fc-092c-4225-b29d-9c143ad94822 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:31.923107 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdce3fc-092c-4225-b29d-9c143ad94822 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:31.927707 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c0dc2-4733-4324-843c-6f3167c48711 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:31.932962 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f29eba-e8f9-4532-aa90-caf287d8d208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:31.933565 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f29eba-e8f9-4532-aa90-caf287d8d208 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:31.933852 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f29eba-e8f9-4532-aa90-caf287d8d208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:31.933959 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1256/2514] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:49:31.934111 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f29eba-e8f9-4532-aa90-caf287d8d208 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:31.934747 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f29eba-e8f9-4532-aa90-caf287d8d208 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:31.937354 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f29eba-e8f9-4532-aa90-caf287d8d208 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:32.046374 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1259/2515] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:49:31 2022] POST /identity/v3/projects => generated 395 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:49:32.048008 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdce3fc-092c-4225-b29d-9c143ad94822 service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:32.057719 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdce3fc-092c-4225-b29d-9c143ad94822 service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:32.107964 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:32.117498 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e229c27-8986-4db6-906a-bb3b6479edc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:32.118105 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e229c27-8986-4db6-906a-bb3b6479edc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:32.118385 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e229c27-8986-4db6-906a-bb3b6479edc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:32.118664 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e229c27-8986-4db6-906a-bb3b6479edc5 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:32.119282 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e229c27-8986-4db6-906a-bb3b6479edc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:32.121226 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e229c27-8986-4db6-906a-bb3b6479edc5 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:32.207883 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1257/2516] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:49:32 2022] POST /identity/v3/users => generated 304 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:49:32.212070 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f29eba-e8f9-4532-aa90-caf287d8d208 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:32.222860 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f29eba-e8f9-4532-aa90-caf287d8d208 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:32.227847 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa34d6b-dc77-4586-abfc-b7039a815875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:32.228585 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa34d6b-dc77-4586-abfc-b7039a815875 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:32.228864 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa34d6b-dc77-4586-abfc-b7039a815875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:32.229133 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa34d6b-dc77-4586-abfc-b7039a815875 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:32.229772 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa34d6b-dc77-4586-abfc-b7039a815875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:32.231598 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa34d6b-dc77-4586-abfc-b7039a815875 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:32.242357 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1260/2517] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:49:32.246592 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e229c27-8986-4db6-906a-bb3b6479edc5 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:32.257464 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e229c27-8986-4db6-906a-bb3b6479edc5 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:32.262523 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce149174-5b70-41b8-85f4-d1f140da2e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:32.263230 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce149174-5b70-41b8-85f4-d1f140da2e66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:32.263602 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce149174-5b70-41b8-85f4-d1f140da2e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:32.263858 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce149174-5b70-41b8-85f4-d1f140da2e66 admin admin] PATH_INFO: `/v3/projects/ed0d44bb9cdf4dd29870614753933fb7/users/831da13e827742d2a010bc755a2716b6/roles/9252c356af254127896f3626d925a88a` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:32.279846 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce149174-5b70-41b8-85f4-d1f140da2e66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed0d44bb9cdf4dd29870614753933fb7, user_id=831da13e827742d2a010bc755a2716b6, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:32.282516 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce149174-5b70-41b8-85f4-d1f140da2e66 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:32.383275 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1258/2518] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:49:32 2022] PUT /identity/v3/projects/ed0d44bb9cdf4dd29870614753933fb7/users/831da13e827742d2a010bc755a2716b6/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:49:32.387015 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa34d6b-dc77-4586-abfc-b7039a815875 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:32.397768 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa34d6b-dc77-4586-abfc-b7039a815875 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:32.401714 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:32.456916 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a18b0-3f79-47de-b970-dbfc3f43339c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:32.457536 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a18b0-3f79-47de-b970-dbfc3f43339c admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:32.457861 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a18b0-3f79-47de-b970-dbfc3f43339c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:32.458086 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a18b0-3f79-47de-b970-dbfc3f43339c admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:32.458735 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a18b0-3f79-47de-b970-dbfc3f43339c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:32.460353 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a18b0-3f79-47de-b970-dbfc3f43339c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:32.470666 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1261/2519] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:49:32.474760 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce149174-5b70-41b8-85f4-d1f140da2e66 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:32.486314 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce149174-5b70-41b8-85f4-d1f140da2e66 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:32.490978 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11947c9-a95a-4b83-a87d-77de2f9386d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:32.491697 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11947c9-a95a-4b83-a87d-77de2f9386d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:32.491969 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11947c9-a95a-4b83-a87d-77de2f9386d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:32.492386 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11947c9-a95a-4b83-a87d-77de2f9386d9 admin admin] PATH_INFO: `/v3/projects/ed0d44bb9cdf4dd29870614753933fb7/users/831da13e827742d2a010bc755a2716b6/roles/9252c356af254127896f3626d925a88a` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:32.494358 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11947c9-a95a-4b83-a87d-77de2f9386d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed0d44bb9cdf4dd29870614753933fb7, user_id=831da13e827742d2a010bc755a2716b6, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:32.497429 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11947c9-a95a-4b83-a87d-77de2f9386d9 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:32.520428 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1259/2520] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:49:32 2022] PUT /identity/v3/projects/ed0d44bb9cdf4dd29870614753933fb7/users/831da13e827742d2a010bc755a2716b6/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:32.525265 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57470c2a-75b7-4f4a-a777-649fcb478800 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:32.525624 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57470c2a-75b7-4f4a-a777-649fcb478800 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:32.526002 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57470c2a-75b7-4f4a-a777-649fcb478800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:32.555633 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-57470c2a-75b7-4f4a-a777-649fcb478800 None None] MFA Rules not processed for user `831da13e827742d2a010bc755a2716b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:32.556874 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-57470c2a-75b7-4f4a-a777-649fcb478800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:32.624912 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1262/2521] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:32 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:49:32.636388 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11947c9-a95a-4b83-a87d-77de2f9386d9 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:32.638309 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-b11947c9-a95a-4b83-a87d-77de2f9386d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:32.698686 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11947c9-a95a-4b83-a87d-77de2f9386d9 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:32.703002 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa4b122-98bd-4e50-8c1a-89a890877761 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:32.703816 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4b122-98bd-4e50-8c1a-89a890877761 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:32.707082 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4b122-98bd-4e50-8c1a-89a890877761 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:32.707082 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4b122-98bd-4e50-8c1a-89a890877761 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:32.714118 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa4b122-98bd-4e50-8c1a-89a890877761 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:32.715564 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa4b122-98bd-4e50-8c1a-89a890877761 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:32.726002 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1260/2522] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:32 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:49:32.959873 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57470c2a-75b7-4f4a-a777-649fcb478800 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:32.971908 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57470c2a-75b7-4f4a-a777-649fcb478800 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:32.975844 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046c322-b196-4196-8fc7-08350479c3b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:32.976479 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046c322-b196-4196-8fc7-08350479c3b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:32.977651 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046c322-b196-4196-8fc7-08350479c3b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:32.977651 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046c322-b196-4196-8fc7-08350479c3b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:33.034321 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046c322-b196-4196-8fc7-08350479c3b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:33.036034 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046c322-b196-4196-8fc7-08350479c3b3 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:33.045173 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1263/2523] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:32 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:49:37.975904 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a5f3b-0677-445c-9817-1e8da675c1dd None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:37.976519 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a5f3b-0677-445c-9817-1e8da675c1dd None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:37.976519 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a5f3b-0677-445c-9817-1e8da675c1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:38.004439 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-a49a5f3b-0677-445c-9817-1e8da675c1dd None None] MFA Rules not processed for user `040337d14e044fc6afe740fe1293418f`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:38.005809 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a49a5f3b-0677-445c-9817-1e8da675c1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:38.075505 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1261/2524] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:38.079854 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046c322-b196-4196-8fc7-08350479c3b3 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:38.110698 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:38.142759 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046c322-b196-4196-8fc7-08350479c3b3 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:38.147312 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7e2be-5118-43a1-86c4-f7a704f4bf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:38.147975 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7e2be-5118-43a1-86c4-f7a704f4bf14 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:38.148220 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7e2be-5118-43a1-86c4-f7a704f4bf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:38.148492 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7e2be-5118-43a1-86c4-f7a704f4bf14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:38.149124 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7e2be-5118-43a1-86c4-f7a704f4bf14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:38.151055 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7e2be-5118-43a1-86c4-f7a704f4bf14 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:38.248590 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1264/2525] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:49:38 2022] POST /identity/v3/projects => generated 371 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:49:38.248725 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a5f3b-0677-445c-9817-1e8da675c1dd None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:38.261702 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a5f3b-0677-445c-9817-1e8da675c1dd None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:38.298306 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:38.331943 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651781b-186a-4a3d-b5e5-6d4c84c2666d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:38.332737 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651781b-186a-4a3d-b5e5-6d4c84c2666d admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:38.333138 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651781b-186a-4a3d-b5e5-6d4c84c2666d admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:38.333506 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651781b-186a-4a3d-b5e5-6d4c84c2666d admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:38.334303 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4651781b-186a-4a3d-b5e5-6d4c84c2666d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:38.336365 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4651781b-186a-4a3d-b5e5-6d4c84c2666d admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:38.426167 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1262/2526] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:49:38 2022] POST /identity/v3/users => generated 292 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:49:38.430049 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7e2be-5118-43a1-86c4-f7a704f4bf14 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:38.441916 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7e2be-5118-43a1-86c4-f7a704f4bf14 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:38.454288 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df2e32-654f-4dde-92aa-5031e363a095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:38.454288 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df2e32-654f-4dde-92aa-5031e363a095 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:38.454288 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df2e32-654f-4dde-92aa-5031e363a095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:38.454288 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df2e32-654f-4dde-92aa-5031e363a095 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:38.454958 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0df2e32-654f-4dde-92aa-5031e363a095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:38.454958 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0df2e32-654f-4dde-92aa-5031e363a095 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:38.470343 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1265/2527] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:49:38.475873 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651781b-186a-4a3d-b5e5-6d4c84c2666d admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:38.482286 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651781b-186a-4a3d-b5e5-6d4c84c2666d admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:38.487765 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd34f25-8db2-4e1c-b34b-a799d8585886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:38.488586 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd34f25-8db2-4e1c-b34b-a799d8585886 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:38.488929 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd34f25-8db2-4e1c-b34b-a799d8585886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:38.489275 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd34f25-8db2-4e1c-b34b-a799d8585886 admin admin] PATH_INFO: `/v3/projects/f5cb2662dc0545ef820c0637aa11157d/users/072a999f2877497a9e4680056b2d964f/roles/9252c356af254127896f3626d925a88a` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:38.505652 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd34f25-8db2-4e1c-b34b-a799d8585886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5cb2662dc0545ef820c0637aa11157d, user_id=072a999f2877497a9e4680056b2d964f, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:38.508480 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd34f25-8db2-4e1c-b34b-a799d8585886 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:38.583675 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1263/2528] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:49:38 2022] PUT /identity/v3/projects/f5cb2662dc0545ef820c0637aa11157d/users/072a999f2877497a9e4680056b2d964f/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:38.587363 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df2e32-654f-4dde-92aa-5031e363a095 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:38.600655 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df2e32-654f-4dde-92aa-5031e363a095 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:38.678081 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd34f25-8db2-4e1c-b34b-a799d8585886 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:38.682017 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d5e79-b97f-4a4d-8d7b-eaa7edadf748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:38.682290 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d5e79-b97f-4a4d-8d7b-eaa7edadf748 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:38.682531 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d5e79-b97f-4a4d-8d7b-eaa7edadf748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:38.682928 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d5e79-b97f-4a4d-8d7b-eaa7edadf748 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:38.683563 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d5e79-b97f-4a4d-8d7b-eaa7edadf748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:38.685591 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d5e79-b97f-4a4d-8d7b-eaa7edadf748 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:38.688931 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd34f25-8db2-4e1c-b34b-a799d8585886 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:38.696230 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254ecd2-afe8-40d9-8ec5-d4afbfddf22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:38.696871 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254ecd2-afe8-40d9-8ec5-d4afbfddf22c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:38.697148 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254ecd2-afe8-40d9-8ec5-d4afbfddf22c admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:38.697423 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254ecd2-afe8-40d9-8ec5-d4afbfddf22c admin admin] PATH_INFO: `/v3/users/ce5f14b81e134cf891cf867f7c104887` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:38.697686 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1266/2529] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:49:38.701014 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c254ecd2-afe8-40d9-8ec5-d4afbfddf22c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce5f14b81e134cf891cf867f7c104887)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:38.703100 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c254ecd2-afe8-40d9-8ec5-d4afbfddf22c admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:38.706971 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d5e79-b97f-4a4d-8d7b-eaa7edadf748 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:38.724576 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d5e79-b97f-4a4d-8d7b-eaa7edadf748 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:38.737438 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ad8f0-094e-4cba-b7d1-9ff9f762a578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:38.739817 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ad8f0-094e-4cba-b7d1-9ff9f762a578 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:38.740985 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ad8f0-094e-4cba-b7d1-9ff9f762a578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:38.741281 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ad8f0-094e-4cba-b7d1-9ff9f762a578 admin admin] PATH_INFO: `/v3/projects/f5cb2662dc0545ef820c0637aa11157d/users/072a999f2877497a9e4680056b2d964f/roles/9252c356af254127896f3626d925a88a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:38.743921 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ad8f0-094e-4cba-b7d1-9ff9f762a578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5cb2662dc0545ef820c0637aa11157d, user_id=072a999f2877497a9e4680056b2d964f, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:38.746653 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ad8f0-094e-4cba-b7d1-9ff9f762a578 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:38.758025 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1267/2530] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:49:38 2022] PUT /identity/v3/projects/f5cb2662dc0545ef820c0637aa11157d/users/072a999f2877497a9e4680056b2d964f/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:49:38.928361 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c254ecd2-afe8-40d9-8ec5-d4afbfddf22c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce5f14b81e134cf891cf867f7c104887'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:38.954962 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c254ecd2-afe8-40d9-8ec5-d4afbfddf22c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce5f14b81e134cf891cf867f7c104887'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:38.971015 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c254ecd2-afe8-40d9-8ec5-d4afbfddf22c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce5f14b81e134cf891cf867f7c104887'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:38.971608 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c254ecd2-afe8-40d9-8ec5-d4afbfddf22c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce5f14b81e134cf891cf867f7c104887'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:38.973177 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c254ecd2-afe8-40d9-8ec5-d4afbfddf22c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce5f14b81e134cf891cf867f7c104887'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:39.064825 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1264/2531] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:49:38 2022] DELETE /identity/v3/users/ce5f14b81e134cf891cf867f7c104887 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:49:39.069840 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a5708-aa1e-4c5c-a003-8a4b4e4b343f None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:39.070334 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a5708-aa1e-4c5c-a003-8a4b4e4b343f None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:39.070763 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a5708-aa1e-4c5c-a003-8a4b4e4b343f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:39.091805 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-cf5a5708-aa1e-4c5c-a003-8a4b4e4b343f None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:39.094081 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-cf5a5708-aa1e-4c5c-a003-8a4b4e4b343f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:39.186502 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1268/2532] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:49:39.209609 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254ecd2-afe8-40d9-8ec5-d4afbfddf22c admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:39.212622 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c254ecd2-afe8-40d9-8ec5-d4afbfddf22c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:39.282073 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254ecd2-afe8-40d9-8ec5-d4afbfddf22c admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:39.286737 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118241a-bb30-4853-8b57-95e6b6b3a83c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:39.287356 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118241a-bb30-4853-8b57-95e6b6b3a83c service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:39.287760 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118241a-bb30-4853-8b57-95e6b6b3a83c service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:39.288043 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118241a-bb30-4853-8b57-95e6b6b3a83c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:39.298535 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118241a-bb30-4853-8b57-95e6b6b3a83c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:39.299980 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118241a-bb30-4853-8b57-95e6b6b3a83c service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:39.310797 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1265/2533] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:49:39.906887 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a5708-aa1e-4c5c-a003-8a4b4e4b343f None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:39.908387 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-cf5a5708-aa1e-4c5c-a003-8a4b4e4b343f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:39.921352 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a5708-aa1e-4c5c-a003-8a4b4e4b343f None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:39.927154 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39213dba-e560-433c-ac83-cf0b121d5450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:39.927996 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39213dba-e560-433c-ac83-cf0b121d5450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:39.928325 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39213dba-e560-433c-ac83-cf0b121d5450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:39.928598 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39213dba-e560-433c-ac83-cf0b121d5450 admin admin] PATH_INFO: `/v3/projects/6196ea04653b4bf983c61fb05fab6e02` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:39.929723 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39213dba-e560-433c-ac83-cf0b121d5450 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6196ea04653b4bf983c61fb05fab6e02)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:39.931715 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39213dba-e560-433c-ac83-cf0b121d5450 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:39.956708 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:40.083204 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-39213dba-e560-433c-ac83-cf0b121d5450 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6196ea04653b4bf983c61fb05fab6e02', 'request_id': 'req-39213dba-e560-433c-ac83-cf0b121d5450'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:40.088947 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-39213dba-e560-433c-ac83-cf0b121d5450 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6196ea04653b4bf983c61fb05fab6e02', 'request_id': 'req-39213dba-e560-433c-ac83-cf0b121d5450'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:40.096036 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-39213dba-e560-433c-ac83-cf0b121d5450 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6196ea04653b4bf983c61fb05fab6e02', 'request_id': 'req-39213dba-e560-433c-ac83-cf0b121d5450'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:40.167286 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-39213dba-e560-433c-ac83-cf0b121d5450 admin admin] The token cache is being invalidate because project 6196ea04653b4bf983c61fb05fab6e02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:49:40.167560 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-39213dba-e560-433c-ac83-cf0b121d5450 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:40.168259 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-39213dba-e560-433c-ac83-cf0b121d5450 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:40.170070 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1269/2534] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:49:39 2022] DELETE /identity/v3/projects/6196ea04653b4bf983c61fb05fab6e02 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:40.174142 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118241a-bb30-4853-8b57-95e6b6b3a83c service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:40.184120 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118241a-bb30-4853-8b57-95e6b6b3a83c service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:40.196767 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:40.243027 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63457997-0e03-4f1f-a4fc-4cc2b2a75aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:40.243682 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63457997-0e03-4f1f-a4fc-4cc2b2a75aac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:40.243992 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63457997-0e03-4f1f-a4fc-4cc2b2a75aac admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:40.244295 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63457997-0e03-4f1f-a4fc-4cc2b2a75aac admin admin] PATH_INFO: `/v3/users/831da13e827742d2a010bc755a2716b6` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:40.245404 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63457997-0e03-4f1f-a4fc-4cc2b2a75aac admin admin] RBAC: Authorizing `identity:delete_user(user_id=831da13e827742d2a010bc755a2716b6)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:40.247852 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63457997-0e03-4f1f-a4fc-4cc2b2a75aac admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:40.480663 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-63457997-0e03-4f1f-a4fc-4cc2b2a75aac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '831da13e827742d2a010bc755a2716b6'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:40.508672 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-63457997-0e03-4f1f-a4fc-4cc2b2a75aac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '831da13e827742d2a010bc755a2716b6'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:40.521291 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-63457997-0e03-4f1f-a4fc-4cc2b2a75aac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '831da13e827742d2a010bc755a2716b6'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:40.522473 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-63457997-0e03-4f1f-a4fc-4cc2b2a75aac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '831da13e827742d2a010bc755a2716b6'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:40.523130 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-63457997-0e03-4f1f-a4fc-4cc2b2a75aac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '831da13e827742d2a010bc755a2716b6'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:40.648085 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1266/2535] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:49:40 2022] DELETE /identity/v3/users/831da13e827742d2a010bc755a2716b6 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:41.610144 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39213dba-e560-433c-ac83-cf0b121d5450 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:41.617860 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-39213dba-e560-433c-ac83-cf0b121d5450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:41.635331 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39213dba-e560-433c-ac83-cf0b121d5450 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:41.733350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214cff58-3232-46b0-b03f-3d875d08cf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:41.734167 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cff58-3232-46b0-b03f-3d875d08cf35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:41.734542 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cff58-3232-46b0-b03f-3d875d08cf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:41.734908 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cff58-3232-46b0-b03f-3d875d08cf35 admin admin] PATH_INFO: `/v3/projects/ed0d44bb9cdf4dd29870614753933fb7` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:41.736347 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214cff58-3232-46b0-b03f-3d875d08cf35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed0d44bb9cdf4dd29870614753933fb7)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:41.738878 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214cff58-3232-46b0-b03f-3d875d08cf35 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:41.881895 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-214cff58-3232-46b0-b03f-3d875d08cf35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed0d44bb9cdf4dd29870614753933fb7', 'request_id': 'req-214cff58-3232-46b0-b03f-3d875d08cf35'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:41.889760 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-214cff58-3232-46b0-b03f-3d875d08cf35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed0d44bb9cdf4dd29870614753933fb7', 'request_id': 'req-214cff58-3232-46b0-b03f-3d875d08cf35'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:41.906261 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-214cff58-3232-46b0-b03f-3d875d08cf35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed0d44bb9cdf4dd29870614753933fb7', 'request_id': 'req-214cff58-3232-46b0-b03f-3d875d08cf35'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:42.143898 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-214cff58-3232-46b0-b03f-3d875d08cf35 admin admin] The token cache is being invalidate because project ed0d44bb9cdf4dd29870614753933fb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:49:42.144186 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-214cff58-3232-46b0-b03f-3d875d08cf35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:42.144753 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-214cff58-3232-46b0-b03f-3d875d08cf35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:42.146231 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1270/2536] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:49:41 2022] DELETE /identity/v3/projects/ed0d44bb9cdf4dd29870614753933fb7 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:42.151147 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9e9f2-03cd-430a-95a1-b44176022a69 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:42.151631 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9e9f2-03cd-430a-95a1-b44176022a69 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:42.151741 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9e9f2-03cd-430a-95a1-b44176022a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:42.183602 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-77e9e9f2-03cd-430a-95a1-b44176022a69 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:42.185796 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-77e9e9f2-03cd-430a-95a1-b44176022a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:42.260374 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1267/2537] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:42.268471 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e30b6-d0c0-4aab-ba18-4c6cc28e4b34 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:42.268759 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e30b6-d0c0-4aab-ba18-4c6cc28e4b34 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:42.269038 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e30b6-d0c0-4aab-ba18-4c6cc28e4b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:42.289390 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-970e30b6-d0c0-4aab-ba18-4c6cc28e4b34 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:42.290689 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-970e30b6-d0c0-4aab-ba18-4c6cc28e4b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:42.299610 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1271/2538] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:42.303900 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e9e9f2-03cd-430a-95a1-b44176022a69 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:42.315285 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e9e9f2-03cd-430a-95a1-b44176022a69 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:42.320673 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a512c-b43c-4b50-8aed-9fd63b4f994f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:42.321434 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a512c-b43c-4b50-8aed-9fd63b4f994f admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:42.321780 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a512c-b43c-4b50-8aed-9fd63b4f994f admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:42.322123 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a512c-b43c-4b50-8aed-9fd63b4f994f admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:42.322932 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a512c-b43c-4b50-8aed-9fd63b4f994f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:49:42.323426 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a512c-b43c-4b50-8aed-9fd63b4f994f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:42.326550 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a512c-b43c-4b50-8aed-9fd63b4f994f admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:42.345454 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1268/2539] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:49:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:49:42.346728 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e30b6-d0c0-4aab-ba18-4c6cc28e4b34 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:42.357239 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e30b6-d0c0-4aab-ba18-4c6cc28e4b34 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:42.362591 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f873a-3bc8-4a91-8fb8-789f6648b40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:42.363207 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f873a-3bc8-4a91-8fb8-789f6648b40e admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:42.363481 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f873a-3bc8-4a91-8fb8-789f6648b40e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:42.364258 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f873a-3bc8-4a91-8fb8-789f6648b40e admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:42.364407 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f873a-3bc8-4a91-8fb8-789f6648b40e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:42.366405 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f873a-3bc8-4a91-8fb8-789f6648b40e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:42.496785 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1272/2540] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:49:42 2022] POST /identity/v3/projects => generated 381 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:49:42.501588 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a512c-b43c-4b50-8aed-9fd63b4f994f admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:42.512169 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a512c-b43c-4b50-8aed-9fd63b4f994f admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:42.541853 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:42.617265 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137bcfd9-9428-44c6-9364-0e1188b235ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:42.618511 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bcfd9-9428-44c6-9364-0e1188b235ca admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:42.618897 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bcfd9-9428-44c6-9364-0e1188b235ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:42.619525 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bcfd9-9428-44c6-9364-0e1188b235ca admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:42.621394 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137bcfd9-9428-44c6-9364-0e1188b235ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:42.625262 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137bcfd9-9428-44c6-9364-0e1188b235ca admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:42.732121 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1269/2541] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:49:42 2022] POST /identity/v3/users => generated 291 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:49:42.734253 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f873a-3bc8-4a91-8fb8-789f6648b40e admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:42.745679 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f873a-3bc8-4a91-8fb8-789f6648b40e admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:42.752309 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125461ae-af5a-481a-9e1d-2685b3c37c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:42.752532 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125461ae-af5a-481a-9e1d-2685b3c37c38 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:42.752725 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125461ae-af5a-481a-9e1d-2685b3c37c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:42.753001 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125461ae-af5a-481a-9e1d-2685b3c37c38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:42.753780 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125461ae-af5a-481a-9e1d-2685b3c37c38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:42.756383 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125461ae-af5a-481a-9e1d-2685b3c37c38 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:42.766188 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:42.769874 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1273/2542] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:49:42.773714 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137bcfd9-9428-44c6-9364-0e1188b235ca admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:42.787082 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137bcfd9-9428-44c6-9364-0e1188b235ca admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:42.793512 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8b0b5-067f-4280-8eb6-545c36b959b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:42.795132 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8b0b5-067f-4280-8eb6-545c36b959b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:42.795500 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8b0b5-067f-4280-8eb6-545c36b959b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:42.796280 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8b0b5-067f-4280-8eb6-545c36b959b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:42.796648 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f8b0b5-067f-4280-8eb6-545c36b959b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:42.798494 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f8b0b5-067f-4280-8eb6-545c36b959b1 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:42.810020 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1270/2543] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:49:42.814338 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125461ae-af5a-481a-9e1d-2685b3c37c38 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:42.824891 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125461ae-af5a-481a-9e1d-2685b3c37c38 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:42.830991 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a2ce5-d0bd-448c-a56f-e72f619efc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:42.831772 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a2ce5-d0bd-448c-a56f-e72f619efc22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:42.832155 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a2ce5-d0bd-448c-a56f-e72f619efc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:42.832517 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a2ce5-d0bd-448c-a56f-e72f619efc22 admin admin] PATH_INFO: `/v3/projects/980706b0407642059da7ea3e721816e2/users/135e7dada4454ac89217309fbd0bf6dc/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:42.850139 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488a2ce5-d0bd-448c-a56f-e72f619efc22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=980706b0407642059da7ea3e721816e2, user_id=135e7dada4454ac89217309fbd0bf6dc, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:42.853060 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488a2ce5-d0bd-448c-a56f-e72f619efc22 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:42.933355 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1274/2544] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:49:42 2022] PUT /identity/v3/projects/980706b0407642059da7ea3e721816e2/users/135e7dada4454ac89217309fbd0bf6dc/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:49:42.941862 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e22b6a-87ca-428a-9391-8561c5b5ab33 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:42.942101 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e22b6a-87ca-428a-9391-8561c5b5ab33 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:42.942473 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e22b6a-87ca-428a-9391-8561c5b5ab33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:42.977065 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-b5e22b6a-87ca-428a-9391-8561c5b5ab33 None None] MFA Rules not processed for user `135e7dada4454ac89217309fbd0bf6dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:42.978919 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-b5e22b6a-87ca-428a-9391-8561c5b5ab33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:43.081347 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1271/2545] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:43.086075 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a2ce5-d0bd-448c-a56f-e72f619efc22 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:43.175975 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a2ce5-d0bd-448c-a56f-e72f619efc22 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:43.184914 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e2142-ca10-416c-98a2-f8ca290cbaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:43.185711 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e2142-ca10-416c-98a2-f8ca290cbaeb admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:43.186088 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e2142-ca10-416c-98a2-f8ca290cbaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:43.186407 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e2142-ca10-416c-98a2-f8ca290cbaeb admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:43.187206 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e2142-ca10-416c-98a2-f8ca290cbaeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:43.189324 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e2142-ca10-416c-98a2-f8ca290cbaeb admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:43.300573 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1275/2546] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:49:43 2022] POST /identity/v3/projects => generated 381 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:49:43.304852 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e22b6a-87ca-428a-9391-8561c5b5ab33 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:43.316093 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e22b6a-87ca-428a-9391-8561c5b5ab33 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:43.393148 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40198e45-bd4f-4828-80bf-cdd374351d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:43.393945 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40198e45-bd4f-4828-80bf-cdd374351d3c admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:43.394227 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40198e45-bd4f-4828-80bf-cdd374351d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:43.394623 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40198e45-bd4f-4828-80bf-cdd374351d3c admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:43.395311 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40198e45-bd4f-4828-80bf-cdd374351d3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:43.397279 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40198e45-bd4f-4828-80bf-cdd374351d3c admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:43.505868 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1272/2547] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:49:43 2022] POST /identity/v3/users => generated 297 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:49:43.510336 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e2142-ca10-416c-98a2-f8ca290cbaeb admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:43.521434 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e2142-ca10-416c-98a2-f8ca290cbaeb admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:43.526511 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc70b1-83b5-4387-8a4b-718fac2ae224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:43.527111 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc70b1-83b5-4387-8a4b-718fac2ae224 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:43.527386 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc70b1-83b5-4387-8a4b-718fac2ae224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:43.527655 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc70b1-83b5-4387-8a4b-718fac2ae224 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:43.528719 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc70b1-83b5-4387-8a4b-718fac2ae224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:43.530350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc70b1-83b5-4387-8a4b-718fac2ae224 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:43.545780 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1276/2548] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:49:43.550885 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40198e45-bd4f-4828-80bf-cdd374351d3c admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:43.565382 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40198e45-bd4f-4828-80bf-cdd374351d3c admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:43.570963 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447bdd70-a111-48a3-ac3d-bc37781d6ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:43.571742 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bdd70-a111-48a3-ac3d-bc37781d6ca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:43.572185 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bdd70-a111-48a3-ac3d-bc37781d6ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:43.572554 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bdd70-a111-48a3-ac3d-bc37781d6ca3 admin admin] PATH_INFO: `/v3/projects/c04febc785e14d4c86717be29800fd55/users/047eb9a58b65499e8307b85e7c638cb4/roles/9252c356af254127896f3626d925a88a` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:43.594484 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447bdd70-a111-48a3-ac3d-bc37781d6ca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c04febc785e14d4c86717be29800fd55, user_id=047eb9a58b65499e8307b85e7c638cb4, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:43.594863 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447bdd70-a111-48a3-ac3d-bc37781d6ca3 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:43.598110 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:43.671810 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1273/2549] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:49:43 2022] PUT /identity/v3/projects/c04febc785e14d4c86717be29800fd55/users/047eb9a58b65499e8307b85e7c638cb4/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:43.675574 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc70b1-83b5-4387-8a4b-718fac2ae224 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:43.688129 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc70b1-83b5-4387-8a4b-718fac2ae224 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:43.772447 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f83a1-abe9-40c6-88d2-7cbba3f9fb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:43.773196 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f83a1-abe9-40c6-88d2-7cbba3f9fb7c admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:43.773579 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f83a1-abe9-40c6-88d2-7cbba3f9fb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:43.773951 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f83a1-abe9-40c6-88d2-7cbba3f9fb7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:43.774887 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f83a1-abe9-40c6-88d2-7cbba3f9fb7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:43.776617 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f83a1-abe9-40c6-88d2-7cbba3f9fb7c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:43.788512 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1277/2550] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:49:43.797870 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447bdd70-a111-48a3-ac3d-bc37781d6ca3 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:43.814416 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447bdd70-a111-48a3-ac3d-bc37781d6ca3 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:43.814416 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedd11f-537f-45d3-b912-cb571eb27462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:43.814416 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedd11f-537f-45d3-b912-cb571eb27462 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:43.814416 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedd11f-537f-45d3-b912-cb571eb27462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:43.814978 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedd11f-537f-45d3-b912-cb571eb27462 admin admin] PATH_INFO: `/v3/projects/c04febc785e14d4c86717be29800fd55/users/047eb9a58b65499e8307b85e7c638cb4/roles/9252c356af254127896f3626d925a88a` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:43.817924 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bedd11f-537f-45d3-b912-cb571eb27462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c04febc785e14d4c86717be29800fd55, user_id=047eb9a58b65499e8307b85e7c638cb4, role_id=9252c356af254127896f3626d925a88a)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:43.821535 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bedd11f-537f-45d3-b912-cb571eb27462 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:43.837380 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1274/2551] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:49:43 2022] PUT /identity/v3/projects/c04febc785e14d4c86717be29800fd55/users/047eb9a58b65499e8307b85e7c638cb4/roles/9252c356af254127896f3626d925a88a => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:43.851385 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abe72c-8481-47c5-957b-2947d039d1c2 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:43.852383 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abe72c-8481-47c5-957b-2947d039d1c2 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:43.852927 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abe72c-8481-47c5-957b-2947d039d1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:43.888940 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-63abe72c-8481-47c5-957b-2947d039d1c2 None None] MFA Rules not processed for user `047eb9a58b65499e8307b85e7c638cb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:43.890736 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-63abe72c-8481-47c5-957b-2947d039d1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:43.933699 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:43.988677 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1278/2552] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:43 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:44.001041 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedd11f-537f-45d3-b912-cb571eb27462 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:44.004770 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-4bedd11f-537f-45d3-b912-cb571eb27462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:44.090455 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedd11f-537f-45d3-b912-cb571eb27462 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:44.095227 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51cdad2-ea8c-47d1-bfbe-dcb846dd15c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:44.095841 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cdad2-ea8c-47d1-bfbe-dcb846dd15c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:44.096148 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cdad2-ea8c-47d1-bfbe-dcb846dd15c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:44.096422 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cdad2-ea8c-47d1-bfbe-dcb846dd15c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:44.107030 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51cdad2-ea8c-47d1-bfbe-dcb846dd15c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:44.108539 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51cdad2-ea8c-47d1-bfbe-dcb846dd15c9 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:44.118860 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1275/2553] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:43 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:49:44.259165 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63abe72c-8481-47c5-957b-2947d039d1c2 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:44.260759 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-63abe72c-8481-47c5-957b-2947d039d1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:44.273647 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63abe72c-8481-47c5-957b-2947d039d1c2 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:44.277442 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38888e-0f24-4bad-8245-04c20c68f66e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:44.278044 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38888e-0f24-4bad-8245-04c20c68f66e service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:44.278415 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38888e-0f24-4bad-8245-04c20c68f66e service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:44.279209 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38888e-0f24-4bad-8245-04c20c68f66e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:44.346683 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38888e-0f24-4bad-8245-04c20c68f66e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:44.348859 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38888e-0f24-4bad-8245-04c20c68f66e service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:44.363762 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1279/2554] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:49:45.000803 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51cdad2-ea8c-47d1-bfbe-dcb846dd15c9 service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:45.093111 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51cdad2-ea8c-47d1-bfbe-dcb846dd15c9 service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:45.098006 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e30194-5142-426b-a4c4-90ab19e46f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:45.098659 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e30194-5142-426b-a4c4-90ab19e46f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:45.098937 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e30194-5142-426b-a4c4-90ab19e46f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:45.099208 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e30194-5142-426b-a4c4-90ab19e46f83 admin admin] PATH_INFO: `/v3/users/135e7dada4454ac89217309fbd0bf6dc` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:45.100386 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e30194-5142-426b-a4c4-90ab19e46f83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=135e7dada4454ac89217309fbd0bf6dc)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:45.102304 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e30194-5142-426b-a4c4-90ab19e46f83 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:45.292031 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c1e30194-5142-426b-a4c4-90ab19e46f83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '135e7dada4454ac89217309fbd0bf6dc'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:45.310809 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c1e30194-5142-426b-a4c4-90ab19e46f83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '135e7dada4454ac89217309fbd0bf6dc'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:45.319982 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c1e30194-5142-426b-a4c4-90ab19e46f83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '135e7dada4454ac89217309fbd0bf6dc'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:45.320933 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c1e30194-5142-426b-a4c4-90ab19e46f83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '135e7dada4454ac89217309fbd0bf6dc'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:45.328509 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c1e30194-5142-426b-a4c4-90ab19e46f83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '135e7dada4454ac89217309fbd0bf6dc'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:45.419849 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1276/2555] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:49:44 2022] DELETE /identity/v3/users/135e7dada4454ac89217309fbd0bf6dc => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:45.424519 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdcb13a-7478-4157-a9be-26d9714860d1 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:45.425396 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdcb13a-7478-4157-a9be-26d9714860d1 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:45.425901 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdcb13a-7478-4157-a9be-26d9714860d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:45.448082 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-8fdcb13a-7478-4157-a9be-26d9714860d1 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:45.449612 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8fdcb13a-7478-4157-a9be-26d9714860d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:45.528790 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1280/2556] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:45.539787 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e30194-5142-426b-a4c4-90ab19e46f83 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:45.541379 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c1e30194-5142-426b-a4c4-90ab19e46f83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:45.549627 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:45.605098 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fa608-d03f-44d2-b2dc-f513eb5fd1a2 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:45.605098 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fa608-d03f-44d2-b2dc-f513eb5fd1a2 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:45.605379 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fa608-d03f-44d2-b2dc-f513eb5fd1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:45.621958 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e30194-5142-426b-a4c4-90ab19e46f83 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:45.626256 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0b1f5-88fe-4e63-8211-4399f4c97e5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:45.626921 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0b1f5-88fe-4e63-8211-4399f4c97e5c service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:45.627029 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0b1f5-88fe-4e63-8211-4399f4c97e5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:45.627304 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0b1f5-88fe-4e63-8211-4399f4c97e5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:45.652939 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-759fa608-d03f-44d2-b2dc-f513eb5fd1a2 None None] MFA Rules not processed for user `072a999f2877497a9e4680056b2d964f`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:45.652939 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-759fa608-d03f-44d2-b2dc-f513eb5fd1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:45.658024 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0b1f5-88fe-4e63-8211-4399f4c97e5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:45.660504 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0b1f5-88fe-4e63-8211-4399f4c97e5c service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:45.675531 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1277/2557] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:49:45.751674 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:45.762607 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1281/2558] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:49:45.781211 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0b1f5-88fe-4e63-8211-4399f4c97e5c service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:45.782839 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-28d0b1f5-88fe-4e63-8211-4399f4c97e5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:45.879298 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0b1f5-88fe-4e63-8211-4399f4c97e5c service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:45.885063 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173cf73-c513-4f86-a418-69b6114f9f58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:45.885672 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173cf73-c513-4f86-a418-69b6114f9f58 service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:45.885946 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173cf73-c513-4f86-a418-69b6114f9f58 service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:45.886222 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173cf73-c513-4f86-a418-69b6114f9f58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:45.888926 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-b173cf73-c513-4f86-a418-69b6114f9f58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:45.963236 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173cf73-c513-4f86-a418-69b6114f9f58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:45.964702 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173cf73-c513-4f86-a418-69b6114f9f58 service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:45.975974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1278/2559] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:49:46.123021 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759fa608-d03f-44d2-b2dc-f513eb5fd1a2 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:46.124503 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-759fa608-d03f-44d2-b2dc-f513eb5fd1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:46.139600 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759fa608-d03f-44d2-b2dc-f513eb5fd1a2 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:46.144513 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541940a-5b4c-48b4-a2b7-1badb7a2b983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:46.145154 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541940a-5b4c-48b4-a2b7-1badb7a2b983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:46.145431 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541940a-5b4c-48b4-a2b7-1badb7a2b983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:46.145702 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541940a-5b4c-48b4-a2b7-1badb7a2b983 admin admin] PATH_INFO: `/v3/projects/980706b0407642059da7ea3e721816e2` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:46.146819 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541940a-5b4c-48b4-a2b7-1badb7a2b983 admin admin] RBAC: Authorizing `identity:delete_project(project_id=980706b0407642059da7ea3e721816e2)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:46.148958 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541940a-5b4c-48b4-a2b7-1badb7a2b983 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:46.310055 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-2541940a-5b4c-48b4-a2b7-1badb7a2b983 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '980706b0407642059da7ea3e721816e2', 'request_id': 'req-2541940a-5b4c-48b4-a2b7-1badb7a2b983'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:46.315795 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-2541940a-5b4c-48b4-a2b7-1badb7a2b983 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '980706b0407642059da7ea3e721816e2', 'request_id': 'req-2541940a-5b4c-48b4-a2b7-1badb7a2b983'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:46.322353 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-2541940a-5b4c-48b4-a2b7-1badb7a2b983 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '980706b0407642059da7ea3e721816e2', 'request_id': 'req-2541940a-5b4c-48b4-a2b7-1badb7a2b983'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:46.400675 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-2541940a-5b4c-48b4-a2b7-1badb7a2b983 admin admin] The token cache is being invalidate because project 980706b0407642059da7ea3e721816e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:49:46.400969 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-2541940a-5b4c-48b4-a2b7-1badb7a2b983 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:46.401709 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-2541940a-5b4c-48b4-a2b7-1badb7a2b983 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:46.406846 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1282/2560] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:49:46 2022] DELETE /identity/v3/projects/980706b0407642059da7ea3e721816e2 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:46.407916 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173cf73-c513-4f86-a418-69b6114f9f58 service nova] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:46.418883 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173cf73-c513-4f86-a418-69b6114f9f58 service nova] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:46.440011 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:46.478153 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28391f8e-cac3-414a-aaf6-cf9b5cc3e88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:46.478789 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28391f8e-cac3-414a-aaf6-cf9b5cc3e88b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:46.479106 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28391f8e-cac3-414a-aaf6-cf9b5cc3e88b admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:46.479375 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28391f8e-cac3-414a-aaf6-cf9b5cc3e88b admin admin] PATH_INFO: `/v3/users/047eb9a58b65499e8307b85e7c638cb4` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:46.480522 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28391f8e-cac3-414a-aaf6-cf9b5cc3e88b admin admin] RBAC: Authorizing `identity:delete_user(user_id=047eb9a58b65499e8307b85e7c638cb4)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:46.482538 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28391f8e-cac3-414a-aaf6-cf9b5cc3e88b admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:46.648305 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-28391f8e-cac3-414a-aaf6-cf9b5cc3e88b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '047eb9a58b65499e8307b85e7c638cb4'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:46.681724 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-28391f8e-cac3-414a-aaf6-cf9b5cc3e88b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '047eb9a58b65499e8307b85e7c638cb4'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:46.696201 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-28391f8e-cac3-414a-aaf6-cf9b5cc3e88b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '047eb9a58b65499e8307b85e7c638cb4'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:46.697087 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-28391f8e-cac3-414a-aaf6-cf9b5cc3e88b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '047eb9a58b65499e8307b85e7c638cb4'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:46.697732 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-28391f8e-cac3-414a-aaf6-cf9b5cc3e88b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '047eb9a58b65499e8307b85e7c638cb4'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:46.808187 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1279/2561] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:49:46 2022] DELETE /identity/v3/users/047eb9a58b65499e8307b85e7c638cb4 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:49:46.854741 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541940a-5b4c-48b4-a2b7-1badb7a2b983 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:46.856222 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2541940a-5b4c-48b4-a2b7-1badb7a2b983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:46.871533 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541940a-5b4c-48b4-a2b7-1badb7a2b983 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:46.941204 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dea5d0-d183-4a6c-95c1-2e65d7485492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:46.943737 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dea5d0-d183-4a6c-95c1-2e65d7485492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:46.943737 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dea5d0-d183-4a6c-95c1-2e65d7485492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:46.943737 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dea5d0-d183-4a6c-95c1-2e65d7485492 admin admin] PATH_INFO: `/v3/users/4973d402ca1944409639476f1ced778a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:46.944283 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dea5d0-d183-4a6c-95c1-2e65d7485492 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4973d402ca1944409639476f1ced778a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:46.946230 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dea5d0-d183-4a6c-95c1-2e65d7485492 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:47.141246 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-29dea5d0-d183-4a6c-95c1-2e65d7485492 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4973d402ca1944409639476f1ced778a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:47.154833 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-29dea5d0-d183-4a6c-95c1-2e65d7485492 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4973d402ca1944409639476f1ced778a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:47.156255 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-29dea5d0-d183-4a6c-95c1-2e65d7485492 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4973d402ca1944409639476f1ced778a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:47.168589 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-29dea5d0-d183-4a6c-95c1-2e65d7485492 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4973d402ca1944409639476f1ced778a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:47.169590 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-29dea5d0-d183-4a6c-95c1-2e65d7485492 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4973d402ca1944409639476f1ced778a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:47.173889 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:47.244350 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1283/2562] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:49:46 2022] DELETE /identity/v3/users/4973d402ca1944409639476f1ced778a => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:47.249469 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d602a47-e8e0-43a5-b8fd-736a74082148 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:47.249755 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d602a47-e8e0-43a5-b8fd-736a74082148 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:47.250082 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d602a47-e8e0-43a5-b8fd-736a74082148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:47.269862 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-2d602a47-e8e0-43a5-b8fd-736a74082148 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:47.271117 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-2d602a47-e8e0-43a5-b8fd-736a74082148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:47.315916 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dea5d0-d183-4a6c-95c1-2e65d7485492 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:47.318076 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-29dea5d0-d183-4a6c-95c1-2e65d7485492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:47.335334 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1280/2563] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:47.346462 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d602a47-e8e0-43a5-b8fd-736a74082148 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:47.348291 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-2d602a47-e8e0-43a5-b8fd-736a74082148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:47.406582 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:47.411955 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dea5d0-d183-4a6c-95c1-2e65d7485492 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:47.420168 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d602a47-e8e0-43a5-b8fd-736a74082148 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:47.421409 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c1aa9-b9d3-48b6-80c8-455164ebbe9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:47.422280 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c1aa9-b9d3-48b6-80c8-455164ebbe9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:47.422624 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c1aa9-b9d3-48b6-80c8-455164ebbe9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:47.422974 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c1aa9-b9d3-48b6-80c8-455164ebbe9f admin admin] PATH_INFO: `/v3/projects/c04febc785e14d4c86717be29800fd55` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:47.424321 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c1aa9-b9d3-48b6-80c8-455164ebbe9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c04febc785e14d4c86717be29800fd55)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:47.424591 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5d0fd-d2db-402c-a8a3-245cfec6ecd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:47.425211 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5d0fd-d2db-402c-a8a3-245cfec6ecd0 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:47.425492 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5d0fd-d2db-402c-a8a3-245cfec6ecd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:47.425762 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5d0fd-d2db-402c-a8a3-245cfec6ecd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:47.426611 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c1aa9-b9d3-48b6-80c8-455164ebbe9f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:47.436928 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5d0fd-d2db-402c-a8a3-245cfec6ecd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:47.439152 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5d0fd-d2db-402c-a8a3-245cfec6ecd0 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:47.449914 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1281/2564] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:49:47.666307 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-933c1aa9-b9d3-48b6-80c8-455164ebbe9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c04febc785e14d4c86717be29800fd55', 'request_id': 'req-933c1aa9-b9d3-48b6-80c8-455164ebbe9f'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:47.673097 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-933c1aa9-b9d3-48b6-80c8-455164ebbe9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c04febc785e14d4c86717be29800fd55', 'request_id': 'req-933c1aa9-b9d3-48b6-80c8-455164ebbe9f'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:47.679638 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-933c1aa9-b9d3-48b6-80c8-455164ebbe9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c04febc785e14d4c86717be29800fd55', 'request_id': 'req-933c1aa9-b9d3-48b6-80c8-455164ebbe9f'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:47.770459 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-933c1aa9-b9d3-48b6-80c8-455164ebbe9f admin admin] The token cache is being invalidate because project c04febc785e14d4c86717be29800fd55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:49:47.771036 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-933c1aa9-b9d3-48b6-80c8-455164ebbe9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:47.771722 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-933c1aa9-b9d3-48b6-80c8-455164ebbe9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:47.776703 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1284/2565] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:49:47 2022] DELETE /identity/v3/projects/c04febc785e14d4c86717be29800fd55 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:49:47.783753 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d0833-7737-4686-8eee-09f830f1ab60 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:47.783753 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d0833-7737-4686-8eee-09f830f1ab60 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:47.783753 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d0833-7737-4686-8eee-09f830f1ab60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:47.812432 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-026d0833-7737-4686-8eee-09f830f1ab60 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:47.812432 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-026d0833-7737-4686-8eee-09f830f1ab60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:47.888223 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1282/2566] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:47.898630 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4a915-0fcd-4645-a40e-22e8c24ba619 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:47.899197 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4a915-0fcd-4645-a40e-22e8c24ba619 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:47.899465 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4a915-0fcd-4645-a40e-22e8c24ba619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:47.923947 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-b3a4a915-0fcd-4645-a40e-22e8c24ba619 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:47.925293 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b3a4a915-0fcd-4645-a40e-22e8c24ba619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:47.934084 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1285/2567] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:47.939054 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d0833-7737-4686-8eee-09f830f1ab60 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:47.951143 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d0833-7737-4686-8eee-09f830f1ab60 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:47.955920 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f22d0-fe1a-45c1-9e81-90b7e2f9b85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:47.960164 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f22d0-fe1a-45c1-9e81-90b7e2f9b85a admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:47.960164 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f22d0-fe1a-45c1-9e81-90b7e2f9b85a admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:47.960164 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f22d0-fe1a-45c1-9e81-90b7e2f9b85a admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:47.960164 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f22d0-fe1a-45c1-9e81-90b7e2f9b85a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:49:47.960164 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f22d0-fe1a-45c1-9e81-90b7e2f9b85a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:47.960164 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f22d0-fe1a-45c1-9e81-90b7e2f9b85a admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:47.975940 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1283/2568] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:49:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:49:47.976887 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4a915-0fcd-4645-a40e-22e8c24ba619 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:47.986450 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4a915-0fcd-4645-a40e-22e8c24ba619 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:47.991396 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c47261-e7b1-44e7-bc00-946b2ac28d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:47.992003 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c47261-e7b1-44e7-bc00-946b2ac28d9f admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:47.992372 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c47261-e7b1-44e7-bc00-946b2ac28d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:47.992581 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c47261-e7b1-44e7-bc00-946b2ac28d9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:47.993250 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c47261-e7b1-44e7-bc00-946b2ac28d9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:47.995151 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c47261-e7b1-44e7-bc00-946b2ac28d9f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:48.009225 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f22d0-fe1a-45c1-9e81-90b7e2f9b85a admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:48.011901 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-d32f22d0-fe1a-45c1-9e81-90b7e2f9b85a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:48.026359 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f22d0-fe1a-45c1-9e81-90b7e2f9b85a admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:48.032112 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac2885-b31b-472d-b2b5-480a9e5b7b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:48.032763 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac2885-b31b-472d-b2b5-480a9e5b7b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:48.033044 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac2885-b31b-472d-b2b5-480a9e5b7b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:48.033383 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac2885-b31b-472d-b2b5-480a9e5b7b0d admin admin] PATH_INFO: `/v3/projects/9d43d94bd0f041e6926605e43010e112` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:48.034547 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac2885-b31b-472d-b2b5-480a9e5b7b0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d43d94bd0f041e6926605e43010e112)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:48.036955 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac2885-b31b-472d-b2b5-480a9e5b7b0d admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:48.114067 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1286/2569] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:49:47 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:49:48.115191 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c47261-e7b1-44e7-bc00-946b2ac28d9f admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:48.161293 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-0dac2885-b31b-472d-b2b5-480a9e5b7b0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d43d94bd0f041e6926605e43010e112', 'request_id': 'req-0dac2885-b31b-472d-b2b5-480a9e5b7b0d'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:48.168323 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-0dac2885-b31b-472d-b2b5-480a9e5b7b0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d43d94bd0f041e6926605e43010e112', 'request_id': 'req-0dac2885-b31b-472d-b2b5-480a9e5b7b0d'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:48.174887 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-0dac2885-b31b-472d-b2b5-480a9e5b7b0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d43d94bd0f041e6926605e43010e112', 'request_id': 'req-0dac2885-b31b-472d-b2b5-480a9e5b7b0d'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:48.195417 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:48.199084 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c47261-e7b1-44e7-bc00-946b2ac28d9f admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:48.256396 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a6bbc-8631-4780-9a7a-6106ecef1253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:48.257256 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a6bbc-8631-4780-9a7a-6106ecef1253 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:48.257536 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a6bbc-8631-4780-9a7a-6106ecef1253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:48.257868 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a6bbc-8631-4780-9a7a-6106ecef1253 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:48.258503 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a6bbc-8631-4780-9a7a-6106ecef1253 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:48.261366 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a6bbc-8631-4780-9a7a-6106ecef1253 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:48.264353 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-0dac2885-b31b-472d-b2b5-480a9e5b7b0d admin admin] The token cache is being invalidate because project 9d43d94bd0f041e6926605e43010e112 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:49:48.264708 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-0dac2885-b31b-472d-b2b5-480a9e5b7b0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:48.266183 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-0dac2885-b31b-472d-b2b5-480a9e5b7b0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:48.267740 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1284/2570] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:49:48 2022] DELETE /identity/v3/projects/9d43d94bd0f041e6926605e43010e112 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:48.272530 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9e22b-045a-43e6-b612-aacfb68580c2 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:48.272810 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9e22b-045a-43e6-b612-aacfb68580c2 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:48.273081 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9e22b-045a-43e6-b612-aacfb68580c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:48.295295 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-c5e9e22b-045a-43e6-b612-aacfb68580c2 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:48.296630 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c5e9e22b-045a-43e6-b612-aacfb68580c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:48.304522 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1285/2571] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:48.316313 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884baf0-2c9d-43bb-bdd7-0dfe564555be None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:48.316601 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884baf0-2c9d-43bb-bdd7-0dfe564555be None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:48.316875 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884baf0-2c9d-43bb-bdd7-0dfe564555be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:48.337050 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-8884baf0-2c9d-43bb-bdd7-0dfe564555be None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:48.338256 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-8884baf0-2c9d-43bb-bdd7-0dfe564555be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:48.346609 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1286/2572] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:49:48.350832 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884baf0-2c9d-43bb-bdd7-0dfe564555be None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:48.356034 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1287/2573] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:49:48 2022] POST /identity/v3/users => generated 292 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:49:48.363014 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a6bbc-8631-4780-9a7a-6106ecef1253 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:48.364794 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-801a6bbc-8631-4780-9a7a-6106ecef1253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:48.365874 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884baf0-2c9d-43bb-bdd7-0dfe564555be None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:48.372201 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9bb2a4-41e3-4b41-9abb-99173c584900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:48.372201 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bb2a4-41e3-4b41-9abb-99173c584900 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:48.372201 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bb2a4-41e3-4b41-9abb-99173c584900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:48.372201 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bb2a4-41e3-4b41-9abb-99173c584900 admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:48.373095 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9bb2a4-41e3-4b41-9abb-99173c584900 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:49:48.373399 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9bb2a4-41e3-4b41-9abb-99173c584900 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:48.375317 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9bb2a4-41e3-4b41-9abb-99173c584900 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:48.379113 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a6bbc-8631-4780-9a7a-6106ecef1253 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:48.385335 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab29c6a-e57d-481f-b970-1622c3711817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:48.385961 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab29c6a-e57d-481f-b970-1622c3711817 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:48.386325 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab29c6a-e57d-481f-b970-1622c3711817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:48.386626 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab29c6a-e57d-481f-b970-1622c3711817 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:48.387703 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab29c6a-e57d-481f-b970-1622c3711817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:48.389289 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab29c6a-e57d-481f-b970-1622c3711817 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:48.391492 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1287/2574] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:49:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:49:48.392415 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9bb2a4-41e3-4b41-9abb-99173c584900 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:48.404321 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1288/2575] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:49:48.405957 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab29c6a-e57d-481f-b970-1622c3711817 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:48.411843 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9bb2a4-41e3-4b41-9abb-99173c584900 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:48.416423 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab29c6a-e57d-481f-b970-1622c3711817 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:48.416612 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f0d00-59e3-49c7-93cf-4b3f1a2cde81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:48.417225 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f0d00-59e3-49c7-93cf-4b3f1a2cde81 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:48.417503 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f0d00-59e3-49c7-93cf-4b3f1a2cde81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:48.417775 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f0d00-59e3-49c7-93cf-4b3f1a2cde81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:48.418414 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577f0d00-59e3-49c7-93cf-4b3f1a2cde81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:48.421069 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577f0d00-59e3-49c7-93cf-4b3f1a2cde81 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:48.425276 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb09bf-16a6-40c2-9023-9cf08f1eb25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:48.425893 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb09bf-16a6-40c2-9023-9cf08f1eb25f admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:48.426169 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb09bf-16a6-40c2-9023-9cf08f1eb25f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:48.426437 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb09bf-16a6-40c2-9023-9cf08f1eb25f admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:48.427167 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eb09bf-16a6-40c2-9023-9cf08f1eb25f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:48.430186 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eb09bf-16a6-40c2-9023-9cf08f1eb25f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:48.448492 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1289/2576] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:49:48.451233 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb09bf-16a6-40c2-9023-9cf08f1eb25f admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:48.461832 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb09bf-16a6-40c2-9023-9cf08f1eb25f admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:48.467212 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c04fc5-c97b-4179-acb2-0a821ef81245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:48.467967 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c04fc5-c97b-4179-acb2-0a821ef81245 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:48.468338 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c04fc5-c97b-4179-acb2-0a821ef81245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:48.468678 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c04fc5-c97b-4179-acb2-0a821ef81245 admin admin] PATH_INFO: `/v3/projects/13353d5e4f70440896f319bfa65886b6/users/6dac24a64da543a59efda47758fa798a/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:48.485054 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c04fc5-c97b-4179-acb2-0a821ef81245 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13353d5e4f70440896f319bfa65886b6, user_id=6dac24a64da543a59efda47758fa798a, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:48.487910 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c04fc5-c97b-4179-acb2-0a821ef81245 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:48.567994 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1288/2577] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:49:48 2022] POST /identity/v3/projects => generated 373 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:49:48.569062 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f0d00-59e3-49c7-93cf-4b3f1a2cde81 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:48.593009 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1290/2578] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:49:48 2022] PUT /identity/v3/projects/13353d5e4f70440896f319bfa65886b6/users/6dac24a64da543a59efda47758fa798a/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:49:48.604562 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94274bb5-72e4-4cd1-bb84-ca51f33263d0 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:48.604832 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94274bb5-72e4-4cd1-bb84-ca51f33263d0 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:48.605179 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94274bb5-72e4-4cd1-bb84-ca51f33263d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:48.610999 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:48.651995 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-94274bb5-72e4-4cd1-bb84-ca51f33263d0 None None] MFA Rules not processed for user `6dac24a64da543a59efda47758fa798a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:48.653832 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-94274bb5-72e4-4cd1-bb84-ca51f33263d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:48.676426 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f0d00-59e3-49c7-93cf-4b3f1a2cde81 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:48.744548 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1291/2579] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:49:48.750290 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf9d4e-cdd8-48c8-bee1-284ecc6bd1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:48.751061 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf9d4e-cdd8-48c8-bee1-284ecc6bd1d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:48.751784 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf9d4e-cdd8-48c8-bee1-284ecc6bd1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:48.751784 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf9d4e-cdd8-48c8-bee1-284ecc6bd1d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:48.753528 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf9d4e-cdd8-48c8-bee1-284ecc6bd1d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:48.754888 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf9d4e-cdd8-48c8-bee1-284ecc6bd1d0 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:48.762991 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94274bb5-72e4-4cd1-bb84-ca51f33263d0 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:48.764436 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-94274bb5-72e4-4cd1-bb84-ca51f33263d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:48.813984 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:48.829364 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94274bb5-72e4-4cd1-bb84-ca51f33263d0 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:48.833086 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585a52d-45d2-4d16-9da0-9488e878d6b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:48.833695 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585a52d-45d2-4d16-9da0-9488e878d6b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:48.833970 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585a52d-45d2-4d16-9da0-9488e878d6b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:48.834236 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585a52d-45d2-4d16-9da0-9488e878d6b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:48.846962 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8585a52d-45d2-4d16-9da0-9488e878d6b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:48.848506 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8585a52d-45d2-4d16-9da0-9488e878d6b3 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:48.859379 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1292/2580] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:49:48.881326 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585a52d-45d2-4d16-9da0-9488e878d6b3 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:48.896310 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1289/2581] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:49:48 2022] POST /identity/v3/users => generated 287 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:49:48.896971 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585a52d-45d2-4d16-9da0-9488e878d6b3 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:48.897543 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf9d4e-cdd8-48c8-bee1-284ecc6bd1d0 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:48.907752 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae465e7-2267-4f19-92ff-8450903fcb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:48.909012 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae465e7-2267-4f19-92ff-8450903fcb3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:48.909460 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae465e7-2267-4f19-92ff-8450903fcb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:48.909745 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae465e7-2267-4f19-92ff-8450903fcb3b admin admin] PATH_INFO: `/v3/users/6dac24a64da543a59efda47758fa798a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:48.911225 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf9d4e-cdd8-48c8-bee1-284ecc6bd1d0 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:48.911389 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae465e7-2267-4f19-92ff-8450903fcb3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dac24a64da543a59efda47758fa798a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:48.913262 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae465e7-2267-4f19-92ff-8450903fcb3b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:48.917717 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088c544-9f84-47d8-a3f5-030eaa02546b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:48.918452 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088c544-9f84-47d8-a3f5-030eaa02546b admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:48.927448 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088c544-9f84-47d8-a3f5-030eaa02546b admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:48.941046 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088c544-9f84-47d8-a3f5-030eaa02546b admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:48.942093 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c088c544-9f84-47d8-a3f5-030eaa02546b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:48.946928 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c088c544-9f84-47d8-a3f5-030eaa02546b admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:48.959501 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1290/2582] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:49:48.963604 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088c544-9f84-47d8-a3f5-030eaa02546b admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:48.974147 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088c544-9f84-47d8-a3f5-030eaa02546b admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:48.978889 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b44215-f9d1-4a5c-903c-6ee97880f332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:48.979475 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b44215-f9d1-4a5c-903c-6ee97880f332 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:48.979752 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b44215-f9d1-4a5c-903c-6ee97880f332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:48.980025 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b44215-f9d1-4a5c-903c-6ee97880f332 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:48.980687 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b44215-f9d1-4a5c-903c-6ee97880f332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:48.982366 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b44215-f9d1-4a5c-903c-6ee97880f332 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:48.992868 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1291/2583] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:49:48.997004 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b44215-f9d1-4a5c-903c-6ee97880f332 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:49.007092 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b44215-f9d1-4a5c-903c-6ee97880f332 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:49.014877 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073c299-fde2-47a8-a67d-51bfd5282950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:49.015786 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073c299-fde2-47a8-a67d-51bfd5282950 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:49.016112 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073c299-fde2-47a8-a67d-51bfd5282950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:49.017203 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073c299-fde2-47a8-a67d-51bfd5282950 admin admin] PATH_INFO: `/v3/projects/699302edb9b9416188eef821068a1d79/users/ddb94cf89eaf4d9d93ef8c885dfa71dc/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:49.035668 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6073c299-fde2-47a8-a67d-51bfd5282950 admin admin] RBAC: Authorizing `identity:create_grant(project_id=699302edb9b9416188eef821068a1d79, user_id=ddb94cf89eaf4d9d93ef8c885dfa71dc, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:49.041981 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6073c299-fde2-47a8-a67d-51bfd5282950 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:49.139877 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1292/2584] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:49:48 2022] PUT /identity/v3/projects/699302edb9b9416188eef821068a1d79/users/ddb94cf89eaf4d9d93ef8c885dfa71dc/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:49:49.147054 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810f7a9-5852-4e89-a568-c2964b4a2628 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:49.147335 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810f7a9-5852-4e89-a568-c2964b4a2628 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:49.147611 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810f7a9-5852-4e89-a568-c2964b4a2628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:49.162812 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-9ae465e7-2267-4f19-92ff-8450903fcb3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dac24a64da543a59efda47758fa798a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:49.174334 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-d810f7a9-5852-4e89-a568-c2964b4a2628 None None] MFA Rules not processed for user `040337d14e044fc6afe740fe1293418f`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:49.175570 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-d810f7a9-5852-4e89-a568-c2964b4a2628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:49.178235 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-9ae465e7-2267-4f19-92ff-8450903fcb3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dac24a64da543a59efda47758fa798a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:49.179730 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-9ae465e7-2267-4f19-92ff-8450903fcb3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dac24a64da543a59efda47758fa798a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:49.189610 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-9ae465e7-2267-4f19-92ff-8450903fcb3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dac24a64da543a59efda47758fa798a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:49.190370 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-9ae465e7-2267-4f19-92ff-8450903fcb3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dac24a64da543a59efda47758fa798a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:49.233564 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1293/2585] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:49.234691 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986695a-e797-4d52-8719-738cc1bd0030 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:49.234975 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986695a-e797-4d52-8719-738cc1bd0030 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:49.235249 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986695a-e797-4d52-8719-738cc1bd0030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:49.257567 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1293/2586] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:49:48 2022] DELETE /identity/v3/users/6dac24a64da543a59efda47758fa798a => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:49.260505 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a00b7-789b-473b-9c7f-cdb586407fe5 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:49.261850 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a00b7-789b-473b-9c7f-cdb586407fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:49.264732 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a00b7-789b-473b-9c7f-cdb586407fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:49.272926 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-e986695a-e797-4d52-8719-738cc1bd0030 None None] MFA Rules not processed for user `ddb94cf89eaf4d9d93ef8c885dfa71dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:49.274505 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e986695a-e797-4d52-8719-738cc1bd0030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:49.298926 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-675a00b7-789b-473b-9c7f-cdb586407fe5 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:49.300209 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-675a00b7-789b-473b-9c7f-cdb586407fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:49.384559 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1294/2587] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:49.402632 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986695a-e797-4d52-8719-738cc1bd0030 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:49.402632 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e986695a-e797-4d52-8719-738cc1bd0030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:49.445747 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1294/2588] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:49.457345 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a00b7-789b-473b-9c7f-cdb586407fe5 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:49.460301 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-675a00b7-789b-473b-9c7f-cdb586407fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:49.491385 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986695a-e797-4d52-8719-738cc1bd0030 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:49.496856 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a846d0c-8ec3-42b5-b7c1-26082b937706 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:49.498572 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a846d0c-8ec3-42b5-b7c1-26082b937706 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:49.499197 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a846d0c-8ec3-42b5-b7c1-26082b937706 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:49.499559 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a846d0c-8ec3-42b5-b7c1-26082b937706 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:49.512209 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a846d0c-8ec3-42b5-b7c1-26082b937706 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:49.515856 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a846d0c-8ec3-42b5-b7c1-26082b937706 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:49.533416 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1295/2589] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:49:49.534998 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a00b7-789b-473b-9c7f-cdb586407fe5 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:49.539610 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43abee-b533-4612-b25d-001d3775684e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:49.540474 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43abee-b533-4612-b25d-001d3775684e service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:49.540744 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43abee-b533-4612-b25d-001d3775684e service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:49.541177 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43abee-b533-4612-b25d-001d3775684e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:49.554729 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:49.557088 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d43abee-b533-4612-b25d-001d3775684e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:49.558826 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d43abee-b533-4612-b25d-001d3775684e service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:49.571469 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1295/2590] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:49:49.638499 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:50.041997 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a846d0c-8ec3-42b5-b7c1-26082b937706 service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:50.043739 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-0a846d0c-8ec3-42b5-b7c1-26082b937706 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:50.059832 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a846d0c-8ec3-42b5-b7c1-26082b937706 service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:50.065620 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05dc2b1-646d-4c34-ab27-868d8f3ec68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:50.066319 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05dc2b1-646d-4c34-ab27-868d8f3ec68a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:50.066514 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05dc2b1-646d-4c34-ab27-868d8f3ec68a admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:50.066784 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05dc2b1-646d-4c34-ab27-868d8f3ec68a admin admin] PATH_INFO: `/v3/projects/13353d5e4f70440896f319bfa65886b6` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:50.068135 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05dc2b1-646d-4c34-ab27-868d8f3ec68a admin admin] RBAC: Authorizing `identity:delete_project(project_id=13353d5e4f70440896f319bfa65886b6)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:50.069985 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05dc2b1-646d-4c34-ab27-868d8f3ec68a admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:50.182873 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b05dc2b1-646d-4c34-ab27-868d8f3ec68a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13353d5e4f70440896f319bfa65886b6', 'request_id': 'req-b05dc2b1-646d-4c34-ab27-868d8f3ec68a'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:50.190911 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b05dc2b1-646d-4c34-ab27-868d8f3ec68a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13353d5e4f70440896f319bfa65886b6', 'request_id': 'req-b05dc2b1-646d-4c34-ab27-868d8f3ec68a'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:50.196691 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b05dc2b1-646d-4c34-ab27-868d8f3ec68a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13353d5e4f70440896f319bfa65886b6', 'request_id': 'req-b05dc2b1-646d-4c34-ab27-868d8f3ec68a'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:50.293070 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b05dc2b1-646d-4c34-ab27-868d8f3ec68a admin admin] The token cache is being invalidate because project 13353d5e4f70440896f319bfa65886b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:49:50.293367 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b05dc2b1-646d-4c34-ab27-868d8f3ec68a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:50.294599 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b05dc2b1-646d-4c34-ab27-868d8f3ec68a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:50.297829 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1296/2591] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:49:50 2022] DELETE /identity/v3/projects/13353d5e4f70440896f319bfa65886b6 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:53.845658 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43abee-b533-4612-b25d-001d3775684e service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:53.847524 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5d43abee-b533-4612-b25d-001d3775684e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:53.860951 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43abee-b533-4612-b25d-001d3775684e service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:53.917781 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45ba1c-1319-4d57-936f-e5e682795d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:53.918425 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45ba1c-1319-4d57-936f-e5e682795d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:53.918685 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45ba1c-1319-4d57-936f-e5e682795d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:53.919522 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45ba1c-1319-4d57-936f-e5e682795d66 admin admin] PATH_INFO: `/v3/users/ddb94cf89eaf4d9d93ef8c885dfa71dc` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:53.920663 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f45ba1c-1319-4d57-936f-e5e682795d66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddb94cf89eaf4d9d93ef8c885dfa71dc)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:53.922590 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f45ba1c-1319-4d57-936f-e5e682795d66 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:54.105979 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0f45ba1c-1319-4d57-936f-e5e682795d66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddb94cf89eaf4d9d93ef8c885dfa71dc'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:54.118032 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0f45ba1c-1319-4d57-936f-e5e682795d66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddb94cf89eaf4d9d93ef8c885dfa71dc'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:54.118783 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0f45ba1c-1319-4d57-936f-e5e682795d66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddb94cf89eaf4d9d93ef8c885dfa71dc'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:54.125866 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0f45ba1c-1319-4d57-936f-e5e682795d66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddb94cf89eaf4d9d93ef8c885dfa71dc'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:54.126500 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0f45ba1c-1319-4d57-936f-e5e682795d66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddb94cf89eaf4d9d93ef8c885dfa71dc'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:54.206521 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1296/2592] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:49:53 2022] DELETE /identity/v3/users/ddb94cf89eaf4d9d93ef8c885dfa71dc => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:49:54.211003 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ffda5-bdc6-43af-a706-5999abe8b32b None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:54.211456 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ffda5-bdc6-43af-a706-5999abe8b32b None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:54.211557 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ffda5-bdc6-43af-a706-5999abe8b32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:54.234116 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-a52ffda5-bdc6-43af-a706-5999abe8b32b None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:54.235991 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a52ffda5-bdc6-43af-a706-5999abe8b32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:54.250080 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:54.297083 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1297/2593] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:54.306764 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45ba1c-1319-4d57-936f-e5e682795d66 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:54.308210 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0f45ba1c-1319-4d57-936f-e5e682795d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:54.367916 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45ba1c-1319-4d57-936f-e5e682795d66 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:54.371490 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0061d5b-1cb9-4875-bcd1-c056099d60b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:54.372662 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0061d5b-1cb9-4875-bcd1-c056099d60b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:54.372941 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0061d5b-1cb9-4875-bcd1-c056099d60b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:54.373215 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0061d5b-1cb9-4875-bcd1-c056099d60b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:54.382398 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0061d5b-1cb9-4875-bcd1-c056099d60b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:54.383824 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0061d5b-1cb9-4875-bcd1-c056099d60b8 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:54.394014 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1297/2594] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:49:54.836838 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ffda5-bdc6-43af-a706-5999abe8b32b None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:54.838264 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a52ffda5-bdc6-43af-a706-5999abe8b32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:54.850714 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ffda5-bdc6-43af-a706-5999abe8b32b None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:54.855438 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b30dfd-80bf-421e-95c4-1c4a0a7ae4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:54.856092 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b30dfd-80bf-421e-95c4-1c4a0a7ae4c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:54.856917 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b30dfd-80bf-421e-95c4-1c4a0a7ae4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:54.857287 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b30dfd-80bf-421e-95c4-1c4a0a7ae4c6 admin admin] PATH_INFO: `/v3/projects/699302edb9b9416188eef821068a1d79` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:54.858385 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b30dfd-80bf-421e-95c4-1c4a0a7ae4c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=699302edb9b9416188eef821068a1d79)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:54.860351 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b30dfd-80bf-421e-95c4-1c4a0a7ae4c6 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:54.971672 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-59b30dfd-80bf-421e-95c4-1c4a0a7ae4c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '699302edb9b9416188eef821068a1d79', 'request_id': 'req-59b30dfd-80bf-421e-95c4-1c4a0a7ae4c6'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:54.978688 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-59b30dfd-80bf-421e-95c4-1c4a0a7ae4c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '699302edb9b9416188eef821068a1d79', 'request_id': 'req-59b30dfd-80bf-421e-95c4-1c4a0a7ae4c6'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:54.984513 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-59b30dfd-80bf-421e-95c4-1c4a0a7ae4c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '699302edb9b9416188eef821068a1d79', 'request_id': 'req-59b30dfd-80bf-421e-95c4-1c4a0a7ae4c6'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:55.058822 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-59b30dfd-80bf-421e-95c4-1c4a0a7ae4c6 admin admin] The token cache is being invalidate because project 699302edb9b9416188eef821068a1d79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:49:55.059113 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-59b30dfd-80bf-421e-95c4-1c4a0a7ae4c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:55.060314 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-59b30dfd-80bf-421e-95c4-1c4a0a7ae4c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:55.061814 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1298/2595] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:49:54 2022] DELETE /identity/v3/projects/699302edb9b9416188eef821068a1d79 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:55.066767 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413053e8-1470-4ba7-997f-801c123d3d75 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:55.067258 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413053e8-1470-4ba7-997f-801c123d3d75 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:55.067358 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413053e8-1470-4ba7-997f-801c123d3d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:55.087357 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-413053e8-1470-4ba7-997f-801c123d3d75 None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:55.088577 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-413053e8-1470-4ba7-997f-801c123d3d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:55.100520 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:55.154636 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1298/2596] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:55.162846 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf665d-2a43-481d-afcf-42e528ee533f None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:55.163132 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf665d-2a43-481d-afcf-42e528ee533f None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:55.163410 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf665d-2a43-481d-afcf-42e528ee533f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:55.184275 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-7adf665d-2a43-481d-afcf-42e528ee533f None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:55.186264 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-7adf665d-2a43-481d-afcf-42e528ee533f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:55.194089 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1299/2597] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:55.198464 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413053e8-1470-4ba7-997f-801c123d3d75 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:55.208884 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413053e8-1470-4ba7-997f-801c123d3d75 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:55.213446 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ab2a1-cea1-4e71-9c68-1188b864ce54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:55.214037 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ab2a1-cea1-4e71-9c68-1188b864ce54 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:55.214315 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ab2a1-cea1-4e71-9c68-1188b864ce54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:55.214584 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ab2a1-cea1-4e71-9c68-1188b864ce54 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:55.215221 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ab2a1-cea1-4e71-9c68-1188b864ce54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:49:55.215519 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ab2a1-cea1-4e71-9c68-1188b864ce54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:55.217240 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ab2a1-cea1-4e71-9c68-1188b864ce54 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:55.228592 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1299/2598] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Nov 2 07:49:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:49:55.233014 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf665d-2a43-481d-afcf-42e528ee533f None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:55.242151 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf665d-2a43-481d-afcf-42e528ee533f None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:55.248743 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0186ad-e32b-4e34-a773-c44e4b63f723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:55.249374 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0186ad-e32b-4e34-a773-c44e4b63f723 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:55.249660 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0186ad-e32b-4e34-a773-c44e4b63f723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:55.249938 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0186ad-e32b-4e34-a773-c44e4b63f723 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:55.250603 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0186ad-e32b-4e34-a773-c44e4b63f723 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:55.252565 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0186ad-e32b-4e34-a773-c44e4b63f723 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:55.373821 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1300/2599] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Nov 2 07:49:55 2022] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:49:55.377664 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ab2a1-cea1-4e71-9c68-1188b864ce54 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:55.388197 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ab2a1-cea1-4e71-9c68-1188b864ce54 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:55.444061 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611608d-a911-4e0a-a7a8-b6d2ffa0b66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:55.444795 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611608d-a911-4e0a-a7a8-b6d2ffa0b66b admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:55.445121 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611608d-a911-4e0a-a7a8-b6d2ffa0b66b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:55.445400 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611608d-a911-4e0a-a7a8-b6d2ffa0b66b admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:55.446089 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611608d-a911-4e0a-a7a8-b6d2ffa0b66b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:55.448167 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611608d-a911-4e0a-a7a8-b6d2ffa0b66b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:55.532718 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1300/2600] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Nov 2 07:49:55 2022] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:49:55.538886 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0186ad-e32b-4e34-a773-c44e4b63f723 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:55.551009 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0186ad-e32b-4e34-a773-c44e4b63f723 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:55.555941 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20370b8d-ea1d-4395-acd8-fb5ba5834a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:55.556574 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20370b8d-ea1d-4395-acd8-fb5ba5834a9c admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:55.556852 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20370b8d-ea1d-4395-acd8-fb5ba5834a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:55.557124 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20370b8d-ea1d-4395-acd8-fb5ba5834a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:55.557757 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20370b8d-ea1d-4395-acd8-fb5ba5834a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:55.559346 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20370b8d-ea1d-4395-acd8-fb5ba5834a9c admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:55.571599 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1301/2601] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:49:55.575946 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611608d-a911-4e0a-a7a8-b6d2ffa0b66b admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:55.586197 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611608d-a911-4e0a-a7a8-b6d2ffa0b66b admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:55.590943 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd75ecac-4512-46ff-b0d9-49ea6197e391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:55.591536 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75ecac-4512-46ff-b0d9-49ea6197e391 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:55.591811 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75ecac-4512-46ff-b0d9-49ea6197e391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:55.592111 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75ecac-4512-46ff-b0d9-49ea6197e391 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:55.592769 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd75ecac-4512-46ff-b0d9-49ea6197e391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:55.594358 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd75ecac-4512-46ff-b0d9-49ea6197e391 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:55.604801 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1301/2602] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:49:55.609403 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20370b8d-ea1d-4395-acd8-fb5ba5834a9c admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:55.619025 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20370b8d-ea1d-4395-acd8-fb5ba5834a9c admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:55.624318 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bdd047-5f35-46f2-9ca6-652e51e414fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:55.624952 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bdd047-5f35-46f2-9ca6-652e51e414fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:55.625229 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bdd047-5f35-46f2-9ca6-652e51e414fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:55.625497 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bdd047-5f35-46f2-9ca6-652e51e414fe admin admin] PATH_INFO: `/v3/projects/521d4507292b422a91fa7899aaad1a8b/users/ecc1357303524d4aa0aafdebbdd00162/roles/c80de80e56e34e6caa3c27dcec321efd` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:55.643277 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bdd047-5f35-46f2-9ca6-652e51e414fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=521d4507292b422a91fa7899aaad1a8b, user_id=ecc1357303524d4aa0aafdebbdd00162, role_id=c80de80e56e34e6caa3c27dcec321efd)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:55.646218 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bdd047-5f35-46f2-9ca6-652e51e414fe admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:55.721395 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1302/2603] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Nov 2 07:49:55 2022] PUT /identity/v3/projects/521d4507292b422a91fa7899aaad1a8b/users/ecc1357303524d4aa0aafdebbdd00162/roles/c80de80e56e34e6caa3c27dcec321efd => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:49:55.733077 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff6685-f79c-4022-80c9-4732f2c657b5 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:55.733438 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff6685-f79c-4022-80c9-4732f2c657b5 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:55.733715 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff6685-f79c-4022-80c9-4732f2c657b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:55.764492 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-6aff6685-f79c-4022-80c9-4732f2c657b5 None None] MFA Rules not processed for user `ecc1357303524d4aa0aafdebbdd00162`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:55.765616 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6aff6685-f79c-4022-80c9-4732f2c657b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:55.835054 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1302/2604] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:49:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:55.846280 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bdd047-5f35-46f2-9ca6-652e51e414fe admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:55.847977 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-b1bdd047-5f35-46f2-9ca6-652e51e414fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:55.891084 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:55.904863 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bdd047-5f35-46f2-9ca6-652e51e414fe admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:55.908633 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de3d19-47ab-4e3d-a224-fe81833b27a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c09b7eff03645ab9b7252ea96543719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:55.909231 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de3d19-47ab-4e3d-a224-fe81833b27a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:55.909513 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de3d19-47ab-4e3d-a224-fe81833b27a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:55.909781 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de3d19-47ab-4e3d-a224-fe81833b27a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:55.918117 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de3d19-47ab-4e3d-a224-fe81833b27a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:55.920353 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de3d19-47ab-4e3d-a224-fe81833b27a3 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:55.930101 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1303/2605] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:50:05.831631 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=91,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:06.001096 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=8 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:06.543555 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff6685-f79c-4022-80c9-4732f2c657b5 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:06.543750 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6aff6685-f79c-4022-80c9-4732f2c657b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:06.641108 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff6685-f79c-4022-80c9-4732f2c657b5 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:06.646293 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59935739-8d09-41f1-b921-133db2a7c665 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '741c9fc71c80438faa037c85f4997c3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:06.651693 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59935739-8d09-41f1-b921-133db2a7c665 service placement] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:06.651693 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59935739-8d09-41f1-b921-133db2a7c665 service placement] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:06.651693 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59935739-8d09-41f1-b921-133db2a7c665 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:06.651693 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-59935739-8d09-41f1-b921-133db2a7c665 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:06.660954 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59935739-8d09-41f1-b921-133db2a7c665 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:06.662541 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59935739-8d09-41f1-b921-133db2a7c665 service placement] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:06.672865 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1303/2606] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:50:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:50:07.669639 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de3d19-47ab-4e3d-a224-fe81833b27a3 service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:07.734217 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de3d19-47ab-4e3d-a224-fe81833b27a3 service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:07.739424 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984d7fb-f655-4167-9532-26626af51d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:07.740080 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984d7fb-f655-4167-9532-26626af51d74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:07.740351 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984d7fb-f655-4167-9532-26626af51d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:07.740622 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984d7fb-f655-4167-9532-26626af51d74 admin admin] PATH_INFO: `/v3/users/ecc1357303524d4aa0aafdebbdd00162` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:07.741819 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3984d7fb-f655-4167-9532-26626af51d74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecc1357303524d4aa0aafdebbdd00162)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:07.743885 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3984d7fb-f655-4167-9532-26626af51d74 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:07.948978 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-3984d7fb-f655-4167-9532-26626af51d74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecc1357303524d4aa0aafdebbdd00162'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:07.964687 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-3984d7fb-f655-4167-9532-26626af51d74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecc1357303524d4aa0aafdebbdd00162'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:07.973189 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-3984d7fb-f655-4167-9532-26626af51d74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecc1357303524d4aa0aafdebbdd00162'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:07.973770 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-3984d7fb-f655-4167-9532-26626af51d74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecc1357303524d4aa0aafdebbdd00162'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:07.974424 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-3984d7fb-f655-4167-9532-26626af51d74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecc1357303524d4aa0aafdebbdd00162'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:08.040972 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1304/2607] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:50:07 2022] DELETE /identity/v3/users/ecc1357303524d4aa0aafdebbdd00162 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:50:08.045912 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabeaa58-434a-4a0a-87f4-0a5f8344a5ae None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:08.046362 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabeaa58-434a-4a0a-87f4-0a5f8344a5ae None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:08.046362 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabeaa58-434a-4a0a-87f4-0a5f8344a5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:08.066705 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-cabeaa58-434a-4a0a-87f4-0a5f8344a5ae None None] MFA Rules not processed for user `7738e47cbf7c4d698504a795d02c194a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:50:08.067912 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-cabeaa58-434a-4a0a-87f4-0a5f8344a5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:08.130648 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1304/2608] 10.222.0.16 () {58 vars in 958 bytes} [Wed Nov 2 07:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:50:08.141993 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984d7fb-f655-4167-9532-26626af51d74 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:08.145604 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-3984d7fb-f655-4167-9532-26626af51d74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:08.201780 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984d7fb-f655-4167-9532-26626af51d74 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:08.206063 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492d453-fc74-4b6a-81c6-b3f4086b24e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:08.206672 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492d453-fc74-4b6a-81c6-b3f4086b24e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:08.206950 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492d453-fc74-4b6a-81c6-b3f4086b24e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:08.207220 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492d453-fc74-4b6a-81c6-b3f4086b24e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:08.217179 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7492d453-fc74-4b6a-81c6-b3f4086b24e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:08.219343 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7492d453-fc74-4b6a-81c6-b3f4086b24e2 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:08.229516 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1305/2609] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:50:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:50:08.746491 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabeaa58-434a-4a0a-87f4-0a5f8344a5ae None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:08.748028 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-cabeaa58-434a-4a0a-87f4-0a5f8344a5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:08.766688 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabeaa58-434a-4a0a-87f4-0a5f8344a5ae None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:08.776909 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b18d0-0436-490d-b92a-c91caed21c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:08.779502 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b18d0-0436-490d-b92a-c91caed21c0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:08.779502 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b18d0-0436-490d-b92a-c91caed21c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:08.779502 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b18d0-0436-490d-b92a-c91caed21c0b admin admin] PATH_INFO: `/v3/projects/521d4507292b422a91fa7899aaad1a8b` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:08.780454 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6b18d0-0436-490d-b92a-c91caed21c0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=521d4507292b422a91fa7899aaad1a8b)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:08.784532 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6b18d0-0436-490d-b92a-c91caed21c0b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:08.905614 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-5f6b18d0-0436-490d-b92a-c91caed21c0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '521d4507292b422a91fa7899aaad1a8b', 'request_id': 'req-5f6b18d0-0436-490d-b92a-c91caed21c0b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:08.911642 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-5f6b18d0-0436-490d-b92a-c91caed21c0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '521d4507292b422a91fa7899aaad1a8b', 'request_id': 'req-5f6b18d0-0436-490d-b92a-c91caed21c0b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:08.918121 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-5f6b18d0-0436-490d-b92a-c91caed21c0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '521d4507292b422a91fa7899aaad1a8b', 'request_id': 'req-5f6b18d0-0436-490d-b92a-c91caed21c0b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:08.922215 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:09.023534 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-5f6b18d0-0436-490d-b92a-c91caed21c0b admin admin] The token cache is being invalidate because project 521d4507292b422a91fa7899aaad1a8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:50:09.023762 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-5f6b18d0-0436-490d-b92a-c91caed21c0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:09.024392 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-5f6b18d0-0436-490d-b92a-c91caed21c0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:09.025959 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1305/2610] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:50:08 2022] DELETE /identity/v3/projects/521d4507292b422a91fa7899aaad1a8b => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:50:18.032971 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492d453-fc74-4b6a-81c6-b3f4086b24e2 service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:18.034462 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-7492d453-fc74-4b6a-81c6-b3f4086b24e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:18.045974 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492d453-fc74-4b6a-81c6-b3f4086b24e2 service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:18.063725 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:18.094588 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b2d92-f4a0-4c17-b236-79e578078893 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:18.095221 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b2d92-f4a0-4c17-b236-79e578078893 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:18.095723 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b2d92-f4a0-4c17-b236-79e578078893 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:18.096243 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b2d92-f4a0-4c17-b236-79e578078893 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:18.098401 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-364b2d92-f4a0-4c17-b236-79e578078893 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:18.161830 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b2d92-f4a0-4c17-b236-79e578078893 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:18.163238 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b2d92-f4a0-4c17-b236-79e578078893 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:18.173326 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1306/2611] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:50:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:50:19.159087 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:DELETE=1,keystone:SELECT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:28.195328 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=40 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:52:14.998865 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b18d0-0436-490d-b92a-c91caed21c0b admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:52:15.000368 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5f6b18d0-0436-490d-b92a-c91caed21c0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:52:15.013173 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b18d0-0436-490d-b92a-c91caed21c0b admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:52:15.016813 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f87c00-b152-4e4c-a903-4f8598b74cea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:52:15.022018 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f87c00-b152-4e4c-a903-4f8598b74cea service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:15.022018 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f87c00-b152-4e4c-a903-4f8598b74cea service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:15.022018 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f87c00-b152-4e4c-a903-4f8598b74cea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:15.022018 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d2f87c00-b152-4e4c-a903-4f8598b74cea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:52:15.092731 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f87c00-b152-4e4c-a903-4f8598b74cea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:52:15.094167 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f87c00-b152-4e4c-a903-4f8598b74cea service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:52:15.105085 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1306/2612] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:52:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:52:16.294855 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b2d92-f4a0-4c17-b236-79e578078893 service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:52:16.296940 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-364b2d92-f4a0-4c17-b236-79e578078893 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:52:16.307116 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b2d92-f4a0-4c17-b236-79e578078893 service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:52:16.310670 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be049a47-b3df-49df-bfef-91e5e1912d47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:52:16.311279 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be049a47-b3df-49df-bfef-91e5e1912d47 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:16.311527 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be049a47-b3df-49df-bfef-91e5e1912d47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:16.311793 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be049a47-b3df-49df-bfef-91e5e1912d47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:16.313450 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-be049a47-b3df-49df-bfef-91e5e1912d47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:52:16.326781 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be049a47-b3df-49df-bfef-91e5e1912d47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:52:16.328209 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be049a47-b3df-49df-bfef-91e5e1912d47 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:52:16.339533 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1307/2613] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:52:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:52:17.215295 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f87c00-b152-4e4c-a903-4f8598b74cea service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:52:17.224792 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f87c00-b152-4e4c-a903-4f8598b74cea service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:52:17.228516 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78196ba-1b19-49d3-ae2d-9833f7873963 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:52:17.229111 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78196ba-1b19-49d3-ae2d-9833f7873963 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:17.229389 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78196ba-1b19-49d3-ae2d-9833f7873963 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:17.229662 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78196ba-1b19-49d3-ae2d-9833f7873963 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:17.231406 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a78196ba-1b19-49d3-ae2d-9833f7873963 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:52:17.241660 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78196ba-1b19-49d3-ae2d-9833f7873963 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:52:17.243104 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78196ba-1b19-49d3-ae2d-9833f7873963 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:52:17.251128 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1307/2614] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:52:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:52:26.334643 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=6 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:52:27.247432 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=40 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:52:28.266783 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be049a47-b3df-49df-bfef-91e5e1912d47 service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:52:28.275457 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be049a47-b3df-49df-bfef-91e5e1912d47 service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:52:28.279101 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a337a144-06c6-40b1-8e51-96625ab6195f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:52:28.279699 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337a144-06c6-40b1-8e51-96625ab6195f service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:28.279985 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337a144-06c6-40b1-8e51-96625ab6195f service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:28.280292 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337a144-06c6-40b1-8e51-96625ab6195f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:28.281963 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a337a144-06c6-40b1-8e51-96625ab6195f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:52:28.292206 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a337a144-06c6-40b1-8e51-96625ab6195f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:52:28.293597 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a337a144-06c6-40b1-8e51-96625ab6195f service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:52:28.302149 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1308/2615] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:52:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:52:28.803094 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78196ba-1b19-49d3-ae2d-9833f7873963 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:52:28.814887 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78196ba-1b19-49d3-ae2d-9833f7873963 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:52:28.820508 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd76ef-3f97-4c49-b3ae-9a342744c49f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:52:28.821137 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd76ef-3f97-4c49-b3ae-9a342744c49f service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:28.821616 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd76ef-3f97-4c49-b3ae-9a342744c49f service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:28.821874 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd76ef-3f97-4c49-b3ae-9a342744c49f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:28.824087 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d9dd76ef-3f97-4c49-b3ae-9a342744c49f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:52:28.839424 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd76ef-3f97-4c49-b3ae-9a342744c49f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:52:28.840868 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd76ef-3f97-4c49-b3ae-9a342744c49f service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:52:28.850511 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1308/2616] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:52:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:52:28.929780 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de5b3a-2059-4acc-8d17-c8c88283e793 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:28.930073 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de5b3a-2059-4acc-8d17-c8c88283e793 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:28.930352 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de5b3a-2059-4acc-8d17-c8c88283e793 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:28.931697 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1309/2617] 10.222.0.16 () {54 vars in 921 bytes} [Wed Nov 2 07:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:52:28.937113 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3067f-3322-4b50-9479-c20537282cb0 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:28.937466 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3067f-3322-4b50-9479-c20537282cb0 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:28.937806 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3067f-3322-4b50-9479-c20537282cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:28.976905 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-b0d3067f-3322-4b50-9479-c20537282cb0 None None] MFA Rules not processed for user `232210eabdfd4969a348d7333c50c438`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:52:28.978140 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b0d3067f-3322-4b50-9479-c20537282cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:52:28.989185 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1309/2618] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Nov 2 07:52:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:52:29.000338 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de5b3a-2059-4acc-8d17-c8c88283e793 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:52:29.012362 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de5b3a-2059-4acc-8d17-c8c88283e793 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:52:29.015934 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac05b597-185f-4400-956a-f7e2279433a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c35fe87fc263440980ce70680748e5af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:52:29.019846 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05b597-185f-4400-956a-f7e2279433a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:29.019846 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05b597-185f-4400-956a-f7e2279433a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:29.019846 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05b597-185f-4400-956a-f7e2279433a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:29.028234 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac05b597-185f-4400-956a-f7e2279433a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:52:29.029716 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac05b597-185f-4400-956a-f7e2279433a5 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:52:29.040844 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1310/2619] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:52:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:52:29.104715 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3067f-3322-4b50-9479-c20537282cb0 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:52:29.106028 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b0d3067f-3322-4b50-9479-c20537282cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:52:29.176262 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3067f-3322-4b50-9479-c20537282cb0 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:52:29.181639 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9b784-d4d5-44fe-9629-55a8f704cf83 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '741c9fc71c80438faa037c85f4997c3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:52:29.182241 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9b784-d4d5-44fe-9629-55a8f704cf83 service placement] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:29.182520 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9b784-d4d5-44fe-9629-55a8f704cf83 service placement] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:29.182789 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9b784-d4d5-44fe-9629-55a8f704cf83 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:29.184546 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-1ce9b784-d4d5-44fe-9629-55a8f704cf83 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:52:29.196942 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9b784-d4d5-44fe-9629-55a8f704cf83 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:52:29.198569 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9b784-d4d5-44fe-9629-55a8f704cf83 service placement] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:52:29.209133 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1310/2620] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:52:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:52:32.272619 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac05b597-185f-4400-956a-f7e2279433a5 service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:52:32.273809 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-ac05b597-185f-4400-956a-f7e2279433a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:52:32.289500 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac05b597-185f-4400-956a-f7e2279433a5 service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:52:32.295293 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991f340-9ece-44a1-98e9-7e820594ec43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:52:32.295907 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991f340-9ece-44a1-98e9-7e820594ec43 service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:32.296219 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991f340-9ece-44a1-98e9-7e820594ec43 service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:32.301370 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991f340-9ece-44a1-98e9-7e820594ec43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:32.301370 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a991f340-9ece-44a1-98e9-7e820594ec43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:52:32.311075 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a991f340-9ece-44a1-98e9-7e820594ec43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:52:32.312906 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a991f340-9ece-44a1-98e9-7e820594ec43 service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:52:32.324807 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1311/2621] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:52:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:52:39.204225 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=47 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:52:42.320150 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=18 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:53:48.002280 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9b784-d4d5-44fe-9629-55a8f704cf83 service placement] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:48.015397 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9b784-d4d5-44fe-9629-55a8f704cf83 service placement] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:48.023253 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d5a2c-c8d1-4628-a7fe-0e58cdb0ff1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232210eabdfd4969a348d7333c50c438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:48.023867 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d5a2c-c8d1-4628-a7fe-0e58cdb0ff1d service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:48.024582 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d5a2c-c8d1-4628-a7fe-0e58cdb0ff1d service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:48.024809 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d5a2c-c8d1-4628-a7fe-0e58cdb0ff1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:48.027829 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e99d5a2c-c8d1-4628-a7fe-0e58cdb0ff1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:48.044199 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d5a2c-c8d1-4628-a7fe-0e58cdb0ff1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:48.051485 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d5a2c-c8d1-4628-a7fe-0e58cdb0ff1d service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:48.058374 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1311/2622] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:53:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:53:58.054045 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=6 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:53:59.019115 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991f340-9ece-44a1-98e9-7e820594ec43 service nova] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:59.030735 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991f340-9ece-44a1-98e9-7e820594ec43 service nova] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:59.036686 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9cf819-b014-4cd2-b3c7-be6e0e00cba2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '741c9fc71c80438faa037c85f4997c3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:59.037235 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cf819-b014-4cd2-b3c7-be6e0e00cba2 service placement] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:59.037577 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cf819-b014-4cd2-b3c7-be6e0e00cba2 service placement] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:59.037853 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cf819-b014-4cd2-b3c7-be6e0e00cba2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:59.039840 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-5d9cf819-b014-4cd2-b3c7-be6e0e00cba2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:59.052617 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9cf819-b014-4cd2-b3c7-be6e0e00cba2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:59.054212 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9cf819-b014-4cd2-b3c7-be6e0e00cba2 service placement] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:59.066018 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1312/2623] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:53:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:54:02.769411 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d5a2c-c8d1-4628-a7fe-0e58cdb0ff1d service nova] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:02.781297 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d5a2c-c8d1-4628-a7fe-0e58cdb0ff1d service nova] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:02.787142 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f180ae-7c5e-41c1-be0c-9bc25a98f1ca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '741c9fc71c80438faa037c85f4997c3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:02.787749 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f180ae-7c5e-41c1-be0c-9bc25a98f1ca service placement] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:02.788171 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f180ae-7c5e-41c1-be0c-9bc25a98f1ca service placement] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:02.788448 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f180ae-7c5e-41c1-be0c-9bc25a98f1ca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:02.791973 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-52f180ae-7c5e-41c1-be0c-9bc25a98f1ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:02.803051 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f180ae-7c5e-41c1-be0c-9bc25a98f1ca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:02.804701 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f180ae-7c5e-41c1-be0c-9bc25a98f1ca service placement] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:02.817402 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1312/2624] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:54:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:54:02.915730 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9cf819-b014-4cd2-b3c7-be6e0e00cba2 service placement] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:02.917275 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-5d9cf819-b014-4cd2-b3c7-be6e0e00cba2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:02.983270 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9cf819-b014-4cd2-b3c7-be6e0e00cba2 service placement] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:02.987818 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56854978-7ba6-4472-aee1-a02974807dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:02.989201 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56854978-7ba6-4472-aee1-a02974807dfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:02.989476 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56854978-7ba6-4472-aee1-a02974807dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:02.989748 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56854978-7ba6-4472-aee1-a02974807dfa admin admin] PATH_INFO: `/v3/users/040337d14e044fc6afe740fe1293418f` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:02.990859 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56854978-7ba6-4472-aee1-a02974807dfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=040337d14e044fc6afe740fe1293418f)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:02.992781 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56854978-7ba6-4472-aee1-a02974807dfa admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:03.173612 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-56854978-7ba6-4472-aee1-a02974807dfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '040337d14e044fc6afe740fe1293418f'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:03.185373 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-56854978-7ba6-4472-aee1-a02974807dfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '040337d14e044fc6afe740fe1293418f'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:03.192075 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-56854978-7ba6-4472-aee1-a02974807dfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '040337d14e044fc6afe740fe1293418f'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:03.192758 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-56854978-7ba6-4472-aee1-a02974807dfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '040337d14e044fc6afe740fe1293418f'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:03.193363 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-56854978-7ba6-4472-aee1-a02974807dfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '040337d14e044fc6afe740fe1293418f'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:03.273276 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1313/2625] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:54:02 2022] DELETE /identity/v3/users/040337d14e044fc6afe740fe1293418f => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:54:03.544771 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f180ae-7c5e-41c1-be0c-9bc25a98f1ca service placement] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:03.561326 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f180ae-7c5e-41c1-be0c-9bc25a98f1ca service placement] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:03.622063 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312eb36-b4b2-4f60-9e11-15826abf868b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:03.622674 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312eb36-b4b2-4f60-9e11-15826abf868b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:03.622946 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312eb36-b4b2-4f60-9e11-15826abf868b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:03.623214 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312eb36-b4b2-4f60-9e11-15826abf868b admin admin] PATH_INFO: `/v3/projects/c0dc8c51819f41f2b84b7ee652537db7` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:03.624583 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312eb36-b4b2-4f60-9e11-15826abf868b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0dc8c51819f41f2b84b7ee652537db7)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:03.626214 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312eb36-b4b2-4f60-9e11-15826abf868b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:03.778402 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4312eb36-b4b2-4f60-9e11-15826abf868b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0dc8c51819f41f2b84b7ee652537db7', 'request_id': 'req-4312eb36-b4b2-4f60-9e11-15826abf868b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:03.783933 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4312eb36-b4b2-4f60-9e11-15826abf868b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0dc8c51819f41f2b84b7ee652537db7', 'request_id': 'req-4312eb36-b4b2-4f60-9e11-15826abf868b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:03.790958 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4312eb36-b4b2-4f60-9e11-15826abf868b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0dc8c51819f41f2b84b7ee652537db7', 'request_id': 'req-4312eb36-b4b2-4f60-9e11-15826abf868b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:03.862540 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4312eb36-b4b2-4f60-9e11-15826abf868b admin admin] The token cache is being invalidate because project c0dc8c51819f41f2b84b7ee652537db7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:54:03.862826 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4312eb36-b4b2-4f60-9e11-15826abf868b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:03.864403 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4312eb36-b4b2-4f60-9e11-15826abf868b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:03.865959 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1313/2626] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:54:03 2022] DELETE /identity/v3/projects/c0dc8c51819f41f2b84b7ee652537db7 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:54:03.870117 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56854978-7ba6-4472-aee1-a02974807dfa admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:03.871543 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-56854978-7ba6-4472-aee1-a02974807dfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:03.884999 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56854978-7ba6-4472-aee1-a02974807dfa admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:03.942517 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b56e2-4754-4b08-89fa-0bfb008d9017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:03.943150 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b56e2-4754-4b08-89fa-0bfb008d9017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:03.943417 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b56e2-4754-4b08-89fa-0bfb008d9017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:03.943771 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b56e2-4754-4b08-89fa-0bfb008d9017 admin admin] PATH_INFO: `/v3/users/072a999f2877497a9e4680056b2d964f` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:03.944841 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b56e2-4754-4b08-89fa-0bfb008d9017 admin admin] RBAC: Authorizing `identity:delete_user(user_id=072a999f2877497a9e4680056b2d964f)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:03.946755 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b56e2-4754-4b08-89fa-0bfb008d9017 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:03.952230 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:54:04.145029 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-139b56e2-4754-4b08-89fa-0bfb008d9017 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '072a999f2877497a9e4680056b2d964f'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:04.157092 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-139b56e2-4754-4b08-89fa-0bfb008d9017 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '072a999f2877497a9e4680056b2d964f'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:04.164040 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-139b56e2-4754-4b08-89fa-0bfb008d9017 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '072a999f2877497a9e4680056b2d964f'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:04.164758 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-139b56e2-4754-4b08-89fa-0bfb008d9017 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '072a999f2877497a9e4680056b2d964f'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:04.165375 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-139b56e2-4754-4b08-89fa-0bfb008d9017 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '072a999f2877497a9e4680056b2d964f'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:04.262244 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1314/2627] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Nov 2 07:54:03 2022] DELETE /identity/v3/users/072a999f2877497a9e4680056b2d964f => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:54:04.515955 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312eb36-b4b2-4f60-9e11-15826abf868b admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:04.517441 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4312eb36-b4b2-4f60-9e11-15826abf868b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:04.534893 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312eb36-b4b2-4f60-9e11-15826abf868b admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:04.594459 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078bcbea-62af-4046-99e2-8a0ed93fd30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7738e47cbf7c4d698504a795d02c194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9bbbd097ac4710887083fd253be149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:04.595232 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bcbea-62af-4046-99e2-8a0ed93fd30f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:04.595532 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bcbea-62af-4046-99e2-8a0ed93fd30f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:04.595802 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bcbea-62af-4046-99e2-8a0ed93fd30f admin admin] PATH_INFO: `/v3/projects/f5cb2662dc0545ef820c0637aa11157d` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:04.596958 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078bcbea-62af-4046-99e2-8a0ed93fd30f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5cb2662dc0545ef820c0637aa11157d)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:04.599511 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078bcbea-62af-4046-99e2-8a0ed93fd30f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:04.620905 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:54:04.697425 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-078bcbea-62af-4046-99e2-8a0ed93fd30f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5cb2662dc0545ef820c0637aa11157d', 'request_id': 'req-078bcbea-62af-4046-99e2-8a0ed93fd30f'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:04.702897 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-078bcbea-62af-4046-99e2-8a0ed93fd30f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5cb2662dc0545ef820c0637aa11157d', 'request_id': 'req-078bcbea-62af-4046-99e2-8a0ed93fd30f'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:04.709755 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-078bcbea-62af-4046-99e2-8a0ed93fd30f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5cb2662dc0545ef820c0637aa11157d', 'request_id': 'req-078bcbea-62af-4046-99e2-8a0ed93fd30f'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:04.776262 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-078bcbea-62af-4046-99e2-8a0ed93fd30f admin admin] The token cache is being invalidate because project f5cb2662dc0545ef820c0637aa11157d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:54:04.776547 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-078bcbea-62af-4046-99e2-8a0ed93fd30f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:04.777163 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-078bcbea-62af-4046-99e2-8a0ed93fd30f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:04.778641 dv-cinder-804757-31-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1314/2628] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Nov 2 07:54:04 2022] DELETE /identity/v3/projects/f5cb2662dc0545ef820c0637aa11157d => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:54:14.258698 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:54:14.773189 dv-cinder-804757-31-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:55:21.474482 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b56e2-4754-4b08-89fa-0bfb008d9017 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:55:21.475893 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-139b56e2-4754-4b08-89fa-0bfb008d9017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:55:21.544120 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b56e2-4754-4b08-89fa-0bfb008d9017 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:55:21.601096 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad99bd4-1a04-4afa-8650-03054f1ccbe5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '741c9fc71c80438faa037c85f4997c3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3bf3e930dd407f8401c0487edc8c20', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:55:21.601704 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad99bd4-1a04-4afa-8650-03054f1ccbe5 service placement] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:55:21.602596 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad99bd4-1a04-4afa-8650-03054f1ccbe5 service placement] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:55:21.602867 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad99bd4-1a04-4afa-8650-03054f1ccbe5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:55:21.604587 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-cad99bd4-1a04-4afa-8650-03054f1ccbe5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:55:21.615427 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad99bd4-1a04-4afa-8650-03054f1ccbe5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:55:21.617018 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad99bd4-1a04-4afa-8650-03054f1ccbe5 service placement] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:55:21.626623 dv-cinder-804757-31-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1315/2629] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Nov 2 07:55:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:55:31.622505 dv-cinder-804757-31-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=58 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}